-- Logs begin at Thu 2022-09-01 15:47:45 UTC, end at Thu 2022-09-01 16:56:22 UTC. -- Sep 01 16:18:15.814583 dv-cinder-852208-16-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 01 16:18:15.822055 dv-cinder-852208-16-smb devstack@keystone.service[81484]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 01 16:18:15.824098 dv-cinder-852208-16-smb devstack@keystone.service[81484]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 16:18:15 2022] *** Sep 01 16:18:15.824098 dv-cinder-852208-16-smb devstack@keystone.service[81484]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 16:18:15.824098 dv-cinder-852208-16-smb devstack@keystone.service[81484]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 16:18:15.824098 dv-cinder-852208-16-smb devstack@keystone.service[81484]: nodename: dv-cinder-852208-16-smb Sep 01 16:18:15.824098 dv-cinder-852208-16-smb devstack@keystone.service[81484]: machine: x86_64 Sep 01 16:18:15.824098 dv-cinder-852208-16-smb devstack@keystone.service[81484]: clock source: unix Sep 01 16:18:15.824098 dv-cinder-852208-16-smb devstack@keystone.service[81484]: pcre jit disabled Sep 01 16:18:15.824691 dv-cinder-852208-16-smb devstack@keystone.service[81484]: detected number of CPU cores: 4 Sep 01 16:18:15.824691 dv-cinder-852208-16-smb devstack@keystone.service[81484]: current working directory: / Sep 01 16:18:15.824691 dv-cinder-852208-16-smb devstack@keystone.service[81484]: detected binary path: /usr/bin/uwsgi-core Sep 01 16:18:15.824691 dv-cinder-852208-16-smb devstack@keystone.service[81484]: your processes number limit is 47680 Sep 01 16:18:15.824691 dv-cinder-852208-16-smb devstack@keystone.service[81484]: your memory page size is 4096 bytes Sep 01 16:18:15.824691 dv-cinder-852208-16-smb devstack@keystone.service[81484]: detected max file descriptor number: 2048 Sep 01 16:18:15.824691 dv-cinder-852208-16-smb devstack@keystone.service[81484]: lock engine: pthread robust mutexes Sep 01 16:18:15.824691 dv-cinder-852208-16-smb devstack@keystone.service[81484]: thunder lock: enabled Sep 01 16:18:15.824691 dv-cinder-852208-16-smb devstack@keystone.service[81484]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 01 16:18:15.824691 dv-cinder-852208-16-smb devstack@keystone.service[81484]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 16:18:15.865115 dv-cinder-852208-16-smb devstack@keystone.service[81484]: Python main interpreter initialized at 0x564b50bde9c0 Sep 01 16:18:15.865115 dv-cinder-852208-16-smb devstack@keystone.service[81484]: python threads support enabled Sep 01 16:18:15.865115 dv-cinder-852208-16-smb devstack@keystone.service[81484]: your server socket listen backlog is limited to 100 connections Sep 01 16:18:15.865115 dv-cinder-852208-16-smb devstack@keystone.service[81484]: your mercy for graceful operations on workers is 90 seconds Sep 01 16:18:15.865521 dv-cinder-852208-16-smb devstack@keystone.service[81484]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 16:18:15.865598 dv-cinder-852208-16-smb devstack@keystone.service[81484]: *** Operational MODE: preforking *** Sep 01 16:18:15.865858 dv-cinder-852208-16-smb devstack@keystone.service[81484]: *** uWSGI is running in multiple interpreter mode *** Sep 01 16:18:15.865858 dv-cinder-852208-16-smb devstack@keystone.service[81484]: spawned uWSGI master process (pid: 81484) Sep 01 16:18:15.866063 dv-cinder-852208-16-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 01 16:18:15.868106 dv-cinder-852208-16-smb devstack@keystone.service[81484]: spawned uWSGI worker 1 (pid: 81497, cores: 1) Sep 01 16:18:15.868106 dv-cinder-852208-16-smb devstack@keystone.service[81484]: spawned uWSGI worker 2 (pid: 81498, cores: 1) Sep 01 16:18:15.868106 dv-cinder-852208-16-smb devstack@keystone.service[81484]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 16:18:20.173514 dv-cinder-852208-16-smb devstack@keystone.service[81497]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:18:20.173514 dv-cinder-852208-16-smb devstack@keystone.service[81497]: from cryptography.utils import int_from_bytes Sep 01 16:18:20.174285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:18:20.174285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: from cryptography.utils import int_from_bytes Sep 01 16:18:20.174285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:18:20.174285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: from cryptography.utils import int_from_bytes Sep 01 16:18:20.174832 dv-cinder-852208-16-smb devstack@keystone.service[81497]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:18:20.174832 dv-cinder-852208-16-smb devstack@keystone.service[81497]: from cryptography.utils import int_from_bytes Sep 01 16:18:20.223842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:18:20.224043 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:18:20.224139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:18:20.224225 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] command line args: [] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:18:20.224303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:18:20.224466 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] command line args: [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:18:20.224544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:18:20.224652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ================================================================================ {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:18:20.224730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:18:20.224902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ================================================================================ {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:18:20.224979 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] admin_token = **** {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.225147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] config_dir = [] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.225236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] admin_token = **** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.225339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.225424 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] config_dir = [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.225524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] config_source = [] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.225605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.225708 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] debug = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.225793 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] config_source = [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.225902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] debug = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.225979 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.226201 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.226346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.226450 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.226545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.226676 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.226787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.226889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.226992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.227088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.227189 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] list_limit = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.227283 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] list_limit = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.227383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] log_config_append = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.227489 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] log_config_append = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.227599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.227700 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.227801 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] log_dir = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.227901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] log_dir = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.228007 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] log_file = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.228108 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] log_file = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.228224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.228308 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.228426 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.228507 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.228622 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.228702 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.228824 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.228902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.229020 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.229101 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.229173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.229296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.229378 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.229501 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.229582 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.229655 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.229778 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.229867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.230015 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.230132 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.230247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.230324 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.230480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.230607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.230773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.230901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.231013 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.231130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.231277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.231406 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.231766 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.231896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.232023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] publish_errors = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.232127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] publish_errors = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.232239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.232350 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.232462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.232581 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.232581 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.232808 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.232921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.233053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.233168 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.233281 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.233399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] standard_threads = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.233518 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] standard_threads = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.233632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.233752 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.233867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.233979 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.234091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.234209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.234323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] use_journal = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.234486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] use_journal = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.234608 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] use_json = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.234756 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] use_json = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.234877 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] use_stderr = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.234997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] use_stderr = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.235110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] use_syslog = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.235234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] use_syslog = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.235349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.235461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:18:20.235580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.235693 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.235813 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.235935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.236055 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.236174 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.236288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.236406 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.236525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.236647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.236761 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.236880 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.236993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.237106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.237225 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.237349 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.237464 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.237576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.237689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.237801 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.237920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.238041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.238155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.238268 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.238386 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.238499 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.238626 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.238761 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.238878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.238997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.239110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.239223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.239336 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.239456 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.239577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.239691 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.239803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.239921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.240041 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.240230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.240346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.240473 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.240594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.240714 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.240837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.240951 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.241064 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.241176 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.241288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.241407 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.241529 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.241642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.241755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.241872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.241986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.242099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.242223 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.242338 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.242450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.242562 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.242700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.242814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.242940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.243054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.243168 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.243287 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.243401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.243513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.243633 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.243748 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.243861 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.243978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.244092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.244205 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.244326 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.244445 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.244559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.244672 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.244784 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.244897 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.245018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.245131 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.245245 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.245357 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.245469 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.245581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.245769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.245885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.245998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.246143 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.246266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.246379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.246501 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.246630 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.246756 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.246877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.246996 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.247110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.247231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.247346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.247458 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.247570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.247688 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.247801 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.247926 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.248047 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.248161 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.248273 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.248386 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.248497 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.248605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.248702 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.248802 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.248935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.249041 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.249151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.249249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.249343 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.249439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.249540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.249655 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.249769 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.249883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.249997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.250102 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.250223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.250346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.250474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.250590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.250743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.250859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.250973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.251086 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.251199 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.251313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.251437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.251553 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.251667 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.251781 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.251900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.252059 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.252185 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.252300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.252404 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.252506 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.252627 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.252742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.252863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.252983 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.253097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.253211 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.253323 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.253436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.253560 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.253675 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.253788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.253901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.254013 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.254126 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.254247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.254362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.254481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.254596 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.254761 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.254874 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.255000 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.255116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.255229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.255342 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.255455 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.255568 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.255691 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.255805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.255919 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.256033 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.256146 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.256259 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.256380 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.256495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.256609 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.256729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.256843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.256963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.257153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.257270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.257385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.257498 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.257618 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.257746 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.257874 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.257998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.258113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.258233 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.258347 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.258461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.258574 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.258713 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.258832 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.258945 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.259058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.259172 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.259285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.259406 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.259521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.259634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.259748 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.259869 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.259983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.260105 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.260220 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.260333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.260453 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.260575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.260723 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.260850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] auth.external = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.260973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] auth.external = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.261097 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.261213 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.261327 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.261443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.261557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.261679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.262321 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] auth.password = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.262440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] auth.password = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.262554 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] auth.token = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.262708 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] auth.token = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.262824 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.262938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.263066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.263183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.263297 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.263412 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.263526 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.263640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.263766 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.263882 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.263997 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.264113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.264227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.264341 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.264468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] credential.caching = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.264584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] credential.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.264699 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.264814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.264928 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.265049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.265174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.265290 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.265404 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.265519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.265639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.265755 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.265878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.265993 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.266107 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.266223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.266337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.266452 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.266574 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.266701 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.266816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.266930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.267044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.267158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.267286 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.267402 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.267516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.267630 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.267745 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.267862 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.267989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.268104 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.268219 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] federation.caching = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.268334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] federation.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.268448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.268568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.268692 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.268807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.268922 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.269036 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.269150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.269271 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.269395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.269512 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.269627 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.269741 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.269855 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.269977 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.270092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.270207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.270321 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.270436 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.270550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.270716 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.270850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.270966 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.271080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] identity.caching = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.271195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.271308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.271494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.271612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.271727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.271841 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.271962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.272078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.272201 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.272316 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.272432 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.272546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.272660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.272773 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.272896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.273017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.273139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.273254 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.273369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.273483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.273609 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.273725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.273840 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.273960 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.274075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.274196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.274319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.274435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.274551 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.274689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.274807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.274911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.275037 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.275153 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.275336 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.275455 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.275570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.275686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.275809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.275924 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.276039 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.276153 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.276273 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.276389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.276512 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.276628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.276743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.276857 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.276972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.277085 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.277208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.277324 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.277468 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.278103 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.278220 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.278335 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.278463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.278580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.278742 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.278858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.278972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.279086 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.279213 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.279329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.279443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.279558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.279672 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.279795 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.279910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.280031 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.280147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.280261 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.280376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.280498 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.280614 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.280728 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.280843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.280957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.281071 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.281194 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.281309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.281423 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.281537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.281651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.281765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.281888 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.282004 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.282118 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.282232 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.282346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.282460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.282582 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.282717 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.282832 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.282947 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.283062 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.283175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.283301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.283417 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.283540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.283655 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.283769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.283883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.284010 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.284126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.284241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.284355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.284470 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.284584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.284707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.284829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.284945 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.285061 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.285175 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.285289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.285411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.285526 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.285640 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.285754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.285868 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.285982 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.286106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.286221 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.286335 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.286433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.286546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.286698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.286827 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.286944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.287059 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.287180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.287295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.287408 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.287530 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.287646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.287760 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.287874 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.287989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.288103 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.288226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.288341 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.288461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.288575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.288689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.288821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.288944 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.289060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.289174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.289289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.289403 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.289517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.289640 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.289755 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.289870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.289984 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.290098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.290211 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.290339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.290456 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.290570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.290695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.290695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.290909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.291036 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.291152 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.291266 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.291381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.291495 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.291609 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.291731 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.291847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.291961 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.292075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.292189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.292303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.292426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] resource.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.292541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] resource.caching = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.292654 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.292769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.292866 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.292962 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.293184 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.293304 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.293420 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.293536 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.293651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.293765 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.293888 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.294003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.294118 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.294233 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.294347 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.294536 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.294693 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.294811 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.294925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] role.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.295039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] role.caching = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.295153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] role.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.295280 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] role.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.295397 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.295512 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.295626 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.295740 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.295854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.295978 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.296094 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.296208 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.296323 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.296437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.296552 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.296674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.296790 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.296905 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.297019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.297133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.297248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.297370 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.297486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.297600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.297715 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.297829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.297943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.298066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.298182 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.298296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.298415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.298530 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.298659 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.298885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.299005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.299120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.299234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.299355 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.299471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.299597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.299715 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.299831 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.299946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.300060 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.300182 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.300299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.300414 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.300528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.300643 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.300643 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.300866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.300982 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.301097 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.301211 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.301325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.301439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.301439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.301662 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.301777 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.301892 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.302006 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.302120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.302243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.302359 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.302473 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.302588 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.302748 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.302864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.302990 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] token.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.303107 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.303221 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.303221 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.303435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.303549 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.303549 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.303774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] token.caching = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.303895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.304011 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.304126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.304126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.304348 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.304464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.304464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.304678 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.304791 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.304791 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.305013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.305129 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.305129 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.305343 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.305457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.305457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.305682 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.305810 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.305810 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.306027 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.306140 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.connection = **** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.306140 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.306351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.306477 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.306477 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.306710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.306825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.306939 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.307054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.307054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.307282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.307397 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.307397 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.307611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.307725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.307847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.307962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.308076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.308191 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.308304 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.308623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.308759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.308876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.308876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.309102 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.309219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.309333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.connection = **** {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.309448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.309562 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.309685 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.309801 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.309916 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.310030 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.310145 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:18:20.310260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.310260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.310260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.310260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.310260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.310837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.310837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.310837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.311166 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.311280 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.311499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.311749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.311984 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.312227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.312465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:18:20.312708 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:18:20.341283 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.341761 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.341986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.343642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.343880 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.344110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.350603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.352479 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.379345 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.379577 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.381282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.381518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.432914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.433715 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.482418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.482531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.482679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.482760 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.637244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.637479 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.637656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.637745 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.637892 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.637978 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.638120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.638207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.638338 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.638431 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.638554 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.638798 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.662035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.662269 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.662499 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.662763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.662991 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.663210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.663426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.664034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.664427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.664817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.665145 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.665375 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.665597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.665820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.675287 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.679536 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.689889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.690230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.690641 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.691063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.691458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.691856 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.691939 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.692154 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.692247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.692383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.692606 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.692824 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.693040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.693256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:18:20.709483 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.709697 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 16:18:20.709781 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.709953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 16:18:20.710282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.710386 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.710491 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 16:18:20.710573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 16:18:20.710797 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.710918 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.711064 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.711146 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.711327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.711407 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.711585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.711665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.721695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.721979 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.722070 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.722255 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.722340 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.722538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.722652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.722902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.729480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.729917 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.732937 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.733225 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.733428 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.733530 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.733719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.733804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.734011 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.734094 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.734303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.734387 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.734594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.734704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.734889 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.734974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.735168 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.735249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.735450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.735534 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.735730 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.735811 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.736008 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.736279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.758306 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.759110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.759793 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.760079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.760580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.760865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.764800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.765088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.765373 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.765482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.765771 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.766059 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.771733 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.772017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.772617 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.772902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.776106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.776395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.776682 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.776894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.776979 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.777189 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.777274 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.778000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.778091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.778288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.778381 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.778562 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.778679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.780581 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.780880 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.781172 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.796345 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.796625 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.797255 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.797534 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.800633 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.802430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.803790 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.804088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.805603 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.805904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.808310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.810282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.811637 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.813467 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.814755 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.815071 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.815360 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.815647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.815937 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.816219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.816580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.816892 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.817183 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.817469 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.817753 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.818140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.832096 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.832393 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.832663 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.832927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.834150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.834442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.834741 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.835009 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.839808 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.842123 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.842577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.843700 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.843978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.844270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.845824 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.846104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.846760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.847050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.847344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.847628 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.847915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.848787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.849072 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.849366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.849651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.849940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.859825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.860115 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.860397 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.860679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.860964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.861242 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.861538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.861918 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.862205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.862496 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.862806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.863095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.863375 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.863671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.877076 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.879267 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.880018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.882318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.882952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.884516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.885237 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.885995 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.886280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.886592 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.886693 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.889989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.890475 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.891412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.894906 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.896533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.899455 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.899570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.899754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.900042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.900320 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.900941 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.904436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.904743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.905034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.905320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.908883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.909176 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.909458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.913791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.914088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.914374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.916265 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.916552 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.916836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.917114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.917389 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.917663 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.917939 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.918243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.918645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.918936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.919214 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.919481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.919751 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.920038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.921355 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:18:20.921644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.921932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.922211 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.922485 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.922789 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.923069 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.923351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.923640 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.923921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.924196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.924463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.924733 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.925020 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:18:20.954394 dv-cinder-852208-16-smb devstack@keystone.service[81497]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564b50bde9c0 pid: 81497 (default app) Sep 01 16:18:20.957655 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709c1d8-972f-4082-83c0-c9c6bf0e1c44 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:20.957944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709c1d8-972f-4082-83c0-c9c6bf0e1c44 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:20.958216 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709c1d8-972f-4082-83c0-c9c6bf0e1c44 None None] PATH_INFO: `/v3` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:20.959770 dv-cinder-852208-16-smb devstack@keystone.service[81498]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564b50bde9c0 pid: 81498 (default app) Sep 01 16:18:20.962511 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 791 bytes} [Thu Sep 1 16:18:20 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:27.500509 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772dac1-4b97-4070-95f3-b8182303562e None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:27.501019 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772dac1-4b97-4070-95f3-b8182303562e None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:27.501128 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772dac1-4b97-4070-95f3-b8182303562e None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:27.505346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1/2] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:18:27.510354 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb7a34-6f9d-4ce8-ba5c-0559f00ba37a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:27.510809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb7a34-6f9d-4ce8-ba5c-0559f00ba37a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:27.510948 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb7a34-6f9d-4ce8-ba5c-0559f00ba37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:27.580873 dv-cinder-852208-16-smb devstack@keystone.service[81497]: INFO dbcounter [None req-a7cb7a34-6f9d-4ce8-ba5c-0559f00ba37a None None] Registered counter for database keystone Sep 01 16:18:27.599735 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG oslo_db.sqlalchemy.engines [None req-a7cb7a34-6f9d-4ce8-ba5c-0559f00ba37a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:18:27.605851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writer thread running {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:18:27.781694 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG passlib.handlers.bcrypt [None req-a7cb7a34-6f9d-4ce8-ba5c-0559f00ba37a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81497) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 16:18:27.782090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG passlib.handlers.bcrypt [None req-a7cb7a34-6f9d-4ce8-ba5c-0559f00ba37a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81497) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 16:18:27.839549 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a7cb7a34-6f9d-4ce8-ba5c-0559f00ba37a None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:27.841177 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a7cb7a34-6f9d-4ce8-ba5c-0559f00ba37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:27.970920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 2/3] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 01 16:18:28.450838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772dac1-4b97-4070-95f3-b8182303562e None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:28.519358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: INFO dbcounter [None req-2772dac1-4b97-4070-95f3-b8182303562e None None] Registered counter for database keystone Sep 01 16:18:28.540494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG oslo_db.sqlalchemy.engines [None req-2772dac1-4b97-4070-95f3-b8182303562e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:18:28.546491 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writer thread running {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:18:28.663711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772dac1-4b97-4070-95f3-b8182303562e None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:28.667915 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa23a6d-ade7-4fd5-bb77-75cf2a9e4fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:28.669048 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa23a6d-ade7-4fd5-bb77-75cf2a9e4fbf admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:28.669320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa23a6d-ade7-4fd5-bb77-75cf2a9e4fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:28.669584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa23a6d-ade7-4fd5-bb77-75cf2a9e4fbf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:28.677768 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa23a6d-ade7-4fd5-bb77-75cf2a9e4fbf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:28.728513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cfa23a6d-ade7-4fd5-bb77-75cf2a9e4fbf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 16:18:28.728793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa23a6d-ade7-4fd5-bb77-75cf2a9e4fbf admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:28.738518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 2/4] 10.222.0.71 () {58 vars in 1324 bytes} [Thu Sep 1 16:18:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:18:28.744365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb7a34-6f9d-4ce8-ba5c-0559f00ba37a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:28.759205 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb7a34-6f9d-4ce8-ba5c-0559f00ba37a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:28.763591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86ed71-fda6-44b7-a8a6-b7aa43631096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:28.764670 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86ed71-fda6-44b7-a8a6-b7aa43631096 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:28.764953 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86ed71-fda6-44b7-a8a6-b7aa43631096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:28.765223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86ed71-fda6-44b7-a8a6-b7aa43631096 admin admin] PATH_INFO: `/v3/projects/4331680a8fba4a9c848da35bab7c3c6a` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:28.766809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86ed71-fda6-44b7-a8a6-b7aa43631096 admin admin] RBAC: Authorizing `identity:get_project(project_id=4331680a8fba4a9c848da35bab7c3c6a)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:28.818843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2e86ed71-fda6-44b7-a8a6-b7aa43631096 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 16:18:28.819184 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86ed71-fda6-44b7-a8a6-b7aa43631096 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:28.823636 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 3/5] 10.222.0.71 () {56 vars in 1207 bytes} [Thu Sep 1 16:18:28 2022] GET /identity/v3/projects/4331680a8fba4a9c848da35bab7c3c6a => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:30.704425 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d863e4-edb3-45ef-8ff9-f3c8b7215fc3 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:30.704890 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d863e4-edb3-45ef-8ff9-f3c8b7215fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:30.704970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d863e4-edb3-45ef-8ff9-f3c8b7215fc3 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:30.709065 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 3/6] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:30.714311 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72977b26-acd7-41a0-8b36-21f5314e513b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:30.714748 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72977b26-acd7-41a0-8b36-21f5314e513b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:30.714901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72977b26-acd7-41a0-8b36-21f5314e513b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:30.735153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-72977b26-acd7-41a0-8b36-21f5314e513b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:30.736673 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-72977b26-acd7-41a0-8b36-21f5314e513b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:30.744404 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 4/7] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 16:18:31.008885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d863e4-edb3-45ef-8ff9-f3c8b7215fc3 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:31.020886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d863e4-edb3-45ef-8ff9-f3c8b7215fc3 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:31.025053 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb052910-6efb-4093-9822-8e52f9fad356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:31.025643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb052910-6efb-4093-9822-8e52f9fad356 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:31.025924 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb052910-6efb-4093-9822-8e52f9fad356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:31.026198 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb052910-6efb-4093-9822-8e52f9fad356 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:31.034394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb052910-6efb-4093-9822-8e52f9fad356 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:31.036185 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb052910-6efb-4093-9822-8e52f9fad356 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:31.045466 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 4/8] 10.222.0.71 () {58 vars in 1324 bytes} [Thu Sep 1 16:18:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:18:31.051187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72977b26-acd7-41a0-8b36-21f5314e513b None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:31.060658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72977b26-acd7-41a0-8b36-21f5314e513b None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:31.065029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d775dd-e711-4e47-a9d3-3870f64c189b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:31.065650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d775dd-e711-4e47-a9d3-3870f64c189b admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:31.065933 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d775dd-e711-4e47-a9d3-3870f64c189b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:31.066212 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d775dd-e711-4e47-a9d3-3870f64c189b admin admin] PATH_INFO: `/v3/users/935f6e33b5664b82a96e7a902653bf28` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:31.067557 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d775dd-e711-4e47-a9d3-3870f64c189b admin admin] RBAC: Authorizing `identity:get_user(user_id=935f6e33b5664b82a96e7a902653bf28)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:31.069370 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d775dd-e711-4e47-a9d3-3870f64c189b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:31.070918 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 5/9] 10.222.0.71 () {56 vars in 1198 bytes} [Thu Sep 1 16:18:31 2022] GET /identity/v3/users/935f6e33b5664b82a96e7a902653bf28 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:33.018481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8af2d-2f26-45ca-a539-238bc8d5d121 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.019082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8af2d-2f26-45ca-a539-238bc8d5d121 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.019082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8af2d-2f26-45ca-a539-238bc8d5d121 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.020327 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 5/10] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:33.025338 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814f30-fbc7-4aa7-a80b-26589b9a78f3 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.025740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814f30-fbc7-4aa7-a80b-26589b9a78f3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.026001 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814f30-fbc7-4aa7-a80b-26589b9a78f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.044247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-3b814f30-fbc7-4aa7-a80b-26589b9a78f3 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:33.045410 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3b814f30-fbc7-4aa7-a80b-26589b9a78f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:33.079952 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45192fc2-3b07-426b-a53e-80d4d935280a None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.080459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45192fc2-3b07-426b-a53e-80d4d935280a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.080817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45192fc2-3b07-426b-a53e-80d4d935280a None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.082947 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 6/11] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:18:33.087991 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf4be1-1ffb-4cea-97cb-bffdb801c587 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.088272 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf4be1-1ffb-4cea-97cb-bffdb801c587 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.088544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf4be1-1ffb-4cea-97cb-bffdb801c587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.126586 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 6/12] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:33.131162 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG passlib.handlers.bcrypt [None req-8acf4be1-1ffb-4cea-97cb-bffdb801c587 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81498) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 16:18:33.131564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG passlib.handlers.bcrypt [None req-8acf4be1-1ffb-4cea-97cb-bffdb801c587 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81498) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 16:18:33.180173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-8acf4be1-1ffb-4cea-97cb-bffdb801c587 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:33.181755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-8acf4be1-1ffb-4cea-97cb-bffdb801c587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:33.281848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 7/13] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:18:33.391112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b814f30-fbc7-4aa7-a80b-26589b9a78f3 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:33.414466 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:33.493890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b814f30-fbc7-4aa7-a80b-26589b9a78f3 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:33.526143 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a5fdc-6a8e-4bc6-a7f4-4263a9772430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:33.526805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a5fdc-6a8e-4bc6-a7f4-4263a9772430 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.527087 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a5fdc-6a8e-4bc6-a7f4-4263a9772430 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.527881 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a5fdc-6a8e-4bc6-a7f4-4263a9772430 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.541437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a5fdc-6a8e-4bc6-a7f4-4263a9772430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:33.542378 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf4be1-1ffb-4cea-97cb-bffdb801c587 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:33.550079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-969a5fdc-6a8e-4bc6-a7f4-4263a9772430 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:33.550079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:33.550079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:33.550079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:33.550079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:33.550079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:33.550079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:33.550079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:33.550079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:33.550079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:33.550079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:33.550079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:33.550079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:33.550079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:33.550079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:33.550079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:33.551042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:33.551042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:33.551042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:33.551042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:33.551042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:33.551042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:33.551042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:33.551042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:33.551042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:33.551042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:33.551042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:33.551042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:33.551042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:33.551042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:33.551042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:33.551042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:33.551914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:33.551914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:33.551914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:33.551914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:33.551914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:33.551914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:33.551914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:33.551914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:33.551914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:33.551914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:33.551914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:33.551914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:18:33.551914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 7/14] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:33.556770 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a5fdc-6a8e-4bc6-a7f4-4263a9772430 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:33.637666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:33.649624 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf4be1-1ffb-4cea-97cb-bffdb801c587 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:33.651921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:33.656949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a5fdc-6a8e-4bc6-a7f4-4263a9772430 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:33.688002 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54be675-5b0b-4cfd-b727-0a8a7e06dcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:33.688848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54be675-5b0b-4cfd-b727-0a8a7e06dcec None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.689138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54be675-5b0b-4cfd-b727-0a8a7e06dcec None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.689409 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54be675-5b0b-4cfd-b727-0a8a7e06dcec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.691564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bcd0f-8902-4646-8047-f4853004ea84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:33.692162 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bcd0f-8902-4646-8047-f4853004ea84 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.692443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bcd0f-8902-4646-8047-f4853004ea84 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.692717 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bcd0f-8902-4646-8047-f4853004ea84 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.693391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bcd0f-8902-4646-8047-f4853004ea84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:33.693692 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bcd0f-8902-4646-8047-f4853004ea84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:33.695113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bcd0f-8902-4646-8047-f4853004ea84 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:33.706743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 8/15] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:33.712184 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bcd0f-8902-4646-8047-f4853004ea84 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:33.755683 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54be675-5b0b-4cfd-b727-0a8a7e06dcec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:33.757190 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54be675-5b0b-4cfd-b727-0a8a7e06dcec None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:33.809145 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bcd0f-8902-4646-8047-f4853004ea84 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:33.843775 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14305ea-2e0e-4db8-baf2-7ae555a03e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:33.844394 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14305ea-2e0e-4db8-baf2-7ae555a03e52 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.844673 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14305ea-2e0e-4db8-baf2-7ae555a03e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.844946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14305ea-2e0e-4db8-baf2-7ae555a03e52 None admin] PATH_INFO: `/v3/users/935f6e33b5664b82a96e7a902653bf28` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.846083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14305ea-2e0e-4db8-baf2-7ae555a03e52 None admin] RBAC: Authorizing `identity:get_user(user_id=935f6e33b5664b82a96e7a902653bf28)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:33.847547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14305ea-2e0e-4db8-baf2-7ae555a03e52 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:33.849380 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 9/16] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:33 2022] GET /identity/v3/users/935f6e33b5664b82a96e7a902653bf28 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:33.854659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 8/17] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:18:33.854816 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14305ea-2e0e-4db8-baf2-7ae555a03e52 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:33.859308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54be675-5b0b-4cfd-b727-0a8a7e06dcec None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:33.861980 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:33.869332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:33.953780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14305ea-2e0e-4db8-baf2-7ae555a03e52 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:33.957965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54be675-5b0b-4cfd-b727-0a8a7e06dcec None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:33.987436 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d372f-1aef-4386-a6aa-7ad6f67dec96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:33.988058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d372f-1aef-4386-a6aa-7ad6f67dec96 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.988335 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d372f-1aef-4386-a6aa-7ad6f67dec96 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.988604 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d372f-1aef-4386-a6aa-7ad6f67dec96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.989702 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d372f-1aef-4386-a6aa-7ad6f67dec96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:33.991197 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d372f-1aef-4386-a6aa-7ad6f67dec96 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:33.991627 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009520c1-0b4e-4d31-81ca-a2526b97bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:33.992456 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009520c1-0b4e-4d31-81ca-a2526b97bb7f None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.992733 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 10/18] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:33.992855 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009520c1-0b4e-4d31-81ca-a2526b97bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.992994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009520c1-0b4e-4d31-81ca-a2526b97bb7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.998795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d372f-1aef-4386-a6aa-7ad6f67dec96 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:34.011278 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009520c1-0b4e-4d31-81ca-a2526b97bb7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:34.013274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009520c1-0b4e-4d31-81ca-a2526b97bb7f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:34.031546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-009520c1-0b4e-4d31-81ca-a2526b97bb7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:34.031546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:34.031546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:34.031546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:34.031546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:34.031546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:34.031546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:34.031546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:34.031546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:34.031546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:34.031546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:34.031546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:34.031546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:18:34.031546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:18:34.031546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:18:34.031546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:18:34.032881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:34.032881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:34.032881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:34.032881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:34.032881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:34.032881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:34.032881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:34.032881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:34.032881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:34.032881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:34.032881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:34.032881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:34.032881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:34.032881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:34.032881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:34.032881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:34.032881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:18:34.033712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:18:34.033712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:34.033712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:18:34.033712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 9/19] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:18:34.038285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009520c1-0b4e-4d31-81ca-a2526b97bb7f None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:34.079285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:34.094897 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:34.098493 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d372f-1aef-4386-a6aa-7ad6f67dec96 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:34.131956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3873bc9-7ebd-41b2-99ac-0eb890e96e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:34.132566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3873bc9-7ebd-41b2-99ac-0eb890e96e0d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:34.132842 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3873bc9-7ebd-41b2-99ac-0eb890e96e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:34.133116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3873bc9-7ebd-41b2-99ac-0eb890e96e0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:34.133844 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3873bc9-7ebd-41b2-99ac-0eb890e96e0d None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.domain.id=default, user.id=935f6e33b5664b82a96e7a902653bf28) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:34.134233 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3873bc9-7ebd-41b2-99ac-0eb890e96e0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:34.135606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3873bc9-7ebd-41b2-99ac-0eb890e96e0d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:34.139656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009520c1-0b4e-4d31-81ca-a2526b97bb7f None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:34.142684 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 11/20] 10.222.0.71 () {56 vars in 1322 bytes} [Thu Sep 1 16:18:33 2022] GET /identity/v3/role_assignments?user.id=935f6e33b5664b82a96e7a902653bf28&scope.domain.id=default&role.id=3cd61239237441418529e9028ef801e4 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:34.175592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c18d06-5d4c-4a5a-a117-1b987db34de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:34.176214 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c18d06-5d4c-4a5a-a117-1b987db34de6 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:34.176492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c18d06-5d4c-4a5a-a117-1b987db34de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:34.176762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c18d06-5d4c-4a5a-a117-1b987db34de6 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:34.177421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c18d06-5d4c-4a5a-a117-1b987db34de6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:34.177790 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c18d06-5d4c-4a5a-a117-1b987db34de6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:34.179237 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c18d06-5d4c-4a5a-a117-1b987db34de6 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:34.198568 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 10/21] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:36.216509 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801890f-9659-48c5-b72e-3b9452f1eb24 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:36.217311 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801890f-9659-48c5-b72e-3b9452f1eb24 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:36.217311 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801890f-9659-48c5-b72e-3b9452f1eb24 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:36.218969 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 12/22] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:36.224604 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf4ec1-62e6-4598-8f79-046bccc68659 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:36.225454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf4ec1-62e6-4598-8f79-046bccc68659 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:36.225951 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf4ec1-62e6-4598-8f79-046bccc68659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:36.249589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-4cbf4ec1-62e6-4598-8f79-046bccc68659 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:36.251523 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4cbf4ec1-62e6-4598-8f79-046bccc68659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:36.329213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 11/23] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:36.429792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279ccdd-bf37-4aa1-ab01-915505024965 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:36.430569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279ccdd-bf37-4aa1-ab01-915505024965 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:36.431075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279ccdd-bf37-4aa1-ab01-915505024965 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:36.432852 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 13/24] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:36.438923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7df4ca-d9fb-40be-a6b7-f149e8f948af None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:36.439432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7df4ca-d9fb-40be-a6b7-f149e8f948af None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:36.439922 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7df4ca-d9fb-40be-a6b7-f149e8f948af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:36.463142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-ec7df4ca-d9fb-40be-a6b7-f149e8f948af None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:36.464643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ec7df4ca-d9fb-40be-a6b7-f149e8f948af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:36.522797 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:36.557410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 12/25] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:18:36.566351 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb0249-c6c4-4ea1-9bb7-ea029f92cc75 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:36.566970 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb0249-c6c4-4ea1-9bb7-ea029f92cc75 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:36.567461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb0249-c6c4-4ea1-9bb7-ea029f92cc75 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:36.568985 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 14/26] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:36.574334 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6fb47-609d-40ba-90d2-2511c0f0c764 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:36.575384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6fb47-609d-40ba-90d2-2511c0f0c764 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:36.575858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6fb47-609d-40ba-90d2-2511c0f0c764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:36.597184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-86f6fb47-609d-40ba-90d2-2511c0f0c764 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:36.598716 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-86f6fb47-609d-40ba-90d2-2511c0f0c764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:36.695694 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 13/27] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:36.821776 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb0249-c6c4-4ea1-9bb7-ea029f92cc75 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:36.946431 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb0249-c6c4-4ea1-9bb7-ea029f92cc75 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:36.990391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ebd76-641a-49f7-8145-26fbbcb36f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:36.991070 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ebd76-641a-49f7-8145-26fbbcb36f2f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:36.991348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ebd76-641a-49f7-8145-26fbbcb36f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:36.991620 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ebd76-641a-49f7-8145-26fbbcb36f2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:37.007445 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ebd76-641a-49f7-8145-26fbbcb36f2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:37.013315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-cc5ebd76-641a-49f7-8145-26fbbcb36f2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:37.013315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:37.013315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:37.013315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:37.013315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:37.013315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:37.013315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:37.013315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:37.013315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:37.013315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:37.013315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:37.013315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:37.013315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:37.013315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:37.013315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:37.013315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:37.014178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:37.014178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:37.014178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:37.014178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:37.014178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:37.014178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:37.014178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:37.014178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:37.014178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:37.014178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:37.014178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:37.014178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:37.014178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:37.014178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:37.014178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:37.014178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:37.014973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:37.014973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:37.014973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:37.014973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:37.014973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:37.014973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:37.014973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:37.014973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:37.014973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:37.014973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:37.014973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:37.014973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:18:37.014973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 15/28] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:37.021387 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6fb47-609d-40ba-90d2-2511c0f0c764 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:37.069508 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ebd76-641a-49f7-8145-26fbbcb36f2f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:37.073637 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:37.201199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6fb47-609d-40ba-90d2-2511c0f0c764 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:37.212152 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:37.236162 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ebd76-641a-49f7-8145-26fbbcb36f2f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:37.251387 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce9219-a882-4b46-933a-7702e2a613fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:37.251991 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce9219-a882-4b46-933a-7702e2a613fc None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:37.252267 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce9219-a882-4b46-933a-7702e2a613fc None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:37.252536 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce9219-a882-4b46-933a-7702e2a613fc None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:37.253196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce9219-a882-4b46-933a-7702e2a613fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:37.253492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce9219-a882-4b46-933a-7702e2a613fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:37.255010 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce9219-a882-4b46-933a-7702e2a613fc None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:37.266825 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 14/29] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:37.267490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce9219-a882-4b46-933a-7702e2a613fc None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:37.278666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc043ed-7fea-494c-952e-fdcbe458e6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:37.279334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc043ed-7fea-494c-952e-fdcbe458e6a1 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:37.279618 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc043ed-7fea-494c-952e-fdcbe458e6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:37.279888 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc043ed-7fea-494c-952e-fdcbe458e6a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:37.280620 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc043ed-7fea-494c-952e-fdcbe458e6a1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:37.281988 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc043ed-7fea-494c-952e-fdcbe458e6a1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:37.379518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce9219-a882-4b46-933a-7702e2a613fc None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:37.416048 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584a299-de7e-424e-b263-81fcb5c8f35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:37.416680 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584a299-de7e-424e-b263-81fcb5c8f35a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:37.417001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584a299-de7e-424e-b263-81fcb5c8f35a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:37.417279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584a299-de7e-424e-b263-81fcb5c8f35a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:37.423788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 16/30] 10.222.0.71 () {60 vars in 1131 bytes} [Thu Sep 1 16:18:37 2022] POST /identity/v3/roles => generated 219 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:18:37.425305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f65be6-8013-401e-81f4-0057ba000500 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:37.425592 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f65be6-8013-401e-81f4-0057ba000500 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:37.425866 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f65be6-8013-401e-81f4-0057ba000500 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:37.430807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 17/31] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:37.431711 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f65be6-8013-401e-81f4-0057ba000500 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:37.434018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584a299-de7e-424e-b263-81fcb5c8f35a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:37.435619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584a299-de7e-424e-b263-81fcb5c8f35a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:37.473413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-4584a299-de7e-424e-b263-81fcb5c8f35a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:37.473413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:37.473413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:37.473413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:37.473413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:37.473413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:37.473413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:37.473413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:37.473413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:37.473413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:37.473413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:37.473413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:37.473413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:18:37.473413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:18:37.473413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:18:37.473413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:18:37.475989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:37.475989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:37.475989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:37.475989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:37.475989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:37.475989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:37.475989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:37.475989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:37.475989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:37.475989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:37.475989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:37.475989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:37.475989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:37.475989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:37.475989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:37.475989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:37.475989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:18:37.478044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:18:37.478044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:37.478044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:18:37.478044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 15/32] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:37.478545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f0934-8544-425e-9544-b4e3ca8c05d4 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:37.482805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f0934-8544-425e-9544-b4e3ca8c05d4 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:37.482805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f0934-8544-425e-9544-b4e3ca8c05d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:37.520279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-ee8f0934-8544-425e-9544-b4e3ca8c05d4 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:37.522644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ee8f0934-8544-425e-9544-b4e3ca8c05d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:37.555658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:37.568684 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:37.649655 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f65be6-8013-401e-81f4-0057ba000500 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:37.659096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 16/33] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:37.667556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f0934-8544-425e-9544-b4e3ca8c05d4 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:37.690035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acbb46-7b94-4b35-a122-bc2348d565fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:37.690740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acbb46-7b94-4b35-a122-bc2348d565fb None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:37.691271 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acbb46-7b94-4b35-a122-bc2348d565fb None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:37.691547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acbb46-7b94-4b35-a122-bc2348d565fb None admin] PATH_INFO: `/v3/users/935f6e33b5664b82a96e7a902653bf28` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:37.692877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acbb46-7b94-4b35-a122-bc2348d565fb None admin] RBAC: Authorizing `identity:get_user(user_id=935f6e33b5664b82a96e7a902653bf28)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:37.695082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acbb46-7b94-4b35-a122-bc2348d565fb None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:37.697047 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 18/34] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:37 2022] GET /identity/v3/users/935f6e33b5664b82a96e7a902653bf28 => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:37.702432 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acbb46-7b94-4b35-a122-bc2348d565fb None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:37.814698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f0934-8544-425e-9544-b4e3ca8c05d4 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:37.823139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acbb46-7b94-4b35-a122-bc2348d565fb None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:37.857983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:37.859004 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfe68b-5fc1-42fc-8be9-09b2629a612b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:37.859891 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfe68b-5fc1-42fc-8be9-09b2629a612b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:37.860369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfe68b-5fc1-42fc-8be9-09b2629a612b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:37.860985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfe68b-5fc1-42fc-8be9-09b2629a612b None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:37.861835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfe68b-5fc1-42fc-8be9-09b2629a612b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:37.862368 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfe68b-5fc1-42fc-8be9-09b2629a612b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:37.864298 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfe68b-5fc1-42fc-8be9-09b2629a612b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:37.865149 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fd4ad-ab98-4bd9-bdeb-e8fff44c9187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:37.866800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fd4ad-ab98-4bd9-bdeb-e8fff44c9187 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:37.867092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fd4ad-ab98-4bd9-bdeb-e8fff44c9187 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:37.867443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fd4ad-ab98-4bd9-bdeb-e8fff44c9187 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:37.868907 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fd4ad-ab98-4bd9-bdeb-e8fff44c9187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:37.870474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fd4ad-ab98-4bd9-bdeb-e8fff44c9187 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:37.872241 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 19/35] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:37.878042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fd4ad-ab98-4bd9-bdeb-e8fff44c9187 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:37.879343 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 17/36] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:37.885009 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfe68b-5fc1-42fc-8be9-09b2629a612b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:37.899272 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:37.993365 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfe68b-5fc1-42fc-8be9-09b2629a612b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:37.994498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fd4ad-ab98-4bd9-bdeb-e8fff44c9187 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:38.029899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc8e6a-6d7a-48ac-95a6-7a0068ba5d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:38.031048 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc8e6a-6d7a-48ac-95a6-7a0068ba5d3b None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.031536 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc8e6a-6d7a-48ac-95a6-7a0068ba5d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.031885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fe3c5-f701-4abe-9140-9b543cb15ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:38.032260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc8e6a-6d7a-48ac-95a6-7a0068ba5d3b None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.032548 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fe3c5-f701-4abe-9140-9b543cb15ad7 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.032832 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fe3c5-f701-4abe-9140-9b543cb15ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.033113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fe3c5-f701-4abe-9140-9b543cb15ad7 None admin] PATH_INFO: `/v3/domains/default/users/935f6e33b5664b82a96e7a902653bf28/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.033959 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc8e6a-6d7a-48ac-95a6-7a0068ba5d3b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:38.035440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fe3c5-f701-4abe-9140-9b543cb15ad7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=935f6e33b5664b82a96e7a902653bf28, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:38.036037 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc8e6a-6d7a-48ac-95a6-7a0068ba5d3b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:38.036886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fe3c5-f701-4abe-9140-9b543cb15ad7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:38.054746 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 20/37] 10.222.0.71 () {58 vars in 1361 bytes} [Thu Sep 1 16:18:37 2022] PUT /identity/v3/domains/default/users/935f6e33b5664b82a96e7a902653bf28/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:18:38.055740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fe3c5-f701-4abe-9140-9b543cb15ad7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:38.129968 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:38.204678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fe3c5-f701-4abe-9140-9b543cb15ad7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:38.213938 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 18/38] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Sep 1 16:18:37 2022] POST /identity/v3/projects => generated 301 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:18:38.216042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7a78e-fe88-4993-a104-d0fcb8cf2e6b None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.216557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7a78e-fe88-4993-a104-d0fcb8cf2e6b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.217326 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7a78e-fe88-4993-a104-d0fcb8cf2e6b None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.219308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 19/39] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:38.225627 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3ea98-9c25-4673-81c9-44444fada131 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.226402 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3ea98-9c25-4673-81c9-44444fada131 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.226947 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3ea98-9c25-4673-81c9-44444fada131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.253177 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-d2f3ea98-9c25-4673-81c9-44444fada131 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:38.255759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d2f3ea98-9c25-4673-81c9-44444fada131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:38.259546 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20173e-548b-492d-a1a4-24b24b540d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:38.260899 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20173e-548b-492d-a1a4-24b24b540d14 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.261375 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20173e-548b-492d-a1a4-24b24b540d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.261900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20173e-548b-492d-a1a4-24b24b540d14 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.262916 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20173e-548b-492d-a1a4-24b24b540d14 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:38.264612 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20173e-548b-492d-a1a4-24b24b540d14 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:38.287041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 21/40] 10.222.0.71 () {60 vars in 1131 bytes} [Thu Sep 1 16:18:38 2022] POST /identity/v3/roles => generated 225 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:38.335745 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:38.342433 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 20/41] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:38.347018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6d855-6ffb-4c5f-aaa4-a8a6ecbbaaff None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.347311 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6d855-6ffb-4c5f-aaa4-a8a6ecbbaaff None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.347595 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6d855-6ffb-4c5f-aaa4-a8a6ecbbaaff None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.348971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 22/42] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:38.355017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2dbb6-c0a9-43fa-9a87-bf5e9ffe0ffd None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.356127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2dbb6-c0a9-43fa-9a87-bf5e9ffe0ffd None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.356609 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2dbb6-c0a9-43fa-9a87-bf5e9ffe0ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.379654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-c7f2dbb6-c0a9-43fa-9a87-bf5e9ffe0ffd None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:38.381340 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c7f2dbb6-c0a9-43fa-9a87-bf5e9ffe0ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:38.465151 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 21/43] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:38.669122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6d855-6ffb-4c5f-aaa4-a8a6ecbbaaff None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:38.736435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2dbb6-c0a9-43fa-9a87-bf5e9ffe0ffd None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:38.790810 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6d855-6ffb-4c5f-aaa4-a8a6ecbbaaff None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:38.812879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:38.828735 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a490d-7ad7-4bf8-adba-869bfb6127ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:38.829393 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a490d-7ad7-4bf8-adba-869bfb6127ea None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.829705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a490d-7ad7-4bf8-adba-869bfb6127ea None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.829946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a490d-7ad7-4bf8-adba-869bfb6127ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.831292 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a490d-7ad7-4bf8-adba-869bfb6127ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:38.832743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a490d-7ad7-4bf8-adba-869bfb6127ea None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:38.834301 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 23/44] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:38.840492 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a490d-7ad7-4bf8-adba-869bfb6127ea None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:38.847331 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2dbb6-c0a9-43fa-9a87-bf5e9ffe0ffd None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:38.874389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:38.888711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb095a3-0a8c-4d9d-8b8e-b7ea180a83fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:38.889324 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb095a3-0a8c-4d9d-8b8e-b7ea180a83fd None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.889605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb095a3-0a8c-4d9d-8b8e-b7ea180a83fd None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.889891 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb095a3-0a8c-4d9d-8b8e-b7ea180a83fd None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.890548 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb095a3-0a8c-4d9d-8b8e-b7ea180a83fd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:38.892089 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb095a3-0a8c-4d9d-8b8e-b7ea180a83fd None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:38.907365 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 22/45] 10.222.0.71 () {60 vars in 1131 bytes} [Thu Sep 1 16:18:38 2022] POST /identity/v3/roles => generated 223 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:18:38.950378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a490d-7ad7-4bf8-adba-869bfb6127ea None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:38.988789 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb7cca-8914-4b14-9bbf-9dfca8c9c1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:38.989401 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb7cca-8914-4b14-9bbf-9dfca8c9c1f7 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.989688 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb7cca-8914-4b14-9bbf-9dfca8c9c1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.989963 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb7cca-8914-4b14-9bbf-9dfca8c9c1f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.990653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb7cca-8914-4b14-9bbf-9dfca8c9c1f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:38.992124 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb7cca-8914-4b14-9bbf-9dfca8c9c1f7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:39.023422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 24/46] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Sep 1 16:18:38 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:40.157039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f3e2f-e41a-44f7-bae8-db9659fb583d None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:40.157556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f3e2f-e41a-44f7-bae8-db9659fb583d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:40.157639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f3e2f-e41a-44f7-bae8-db9659fb583d None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:40.158982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 23/47] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:40.164330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec1fc2-0490-4fa6-bc1b-badc08f68b49 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:40.164731 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec1fc2-0490-4fa6-bc1b-badc08f68b49 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:40.164875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec1fc2-0490-4fa6-bc1b-badc08f68b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:40.183488 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-18ec1fc2-0490-4fa6-bc1b-badc08f68b49 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:40.185000 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-18ec1fc2-0490-4fa6-bc1b-badc08f68b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:40.220685 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:40.255005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 25/48] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:40.524584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f3e2f-e41a-44f7-bae8-db9659fb583d None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:40.736329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f3e2f-e41a-44f7-bae8-db9659fb583d None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:40.769736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a6f1e-c3af-459c-8b75-51e82dac923a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:40.770392 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a6f1e-c3af-459c-8b75-51e82dac923a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:40.770704 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a6f1e-c3af-459c-8b75-51e82dac923a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:40.770985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a6f1e-c3af-459c-8b75-51e82dac923a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:40.782595 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a6f1e-c3af-459c-8b75-51e82dac923a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:40.788968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-c36a6f1e-c3af-459c-8b75-51e82dac923a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:40.788968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:40.788968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:40.788968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:40.788968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:40.788968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:40.788968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:40.788968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:40.788968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:40.788968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:40.788968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:40.788968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:40.788968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:40.788968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:40.788968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:40.788968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:40.789873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:40.789873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:40.789873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:40.789873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:40.789873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:40.789873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:40.789873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:40.789873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:40.789873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:40.789873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:40.789873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:40.789873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:40.789873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:40.789873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:40.789873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:40.789873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:40.790650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:40.790650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:40.790650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:40.790650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:40.790650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:40.790650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:40.790650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:40.790650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:40.790650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:40.790650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:40.790650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:40.790650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:18:40.790650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 24/49] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:40.795972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec1fc2-0490-4fa6-bc1b-badc08f68b49 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:40.988325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa4763-e437-4986-b0a0-b16504af3cb1 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:40.988714 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa4763-e437-4986-b0a0-b16504af3cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:40.989061 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa4763-e437-4986-b0a0-b16504af3cb1 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:40.990507 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 25/50] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:18:40.995280 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973840c-1225-46a5-acf6-b23755a0c228 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:40.995563 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973840c-1225-46a5-acf6-b23755a0c228 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:40.995838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973840c-1225-46a5-acf6-b23755a0c228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:41.000165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec1fc2-0490-4fa6-bc1b-badc08f68b49 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:41.014334 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-6973840c-1225-46a5-acf6-b23755a0c228 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:41.015556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6973840c-1225-46a5-acf6-b23755a0c228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:41.034335 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31327ae1-5633-46b3-afbe-05542d255959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:41.034908 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31327ae1-5633-46b3-afbe-05542d255959 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:41.035188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31327ae1-5633-46b3-afbe-05542d255959 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:41.035458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31327ae1-5633-46b3-afbe-05542d255959 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:41.036118 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31327ae1-5633-46b3-afbe-05542d255959 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:41.036415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31327ae1-5633-46b3-afbe-05542d255959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:41.037759 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31327ae1-5633-46b3-afbe-05542d255959 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:41.046422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 26/51] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:41.051762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:41.051880 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31327ae1-5633-46b3-afbe-05542d255959 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:41.081573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:41.086645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 26/52] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:18:41.154595 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31327ae1-5633-46b3-afbe-05542d255959 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:41.192753 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b1ec9-4379-4121-9844-50069e5edfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:41.193380 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b1ec9-4379-4121-9844-50069e5edfc1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:41.193656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b1ec9-4379-4121-9844-50069e5edfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:41.193927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b1ec9-4379-4121-9844-50069e5edfc1 None admin] PATH_INFO: `/v3/users/935f6e33b5664b82a96e7a902653bf28` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:41.195105 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b1ec9-4379-4121-9844-50069e5edfc1 None admin] RBAC: Authorizing `identity:get_user(user_id=935f6e33b5664b82a96e7a902653bf28)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:41.196532 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b1ec9-4379-4121-9844-50069e5edfc1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:41.198104 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 27/53] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:41 2022] GET /identity/v3/users/935f6e33b5664b82a96e7a902653bf28 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:41.204184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973840c-1225-46a5-acf6-b23755a0c228 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:41.299324 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973840c-1225-46a5-acf6-b23755a0c228 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:41.331696 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eddf34-1746-4bc1-b24d-1b9b48ca3571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:41.332315 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eddf34-1746-4bc1-b24d-1b9b48ca3571 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:41.332599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eddf34-1746-4bc1-b24d-1b9b48ca3571 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:41.332867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eddf34-1746-4bc1-b24d-1b9b48ca3571 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:41.333954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eddf34-1746-4bc1-b24d-1b9b48ca3571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:41.335413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eddf34-1746-4bc1-b24d-1b9b48ca3571 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:41.336942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 27/54] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:41.343890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b1ec9-4379-4121-9844-50069e5edfc1 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:41.357869 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eddf34-1746-4bc1-b24d-1b9b48ca3571 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:41.399327 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:41.442064 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:41.445154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b1ec9-4379-4121-9844-50069e5edfc1 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:41.456646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eddf34-1746-4bc1-b24d-1b9b48ca3571 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:41.479060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a8d60-5bf2-4c31-a790-93efaea83ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:41.479666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a8d60-5bf2-4c31-a790-93efaea83ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:41.479946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a8d60-5bf2-4c31-a790-93efaea83ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:41.480224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a8d60-5bf2-4c31-a790-93efaea83ff9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:41.481500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a8d60-5bf2-4c31-a790-93efaea83ff9 None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.domain.id=default, user.id=935f6e33b5664b82a96e7a902653bf28) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:41.481811 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a8d60-5bf2-4c31-a790-93efaea83ff9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:41.483274 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a8d60-5bf2-4c31-a790-93efaea83ff9 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:41.489112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 28/55] 10.222.0.71 () {56 vars in 1322 bytes} [Thu Sep 1 16:18:41 2022] GET /identity/v3/role_assignments?user.id=935f6e33b5664b82a96e7a902653bf28&scope.domain.id=default&role.id=3cd61239237441418529e9028ef801e4 => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:41.490142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a3926-8fa0-49e1-b87c-2cd0838ae804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:41.490787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a3926-8fa0-49e1-b87c-2cd0838ae804 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:41.491073 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a3926-8fa0-49e1-b87c-2cd0838ae804 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:41.491352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a3926-8fa0-49e1-b87c-2cd0838ae804 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:41.492482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a3926-8fa0-49e1-b87c-2cd0838ae804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:41.493949 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a3926-8fa0-49e1-b87c-2cd0838ae804 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:41.495649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 28/56] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:41.501919 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a8d60-5bf2-4c31-a790-93efaea83ff9 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:41.605160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a8d60-5bf2-4c31-a790-93efaea83ff9 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:41.642683 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fd9b7-5ad2-4c78-ae1a-c555beae6be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:41.643254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fd9b7-5ad2-4c78-ae1a-c555beae6be0 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:41.643546 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fd9b7-5ad2-4c78-ae1a-c555beae6be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:41.643876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fd9b7-5ad2-4c78-ae1a-c555beae6be0 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:41.644466 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fd9b7-5ad2-4c78-ae1a-c555beae6be0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:41.645889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fd9b7-5ad2-4c78-ae1a-c555beae6be0 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:41.672558 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 29/57] 10.222.0.71 () {60 vars in 1140 bytes} [Thu Sep 1 16:18:41 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:43.601129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84fbf2-496b-4e32-87e0-0eebc8a3786c None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:43.601644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84fbf2-496b-4e32-87e0-0eebc8a3786c None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:43.601758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84fbf2-496b-4e32-87e0-0eebc8a3786c None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:43.603058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 29/58] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:43.608207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25343b35-df9e-4b2e-a4f2-4a1740c3b659 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:43.608580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25343b35-df9e-4b2e-a4f2-4a1740c3b659 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:43.608896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25343b35-df9e-4b2e-a4f2-4a1740c3b659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:43.626476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-25343b35-df9e-4b2e-a4f2-4a1740c3b659 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:43.627675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-25343b35-df9e-4b2e-a4f2-4a1740c3b659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:43.638422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:43.692841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 30/59] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:43.959934 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84fbf2-496b-4e32-87e0-0eebc8a3786c None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:44.062431 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84fbf2-496b-4e32-87e0-0eebc8a3786c None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:44.071163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:44.095639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e10be3-0758-4739-bb3d-2cc8ea32bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:44.096257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e10be3-0758-4739-bb3d-2cc8ea32bfda None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:44.096539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e10be3-0758-4739-bb3d-2cc8ea32bfda None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:44.096813 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e10be3-0758-4739-bb3d-2cc8ea32bfda None admin] PATH_INFO: `/v3/domains/default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:44.097909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e10be3-0758-4739-bb3d-2cc8ea32bfda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:44.099372 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e10be3-0758-4739-bb3d-2cc8ea32bfda None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:44.100909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 30/60] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:44.106274 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25343b35-df9e-4b2e-a4f2-4a1740c3b659 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:44.202042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25343b35-df9e-4b2e-a4f2-4a1740c3b659 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:44.235133 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a509a-1bfc-4e06-9ecf-c0b0371391e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:44.235676 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a509a-1bfc-4e06-9ecf-c0b0371391e9 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:44.235957 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a509a-1bfc-4e06-9ecf-c0b0371391e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:44.236236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a509a-1bfc-4e06-9ecf-c0b0371391e9 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:44.236897 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a509a-1bfc-4e06-9ecf-c0b0371391e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:44.238330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a509a-1bfc-4e06-9ecf-c0b0371391e9 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:44.264659 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 31/61] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:18:44 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:47.034484 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337db449-831e-42cd-bc82-adee6f35f3d5 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:47.035485 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337db449-831e-42cd-bc82-adee6f35f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:47.035982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337db449-831e-42cd-bc82-adee6f35f3d5 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:47.037511 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 31/62] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:47.042794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355c36-7586-48aa-ae2e-00aab5f42adb None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:47.043655 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355c36-7586-48aa-ae2e-00aab5f42adb None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:47.044124 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355c36-7586-48aa-ae2e-00aab5f42adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:47.050777 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:47.068112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-e4355c36-7586-48aa-ae2e-00aab5f42adb None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:47.069712 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e4355c36-7586-48aa-ae2e-00aab5f42adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:47.159635 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 32/63] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:47.490017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4593068-555d-497d-a8ea-c8d342c310fc None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:47.490017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4593068-555d-497d-a8ea-c8d342c310fc None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:47.490017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4593068-555d-497d-a8ea-c8d342c310fc None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:47.490017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 32/64] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:47.495025 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4593068-555d-497d-a8ea-c8d342c310fc None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:47.495697 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c869ce-ca5a-43f4-97c2-97e32ed3e0cc None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:47.496200 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c869ce-ca5a-43f4-97c2-97e32ed3e0cc None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:47.496620 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c869ce-ca5a-43f4-97c2-97e32ed3e0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:47.528203 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-26c869ce-ca5a-43f4-97c2-97e32ed3e0cc None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:47.529663 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-26c869ce-ca5a-43f4-97c2-97e32ed3e0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:47.612453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4593068-555d-497d-a8ea-c8d342c310fc None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:47.642006 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 33/65] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:47.651024 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aa6d4-bdab-4bc3-89e2-124850075729 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:47.651490 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aa6d4-bdab-4bc3-89e2-124850075729 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:47.651923 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aa6d4-bdab-4bc3-89e2-124850075729 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:47.653902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 34/66] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:47.657476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1014f9a-3cb5-44f1-b71a-68d854736cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:47.658287 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1014f9a-3cb5-44f1-b71a-68d854736cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:47.658748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1014f9a-3cb5-44f1-b71a-68d854736cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:47.659134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b6f7c-ba82-4af6-aa71-387c6ab1d8d1 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:47.659340 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1014f9a-3cb5-44f1-b71a-68d854736cd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:47.659445 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b6f7c-ba82-4af6-aa71-387c6ab1d8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:47.659680 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b6f7c-ba82-4af6-aa71-387c6ab1d8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:47.671132 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1014f9a-3cb5-44f1-b71a-68d854736cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:47.676323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-d1014f9a-3cb5-44f1-b71a-68d854736cd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:47.676323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:47.676323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:47.676323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:47.676323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:47.676323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:47.676323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:47.676323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:47.676323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:47.676323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:47.676323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:47.676323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:47.676323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:47.676323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:47.676323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:47.676323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:47.677357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:47.677357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:47.677357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:47.677357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:47.677357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:47.677357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:47.677357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:47.677357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:47.677357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:47.677357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:47.677357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:47.677357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:47.677357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:47.677357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:47.677357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:47.677357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:47.678308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:47.678308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:47.678308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:47.678308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:47.678308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:47.678308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:47.678308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:47.678308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:47.678308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:47.678308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:47.678308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:47.678308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:18:47.680150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 33/67] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:47.687788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1014f9a-3cb5-44f1-b71a-68d854736cd0 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:47.695843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-075b6f7c-ba82-4af6-aa71-387c6ab1d8d1 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:47.697038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-075b6f7c-ba82-4af6-aa71-387c6ab1d8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:47.759042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:47.798757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:47.816740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 35/68] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:18:47.857972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1014f9a-3cb5-44f1-b71a-68d854736cd0 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:47.905220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3dc09-5c2a-486c-8a76-bd2004429337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:47.905886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3dc09-5c2a-486c-8a76-bd2004429337 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:47.906166 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3dc09-5c2a-486c-8a76-bd2004429337 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:47.906443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3dc09-5c2a-486c-8a76-bd2004429337 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:47.907136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3dc09-5c2a-486c-8a76-bd2004429337 None admin] RBAC: Adding query filter params (name=member) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:47.907437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3dc09-5c2a-486c-8a76-bd2004429337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:47.908876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3dc09-5c2a-486c-8a76-bd2004429337 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:47.922464 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 34/69] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:47.928416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b6f7c-ba82-4af6-aa71-387c6ab1d8d1 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:47.934079 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3dc09-5c2a-486c-8a76-bd2004429337 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:48.043837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:48.046018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b6f7c-ba82-4af6-aa71-387c6ab1d8d1 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:48.047737 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3dc09-5c2a-486c-8a76-bd2004429337 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:48.081853 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744381f6-d053-4160-b63f-ca646896caba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:48.082489 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744381f6-d053-4160-b63f-ca646896caba None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.082802 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744381f6-d053-4160-b63f-ca646896caba None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.083080 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744381f6-d053-4160-b63f-ca646896caba None admin] PATH_INFO: `/v3/users/f6ba851c651742d19299e159edabe065` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.084160 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83df9a0-08fa-4c99-b40e-cacb46466770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:48.084790 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83df9a0-08fa-4c99-b40e-cacb46466770 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.085074 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83df9a0-08fa-4c99-b40e-cacb46466770 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.085352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83df9a0-08fa-4c99-b40e-cacb46466770 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.096166 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83df9a0-08fa-4c99-b40e-cacb46466770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:48.099236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744381f6-d053-4160-b63f-ca646896caba None admin] RBAC: Authorizing `identity:get_user(user_id=f6ba851c651742d19299e159edabe065)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:48.100932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744381f6-d053-4160-b63f-ca646896caba None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:48.101241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-a83df9a0-08fa-4c99-b40e-cacb46466770 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:48.101241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:48.101241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:48.101241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:48.101241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:48.101241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:48.101241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:48.101241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:48.101241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:48.101241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:48.101241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:48.101241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:48.101241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:48.101241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:48.101241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:48.101241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:48.102106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:48.102106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:48.102106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:48.102106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:48.102106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:48.102106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:48.102106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:48.102106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:48.102106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:48.102106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:48.102106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:48.102106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:48.102106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:48.102106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:48.102106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:48.102106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:48.102904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:48.102904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:48.102904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:48.102904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:48.102904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:48.102904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:48.102904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:48.102904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:48.102904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:48.102904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:48.102904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:48.102904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:18:48.102904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 35/70] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:18:48.103535 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 36/71] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:47 2022] GET /identity/v3/users/f6ba851c651742d19299e159edabe065 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:48.106793 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad784d-6f95-42f2-8eef-6d2c87c69c47 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.106793 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad784d-6f95-42f2-8eef-6d2c87c69c47 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.106793 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad784d-6f95-42f2-8eef-6d2c87c69c47 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.107023 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34db0c-505d-441b-98af-2d88edea1f58 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.107023 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34db0c-505d-441b-98af-2d88edea1f58 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.107023 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34db0c-505d-441b-98af-2d88edea1f58 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.107281 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 37/72] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:48.107345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 36/73] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:48.107407 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad784d-6f95-42f2-8eef-6d2c87c69c47 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:48.108383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34db0c-505d-441b-98af-2d88edea1f58 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:48.158527 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:48.211320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34db0c-505d-441b-98af-2d88edea1f58 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:48.212842 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad784d-6f95-42f2-8eef-6d2c87c69c47 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:48.245042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c857a3-8e48-4ddb-95ad-48b3f3eb5902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:48.245637 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c857a3-8e48-4ddb-95ad-48b3f3eb5902 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.245886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c8797-b79a-4ee8-99ce-c13facdf0d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:48.246079 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c857a3-8e48-4ddb-95ad-48b3f3eb5902 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.246778 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c857a3-8e48-4ddb-95ad-48b3f3eb5902 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.247108 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c8797-b79a-4ee8-99ce-c13facdf0d77 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.247395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c8797-b79a-4ee8-99ce-c13facdf0d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.247504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c857a3-8e48-4ddb-95ad-48b3f3eb5902 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:48.247669 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c8797-b79a-4ee8-99ce-c13facdf0d77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.247757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c857a3-8e48-4ddb-95ad-48b3f3eb5902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:48.249082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c857a3-8e48-4ddb-95ad-48b3f3eb5902 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:48.257030 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 37/74] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:48.257630 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c8797-b79a-4ee8-99ce-c13facdf0d77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:48.257805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c857a3-8e48-4ddb-95ad-48b3f3eb5902 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:48.263332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-e93c8797-b79a-4ee8-99ce-c13facdf0d77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:18:48.263332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:48.263332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:48.263332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:48.263332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:48.263332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:48.263332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:48.263332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:48.263332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:48.263332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:48.263332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:48.263332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:48.263332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:48.263332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:48.263332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:48.263332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:48.264367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:48.264367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:48.264367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:48.264367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:48.264367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:48.264367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:48.264367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:48.264367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:48.264367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:48.264367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:48.264367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:48.264367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:48.264367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:48.264367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:48.264367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:48.264367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:48.265127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:48.265127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:48.265127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:48.265127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:48.265127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:48.265127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:48.265127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:48.265127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:48.265127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:48.265127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:48.265127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:18:48.265127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:18:48.265127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 38/75] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:18:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:48.267771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144cd25-124d-4e57-860e-8487dc246790 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.268054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144cd25-124d-4e57-860e-8487dc246790 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.268333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144cd25-124d-4e57-860e-8487dc246790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.279578 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:48.286314 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2144cd25-124d-4e57-860e-8487dc246790 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:48.287544 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2144cd25-124d-4e57-860e-8487dc246790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:48.352985 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 39/76] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:48.353954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60c1f-291e-43d3-a712-105e6c9e4cf6 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.354238 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60c1f-291e-43d3-a712-105e6c9e4cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.354519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60c1f-291e-43d3-a712-105e6c9e4cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.365617 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c857a3-8e48-4ddb-95ad-48b3f3eb5902 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:48.372374 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b4e60c1f-291e-43d3-a712-105e6c9e4cf6 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:48.373556 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b4e60c1f-291e-43d3-a712-105e6c9e4cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:48.403394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f5bb3-d6fc-4247-b510-ae8923d3bedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:48.404317 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5bb3-d6fc-4247-b510-ae8923d3bedc None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.404774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5bb3-d6fc-4247-b510-ae8923d3bedc None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.405234 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5bb3-d6fc-4247-b510-ae8923d3bedc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.406760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:48.442243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 40/77] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:48.451792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e60c1f-291e-43d3-a712-105e6c9e4cf6 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:48.478313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f5bb3-d6fc-4247-b510-ae8923d3bedc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:48.480092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f5bb3-d6fc-4247-b510-ae8923d3bedc None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:48.502336 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:48.591251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 38/78] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:48.592679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f5bb3-d6fc-4247-b510-ae8923d3bedc None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:48.593246 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e60c1f-291e-43d3-a712-105e6c9e4cf6 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:48.635935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad42d70-508f-487f-a3bd-886e9c61ec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:48.636593 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad42d70-508f-487f-a3bd-886e9c61ec23 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.636907 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad42d70-508f-487f-a3bd-886e9c61ec23 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.637180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad42d70-508f-487f-a3bd-886e9c61ec23 None admin] PATH_INFO: `/v3/users/935f6e33b5664b82a96e7a902653bf28` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.638310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad42d70-508f-487f-a3bd-886e9c61ec23 None admin] RBAC: Authorizing `identity:get_user(user_id=935f6e33b5664b82a96e7a902653bf28)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:48.639790 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad42d70-508f-487f-a3bd-886e9c61ec23 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:48.641362 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 41/79] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:48 2022] GET /identity/v3/users/935f6e33b5664b82a96e7a902653bf28 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:48.642106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad42d70-508f-487f-a3bd-886e9c61ec23 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:48.680213 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:48.709289 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f5bb3-d6fc-4247-b510-ae8923d3bedc None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:48.734042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:48.741035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad42d70-508f-487f-a3bd-886e9c61ec23 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:48.748931 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012e984-f6b0-4431-8d23-69185dfae9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:48.749537 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012e984-f6b0-4431-8d23-69185dfae9cc None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.749817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012e984-f6b0-4431-8d23-69185dfae9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.750088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012e984-f6b0-4431-8d23-69185dfae9cc None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.750777 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012e984-f6b0-4431-8d23-69185dfae9cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:48.751088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012e984-f6b0-4431-8d23-69185dfae9cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:48.752466 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012e984-f6b0-4431-8d23-69185dfae9cc None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:48.760567 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 39/80] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:18:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:48.761357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012e984-f6b0-4431-8d23-69185dfae9cc None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:48.774821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86113055-e06e-4476-8d20-f09c57bbddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:48.775451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86113055-e06e-4476-8d20-f09c57bbddcf None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.775731 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86113055-e06e-4476-8d20-f09c57bbddcf None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.776005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86113055-e06e-4476-8d20-f09c57bbddcf None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.777125 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86113055-e06e-4476-8d20-f09c57bbddcf None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:48.778582 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86113055-e06e-4476-8d20-f09c57bbddcf None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:48.780241 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 42/81] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:48 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:48.780995 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86113055-e06e-4476-8d20-f09c57bbddcf None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:48.859803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012e984-f6b0-4431-8d23-69185dfae9cc None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:48.877795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86113055-e06e-4476-8d20-f09c57bbddcf None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:48.885829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:48.893116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67bd73-ec52-4aba-9d14-fec7b818e728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:48.893745 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67bd73-ec52-4aba-9d14-fec7b818e728 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.894028 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67bd73-ec52-4aba-9d14-fec7b818e728 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.894303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67bd73-ec52-4aba-9d14-fec7b818e728 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.904136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67bd73-ec52-4aba-9d14-fec7b818e728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:48.909946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-7f67bd73-ec52-4aba-9d14-fec7b818e728 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:48.909946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:48.909946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:48.909946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:48.909946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:48.909946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:48.909946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:48.909946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:48.909946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:48.909946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:48.909946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:48.909946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:48.909946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:48.909946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:48.909946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:48.909946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:48.910814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:48.910814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:48.910814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:48.910814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:48.910814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:48.910814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:48.910814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:48.910814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:48.910814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:48.910814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:48.910814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:48.910814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:48.910814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:48.910814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:48.910814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:48.910814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:48.911593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:48.911593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:48.911593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:48.911593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:48.911593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:48.911593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:48.911593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:48.911593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:48.911593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:48.911593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:48.911593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:48.911593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:18:48.911593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 40/82] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:48.912505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a64565-2a43-460a-9702-bb5cbea62f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:48.913110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a64565-2a43-460a-9702-bb5cbea62f81 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.913295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67bd73-ec52-4aba-9d14-fec7b818e728 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:48.913404 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a64565-2a43-460a-9702-bb5cbea62f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.913645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a64565-2a43-460a-9702-bb5cbea62f81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.956451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:48.980841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a64565-2a43-460a-9702-bb5cbea62f81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:48.982381 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a64565-2a43-460a-9702-bb5cbea62f81 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:49.012827 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67bd73-ec52-4aba-9d14-fec7b818e728 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:49.046153 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9adaf-b2e5-46b3-bd44-98a4b01750e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:49.046834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9adaf-b2e5-46b3-bd44-98a4b01750e3 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.047083 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9adaf-b2e5-46b3-bd44-98a4b01750e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.047380 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9adaf-b2e5-46b3-bd44-98a4b01750e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.048505 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9adaf-b2e5-46b3-bd44-98a4b01750e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:49.049948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9adaf-b2e5-46b3-bd44-98a4b01750e3 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:49.051538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 41/83] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:49.052306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9adaf-b2e5-46b3-bd44-98a4b01750e3 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:49.080538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 43/84] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:49.081557 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a64565-2a43-460a-9702-bb5cbea62f81 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:49.089158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:49.156212 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9adaf-b2e5-46b3-bd44-98a4b01750e3 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:49.166454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:49.179455 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a64565-2a43-460a-9702-bb5cbea62f81 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:49.189711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529683f9-f1d5-4df0-9a72-da3be5cf343b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:49.190332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529683f9-f1d5-4df0-9a72-da3be5cf343b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.190633 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529683f9-f1d5-4df0-9a72-da3be5cf343b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.190913 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529683f9-f1d5-4df0-9a72-da3be5cf343b None admin] PATH_INFO: `/v3/users/f6ba851c651742d19299e159edabe065` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.192273 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529683f9-f1d5-4df0-9a72-da3be5cf343b None admin] RBAC: Authorizing `identity:get_user(user_id=f6ba851c651742d19299e159edabe065)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:49.193702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529683f9-f1d5-4df0-9a72-da3be5cf343b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:49.195478 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 42/85] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:49 2022] GET /identity/v3/users/f6ba851c651742d19299e159edabe065 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:49.196044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529683f9-f1d5-4df0-9a72-da3be5cf343b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:49.217433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5301580-ba03-4f54-bbca-2a35b0f9896f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:49.218035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5301580-ba03-4f54-bbca-2a35b0f9896f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.218316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5301580-ba03-4f54-bbca-2a35b0f9896f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.218589 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5301580-ba03-4f54-bbca-2a35b0f9896f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.219345 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5301580-ba03-4f54-bbca-2a35b0f9896f None admin] RBAC: Adding query filter params (role.id=8b655a66d879422db1b56ca98d77e490, scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f, user.id=f6ba851c651742d19299e159edabe065) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:49.219652 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5301580-ba03-4f54-bbca-2a35b0f9896f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:49.221071 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5301580-ba03-4f54-bbca-2a35b0f9896f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:49.226502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 44/86] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:49 2022] GET /identity/v3/role_assignments?user.id=f6ba851c651742d19299e159edabe065&scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f&role.id=8b655a66d879422db1b56ca98d77e490 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:49.227318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5301580-ba03-4f54-bbca-2a35b0f9896f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:49.312447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529683f9-f1d5-4df0-9a72-da3be5cf343b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:49.321924 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:49.353999 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653747c-cac3-49ab-8d43-a09f234df423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:49.354768 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653747c-cac3-49ab-8d43-a09f234df423 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.355120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653747c-cac3-49ab-8d43-a09f234df423 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.355510 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653747c-cac3-49ab-8d43-a09f234df423 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.356699 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653747c-cac3-49ab-8d43-a09f234df423 None admin] RBAC: Adding query filter params (name=member) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:49.357013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653747c-cac3-49ab-8d43-a09f234df423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:49.357740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5301580-ba03-4f54-bbca-2a35b0f9896f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:49.358414 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653747c-cac3-49ab-8d43-a09f234df423 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:49.372218 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 43/87] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:49.372218 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653747c-cac3-49ab-8d43-a09f234df423 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:49.401465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef3b9b-11c7-4a29-b60c-89fbd89484aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:49.402468 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef3b9b-11c7-4a29-b60c-89fbd89484aa None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.402928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef3b9b-11c7-4a29-b60c-89fbd89484aa None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.403211 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef3b9b-11c7-4a29-b60c-89fbd89484aa None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.403870 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef3b9b-11c7-4a29-b60c-89fbd89484aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:49.405305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef3b9b-11c7-4a29-b60c-89fbd89484aa None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:49.412955 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:49.426928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 45/88] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:18:49 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:49.427316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef3b9b-11c7-4a29-b60c-89fbd89484aa None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:49.496081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653747c-cac3-49ab-8d43-a09f234df423 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:49.539821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef3b9b-11c7-4a29-b60c-89fbd89484aa None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:49.541501 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09d032-5bff-4f8e-84f0-1af357605ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:49.542651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09d032-5bff-4f8e-84f0-1af357605ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.543181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09d032-5bff-4f8e-84f0-1af357605ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.543662 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09d032-5bff-4f8e-84f0-1af357605ee6 None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.545214 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09d032-5bff-4f8e-84f0-1af357605ee6 None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:49.546995 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09d032-5bff-4f8e-84f0-1af357605ee6 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:49.549592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 44/89] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:49 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:49.550932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09d032-5bff-4f8e-84f0-1af357605ee6 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:49.568341 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:49.581797 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096364cb-b4d9-4ab4-8c2b-ba592d681d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:49.582414 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096364cb-b4d9-4ab4-8c2b-ba592d681d6f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.582733 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096364cb-b4d9-4ab4-8c2b-ba592d681d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.583013 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096364cb-b4d9-4ab4-8c2b-ba592d681d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.677020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096364cb-b4d9-4ab4-8c2b-ba592d681d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:49.678429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096364cb-b4d9-4ab4-8c2b-ba592d681d6f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:49.690773 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09d032-5bff-4f8e-84f0-1af357605ee6 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:49.705972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:49.731477 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cea04c-6df8-4acd-8c15-f9df795ed3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:49.732122 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cea04c-6df8-4acd-8c15-f9df795ed3ff None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.732401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cea04c-6df8-4acd-8c15-f9df795ed3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.732678 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cea04c-6df8-4acd-8c15-f9df795ed3ff None admin] PATH_INFO: `/v3/users/f6ba851c651742d19299e159edabe065` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.733842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cea04c-6df8-4acd-8c15-f9df795ed3ff None admin] RBAC: Authorizing `identity:get_user(user_id=f6ba851c651742d19299e159edabe065)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:49.735336 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cea04c-6df8-4acd-8c15-f9df795ed3ff None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:49.737092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 45/90] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:49 2022] GET /identity/v3/users/f6ba851c651742d19299e159edabe065 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:49.737706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cea04c-6df8-4acd-8c15-f9df795ed3ff None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:49.806978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 46/91] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:49.808156 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096364cb-b4d9-4ab4-8c2b-ba592d681d6f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:49.845150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:49.878155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cea04c-6df8-4acd-8c15-f9df795ed3ff None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:49.916251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b52c8-2500-4365-bf0a-1e2efaa9b4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:49.916999 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b52c8-2500-4365-bf0a-1e2efaa9b4aa None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.917282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b52c8-2500-4365-bf0a-1e2efaa9b4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.917557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b52c8-2500-4365-bf0a-1e2efaa9b4aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.918322 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b52c8-2500-4365-bf0a-1e2efaa9b4aa None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f, user.id=935f6e33b5664b82a96e7a902653bf28) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:49.918658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b52c8-2500-4365-bf0a-1e2efaa9b4aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:49.920209 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b52c8-2500-4365-bf0a-1e2efaa9b4aa None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:49.929200 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 46/92] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:49 2022] GET /identity/v3/role_assignments?user.id=935f6e33b5664b82a96e7a902653bf28&scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f&role.id=3cd61239237441418529e9028ef801e4 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:49.929955 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b52c8-2500-4365-bf0a-1e2efaa9b4aa None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:49.940094 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096364cb-b4d9-4ab4-8c2b-ba592d681d6f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:49.994975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:50.002027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222f021-0061-4100-b23a-ebf13c84c522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:50.002767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222f021-0061-4100-b23a-ebf13c84c522 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.003648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222f021-0061-4100-b23a-ebf13c84c522 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.003921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222f021-0061-4100-b23a-ebf13c84c522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.103425 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b52c8-2500-4365-bf0a-1e2efaa9b4aa None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:50.131756 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222f021-0061-4100-b23a-ebf13c84c522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:50.133180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222f021-0061-4100-b23a-ebf13c84c522 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:50.148455 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef0e2a-cfc1-49d3-b70c-dd3d48bf2bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:50.149715 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef0e2a-cfc1-49d3-b70c-dd3d48bf2bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.150344 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef0e2a-cfc1-49d3-b70c-dd3d48bf2bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.151000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef0e2a-cfc1-49d3-b70c-dd3d48bf2bb6 None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.153130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef0e2a-cfc1-49d3-b70c-dd3d48bf2bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:50.155323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef0e2a-cfc1-49d3-b70c-dd3d48bf2bb6 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:50.157905 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 47/93] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:49 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:50.164033 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef0e2a-cfc1-49d3-b70c-dd3d48bf2bb6 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:50.174986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:50.316524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 47/94] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:50.322897 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222f021-0061-4100-b23a-ebf13c84c522 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:50.378756 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef0e2a-cfc1-49d3-b70c-dd3d48bf2bb6 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:50.398866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:50.495120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222f021-0061-4100-b23a-ebf13c84c522 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:50.542641 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:50.547786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b6925-9bbb-4d57-b2de-7b4f13674abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:50.548653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b6925-9bbb-4d57-b2de-7b4f13674abe None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.551026 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b6925-9bbb-4d57-b2de-7b4f13674abe None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.551312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b6925-9bbb-4d57-b2de-7b4f13674abe None admin] PATH_INFO: `/v3/projects/57df8f79087f4788abf4edbd04834c72` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.555322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b6925-9bbb-4d57-b2de-7b4f13674abe None admin] RBAC: Authorizing `identity:get_project(project_id=57df8f79087f4788abf4edbd04834c72)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:50.556786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b6925-9bbb-4d57-b2de-7b4f13674abe None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:50.559008 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 48/95] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:50 2022] GET /identity/v3/projects/57df8f79087f4788abf4edbd04834c72 => generated 312 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:50.559903 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f40a3-f549-490e-b05a-c95f9a120730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:50.560539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f40a3-f549-490e-b05a-c95f9a120730 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.560820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f40a3-f549-490e-b05a-c95f9a120730 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.561093 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f40a3-f549-490e-b05a-c95f9a120730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.561832 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f40a3-f549-490e-b05a-c95f9a120730 None admin] RBAC: Adding query filter params (role.id=0e112f96840a483bb6dfeab1bb8af187, scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f, user.id=f6ba851c651742d19299e159edabe065) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:50.562141 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f40a3-f549-490e-b05a-c95f9a120730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:50.563603 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f40a3-f549-490e-b05a-c95f9a120730 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:50.573272 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b6925-9bbb-4d57-b2de-7b4f13674abe None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:50.573624 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 48/96] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:50 2022] GET /identity/v3/role_assignments?user.id=f6ba851c651742d19299e159edabe065&scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f&role.id=0e112f96840a483bb6dfeab1bb8af187 => generated 259 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:50.786322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b6925-9bbb-4d57-b2de-7b4f13674abe None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:50.829112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58ab51-5e07-466c-ba8a-b491a134c3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:50.829647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58ab51-5e07-466c-ba8a-b491a134c3bc None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.829929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58ab51-5e07-466c-ba8a-b491a134c3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.830204 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58ab51-5e07-466c-ba8a-b491a134c3bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.831027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58ab51-5e07-466c-ba8a-b491a134c3bc None admin] RBAC: Adding query filter params (role.id=8b655a66d879422db1b56ca98d77e490, scope.project.id=57df8f79087f4788abf4edbd04834c72, user.id=f6ba851c651742d19299e159edabe065) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:50.831339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58ab51-5e07-466c-ba8a-b491a134c3bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:50.832778 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58ab51-5e07-466c-ba8a-b491a134c3bc None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:50.838715 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 49/97] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:50 2022] GET /identity/v3/role_assignments?user.id=f6ba851c651742d19299e159edabe065&scope.project.id=57df8f79087f4788abf4edbd04834c72&role.id=8b655a66d879422db1b56ca98d77e490 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:51.734918 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa474db-e109-4c9f-8e44-ecf768b1c201 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:51.735412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa474db-e109-4c9f-8e44-ecf768b1c201 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:51.735485 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa474db-e109-4c9f-8e44-ecf768b1c201 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:51.737100 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 49/98] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:51.742673 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abc246-7a63-44a4-9cf2-83d355349eb3 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:51.743087 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abc246-7a63-44a4-9cf2-83d355349eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:51.743280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abc246-7a63-44a4-9cf2-83d355349eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:51.762540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b5abc246-7a63-44a4-9cf2-83d355349eb3 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:51.763758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b5abc246-7a63-44a4-9cf2-83d355349eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:51.837495 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:51.853863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 50/99] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:18:52.400090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa474db-e109-4c9f-8e44-ecf768b1c201 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:52.431059 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efdef1-cb05-4414-95a6-34e8b0be6c15 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:52.431365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efdef1-cb05-4414-95a6-34e8b0be6c15 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:52.431604 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efdef1-cb05-4414-95a6-34e8b0be6c15 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:52.432948 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 51/100] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:18:52.438463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56038eee-7d4a-4bc6-8037-2a5b56f74cda None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:52.438768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56038eee-7d4a-4bc6-8037-2a5b56f74cda None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:52.439040 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56038eee-7d4a-4bc6-8037-2a5b56f74cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:52.471667 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-56038eee-7d4a-4bc6-8037-2a5b56f74cda None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:52.472858 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-56038eee-7d4a-4bc6-8037-2a5b56f74cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:52.572263 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa474db-e109-4c9f-8e44-ecf768b1c201 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:52.580310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 52/101] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:18:52.581794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77c8b5-bea2-4e59-8f81-3282510f6b92 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:52.582312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77c8b5-bea2-4e59-8f81-3282510f6b92 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:52.582834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77c8b5-bea2-4e59-8f81-3282510f6b92 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:52.584283 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 53/102] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:52.596057 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b2902-b0f3-42ec-adec-78476ce3ee42 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:52.596705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b2902-b0f3-42ec-adec-78476ce3ee42 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:52.596989 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b2902-b0f3-42ec-adec-78476ce3ee42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:52.618554 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b3206-46c8-4088-9e08-ecfb67908a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:52.622164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b3206-46c8-4088-9e08-ecfb67908a93 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:52.622679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b3206-46c8-4088-9e08-ecfb67908a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:52.623145 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b3206-46c8-4088-9e08-ecfb67908a93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:52.631881 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-c39b2902-b0f3-42ec-adec-78476ce3ee42 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:52.633102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c39b2902-b0f3-42ec-adec-78476ce3ee42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:52.634906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b3206-46c8-4088-9e08-ecfb67908a93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:52.640885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-903b3206-46c8-4088-9e08-ecfb67908a93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:52.640885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:52.640885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:52.640885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:52.640885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:52.640885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:52.640885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:52.640885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:52.640885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:52.640885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:52.640885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:52.640885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:52.640885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:52.640885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:52.640885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:52.640885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:52.641791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:52.641791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:52.641791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:52.641791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:52.641791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:52.641791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:52.641791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:52.641791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:52.641791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:52.641791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:52.641791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:52.641791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:52.641791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:52.641791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:52.641791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:52.641791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:52.642542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:52.642542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:52.642542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:52.642542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:52.642542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:52.642542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:52.642542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:52.642542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:52.642542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:52.642542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:52.642542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:52.642542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:18:52.648537 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 50/103] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:52.651420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b3206-46c8-4088-9e08-ecfb67908a93 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:52.695395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:52.796091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 54/104] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:52.818247 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b3206-46c8-4088-9e08-ecfb67908a93 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:52.867380 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd917c67-ce5f-4603-9205-e8ea8dab5fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:52.867988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd917c67-ce5f-4603-9205-e8ea8dab5fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:52.868269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd917c67-ce5f-4603-9205-e8ea8dab5fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:52.868537 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd917c67-ce5f-4603-9205-e8ea8dab5fb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:52.869195 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd917c67-ce5f-4603-9205-e8ea8dab5fb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:52.869496 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd917c67-ce5f-4603-9205-e8ea8dab5fb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:52.870928 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd917c67-ce5f-4603-9205-e8ea8dab5fb0 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:52.879262 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 51/105] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:52.884408 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2199e8-b7ec-4066-801c-2ec0b8778a3c None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:52.884936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2199e8-b7ec-4066-801c-2ec0b8778a3c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:52.885053 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd917c67-ce5f-4603-9205-e8ea8dab5fb0 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:52.885543 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2199e8-b7ec-4066-801c-2ec0b8778a3c None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:52.887145 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 55/106] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:52.899853 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3947576-f283-4314-b5cf-4ed0e2a7b2e7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:52.900509 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3947576-f283-4314-b5cf-4ed0e2a7b2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:52.901222 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3947576-f283-4314-b5cf-4ed0e2a7b2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:52.935203 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-e3947576-f283-4314-b5cf-4ed0e2a7b2e7 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:52.936414 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e3947576-f283-4314-b5cf-4ed0e2a7b2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:53.018122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:53.023153 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:53.032012 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd917c67-ce5f-4603-9205-e8ea8dab5fb0 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:53.075556 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 56/107] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:18:53.076745 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3947576-f283-4314-b5cf-4ed0e2a7b2e7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:53.101334 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb09e66-0da0-4127-af42-17cec83d5f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:53.102609 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb09e66-0da0-4127-af42-17cec83d5f2f None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.103541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb09e66-0da0-4127-af42-17cec83d5f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.104037 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb09e66-0da0-4127-af42-17cec83d5f2f None admin] PATH_INFO: `/v3/users/f6ba851c651742d19299e159edabe065` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.107512 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb09e66-0da0-4127-af42-17cec83d5f2f None admin] RBAC: Authorizing `identity:get_user(user_id=f6ba851c651742d19299e159edabe065)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:53.108878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb09e66-0da0-4127-af42-17cec83d5f2f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:53.110704 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 52/108] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:52 2022] GET /identity/v3/users/f6ba851c651742d19299e159edabe065 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:53.118155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb09e66-0da0-4127-af42-17cec83d5f2f None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:53.206215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3947576-f283-4314-b5cf-4ed0e2a7b2e7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:53.231589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb09e66-0da0-4127-af42-17cec83d5f2f None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:53.251427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428237dc-5fd2-4595-9898-c8b3fe799379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:53.252313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428237dc-5fd2-4595-9898-c8b3fe799379 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.255288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428237dc-5fd2-4595-9898-c8b3fe799379 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.256508 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428237dc-5fd2-4595-9898-c8b3fe799379 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.261394 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428237dc-5fd2-4595-9898-c8b3fe799379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:53.264338 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428237dc-5fd2-4595-9898-c8b3fe799379 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:53.266822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 57/109] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:53.268358 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428237dc-5fd2-4595-9898-c8b3fe799379 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:53.290210 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435ab6a-7f7c-447b-a3b6-e7a35bdd67db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:53.291148 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435ab6a-7f7c-447b-a3b6-e7a35bdd67db None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.291570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435ab6a-7f7c-447b-a3b6-e7a35bdd67db None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.291987 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435ab6a-7f7c-447b-a3b6-e7a35bdd67db None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.294453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435ab6a-7f7c-447b-a3b6-e7a35bdd67db None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:53.296861 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435ab6a-7f7c-447b-a3b6-e7a35bdd67db None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:53.300354 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 53/110] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:53 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:53.304786 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435ab6a-7f7c-447b-a3b6-e7a35bdd67db None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:53.360006 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:53.363467 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:53.426186 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428237dc-5fd2-4595-9898-c8b3fe799379 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:53.467378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a881675-0918-48c6-beca-a010bf8ee422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:53.467564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435ab6a-7f7c-447b-a3b6-e7a35bdd67db None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:53.468329 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a881675-0918-48c6-beca-a010bf8ee422 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.468753 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a881675-0918-48c6-beca-a010bf8ee422 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.469317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a881675-0918-48c6-beca-a010bf8ee422 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.481184 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a881675-0918-48c6-beca-a010bf8ee422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:53.486926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-8a881675-0918-48c6-beca-a010bf8ee422 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:18:53.486926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:53.486926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:53.486926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:53.486926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:53.486926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:53.486926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:53.486926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:53.486926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:53.486926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:53.486926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:53.486926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:53.486926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:53.486926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:53.486926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:53.486926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:53.488005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:53.488005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:53.488005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:53.488005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:53.488005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:53.488005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:53.488005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:53.488005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:53.488005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:53.488005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:53.488005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:53.488005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:53.488005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:53.488005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:53.488005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:53.488005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:53.488975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:53.488975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:53.488975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:53.488975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:53.488975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:53.488975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:53.488975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:53.488975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:53.488975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:53.488975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:53.488975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:18:53.488975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:18:53.490956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 58/111] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:53.492103 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a881675-0918-48c6-beca-a010bf8ee422 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:53.508018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917f3ea-6cee-43e2-bbc3-82945d6f2a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:53.508943 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917f3ea-6cee-43e2-bbc3-82945d6f2a14 None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.509444 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917f3ea-6cee-43e2-bbc3-82945d6f2a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.509893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917f3ea-6cee-43e2-bbc3-82945d6f2a14 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.510785 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917f3ea-6cee-43e2-bbc3-82945d6f2a14 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:53.513055 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917f3ea-6cee-43e2-bbc3-82945d6f2a14 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:53.542224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 54/112] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Sep 1 16:18:53 2022] POST /identity/v3/projects => generated 302 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:53.543715 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917f3ea-6cee-43e2-bbc3-82945d6f2a14 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:53.608476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a881675-0918-48c6-beca-a010bf8ee422 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:53.620497 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:53.651330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf089393-1b68-498d-81f1-7e79a136ea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:53.652229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf089393-1b68-498d-81f1-7e79a136ea79 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.652629 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf089393-1b68-498d-81f1-7e79a136ea79 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.653003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf089393-1b68-498d-81f1-7e79a136ea79 None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f/users/f6ba851c651742d19299e159edabe065/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.655182 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf089393-1b68-498d-81f1-7e79a136ea79 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf4f1224bb02437e83d0ac7973ab2f2f, user_id=f6ba851c651742d19299e159edabe065, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:53.656751 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf089393-1b68-498d-81f1-7e79a136ea79 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:53.664109 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:53.673343 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 59/113] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:18:53 2022] PUT /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f/users/f6ba851c651742d19299e159edabe065/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:18:53.674141 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf089393-1b68-498d-81f1-7e79a136ea79 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:53.719258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917f3ea-6cee-43e2-bbc3-82945d6f2a14 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:53.761253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd9822-3eb0-4a9f-8bcc-706dfa9c1917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:53.762209 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd9822-3eb0-4a9f-8bcc-706dfa9c1917 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.762653 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd9822-3eb0-4a9f-8bcc-706dfa9c1917 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.763114 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd9822-3eb0-4a9f-8bcc-706dfa9c1917 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.776338 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd9822-3eb0-4a9f-8bcc-706dfa9c1917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:53.782288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-27cd9822-3eb0-4a9f-8bcc-706dfa9c1917 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:53.782288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:53.782288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:53.782288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:53.782288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:53.782288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:53.782288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:53.782288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:53.782288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:53.782288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:53.782288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:53.782288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:53.782288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:53.782288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:53.782288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:53.782288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:53.783248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:53.783248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:53.783248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:53.783248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:53.783248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:53.783248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:53.783248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:53.783248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:53.783248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:53.783248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:53.783248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:53.783248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:53.783248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:53.783248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:53.783248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:53.783248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:53.784016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:53.784016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:53.784016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:53.784016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:53.784016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:53.784016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:53.784016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:53.784016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:53.784016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:53.784016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:53.784016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:53.784016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:18:53.784594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 55/114] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:53.785936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6695e-b21c-49ba-85da-96ebec958038 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.785936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6695e-b21c-49ba-85da-96ebec958038 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.786706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6695e-b21c-49ba-85da-96ebec958038 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.787961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 56/115] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:53.789146 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adfc3d-fef2-4c25-a4d2-4f23c1ff5734 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.789435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adfc3d-fef2-4c25-a4d2-4f23c1ff5734 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.789713 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adfc3d-fef2-4c25-a4d2-4f23c1ff5734 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.791158 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 57/116] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:53.795765 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adfc3d-fef2-4c25-a4d2-4f23c1ff5734 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:53.842531 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf089393-1b68-498d-81f1-7e79a136ea79 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:53.887884 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c446c0-57f1-41f3-896c-c7bdff4a5e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:53.888501 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c446c0-57f1-41f3-896c-c7bdff4a5e5f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.888786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c446c0-57f1-41f3-896c-c7bdff4a5e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.889117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c446c0-57f1-41f3-896c-c7bdff4a5e5f None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.889798 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c446c0-57f1-41f3-896c-c7bdff4a5e5f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:53.890100 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c446c0-57f1-41f3-896c-c7bdff4a5e5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:53.891529 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c446c0-57f1-41f3-896c-c7bdff4a5e5f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:53.902434 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 60/117] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:53.903700 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840b547-73e8-4f27-8725-ff5ea17cf843 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.903993 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840b547-73e8-4f27-8725-ff5ea17cf843 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.904274 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840b547-73e8-4f27-8725-ff5ea17cf843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.923938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f840b547-73e8-4f27-8725-ff5ea17cf843 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:53.925371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f840b547-73e8-4f27-8725-ff5ea17cf843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:53.926422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adfc3d-fef2-4c25-a4d2-4f23c1ff5734 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:53.951597 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:53.964713 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a6881-8a95-4211-8c02-fdc3f0669291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:53.965374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a6881-8a95-4211-8c02-fdc3f0669291 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.965655 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a6881-8a95-4211-8c02-fdc3f0669291 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.965925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a6881-8a95-4211-8c02-fdc3f0669291 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.966804 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a6881-8a95-4211-8c02-fdc3f0669291 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:53.966911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a6881-8a95-4211-8c02-fdc3f0669291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:53.968782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a6881-8a95-4211-8c02-fdc3f0669291 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:53.977642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 58/118] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:53.979007 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2164a-c285-4f28-9d37-2069ab20021c None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.979296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2164a-c285-4f28-9d37-2069ab20021c None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.979570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2164a-c285-4f28-9d37-2069ab20021c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.987742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:53.999928 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-63d2164a-c285-4f28-9d37-2069ab20021c None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:54.001109 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-63d2164a-c285-4f28-9d37-2069ab20021c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:54.005003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 61/119] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:54.005905 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840b547-73e8-4f27-8725-ff5ea17cf843 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:54.106356 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 59/120] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:54.107325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2164a-c285-4f28-9d37-2069ab20021c None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:54.120959 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840b547-73e8-4f27-8725-ff5ea17cf843 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:54.180840 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e38a3-e446-49f7-ba84-65938a6dd461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:54.181492 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e38a3-e446-49f7-ba84-65938a6dd461 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:54.181775 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e38a3-e446-49f7-ba84-65938a6dd461 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:54.182051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e38a3-e446-49f7-ba84-65938a6dd461 None admin] PATH_INFO: `/v3/users/0486f53621574d2bb0739d034b961bfa` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:54.201795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e38a3-e446-49f7-ba84-65938a6dd461 None admin] RBAC: Authorizing `identity:get_user(user_id=0486f53621574d2bb0739d034b961bfa)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:54.211408 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e38a3-e446-49f7-ba84-65938a6dd461 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:54.213123 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 62/121] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:54 2022] GET /identity/v3/users/0486f53621574d2bb0739d034b961bfa => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:54.226650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e38a3-e446-49f7-ba84-65938a6dd461 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:54.265219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:54.267159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2164a-c285-4f28-9d37-2069ab20021c None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:54.331396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caee40-1ae0-41b0-b6bd-ce929ee22e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:54.332650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caee40-1ae0-41b0-b6bd-ce929ee22e6c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:54.333128 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caee40-1ae0-41b0-b6bd-ce929ee22e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:54.333596 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caee40-1ae0-41b0-b6bd-ce929ee22e6c None admin] PATH_INFO: `/v3/users/935f6e33b5664b82a96e7a902653bf28` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:54.335427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9caee40-1ae0-41b0-b6bd-ce929ee22e6c None admin] RBAC: Authorizing `identity:get_user(user_id=935f6e33b5664b82a96e7a902653bf28)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:54.337062 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9caee40-1ae0-41b0-b6bd-ce929ee22e6c None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:54.338939 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 60/122] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:54 2022] GET /identity/v3/users/935f6e33b5664b82a96e7a902653bf28 => generated 247 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:54.346362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caee40-1ae0-41b0-b6bd-ce929ee22e6c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:54.349629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:54.451038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e38a3-e446-49f7-ba84-65938a6dd461 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:54.470317 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caee40-1ae0-41b0-b6bd-ce929ee22e6c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:54.502525 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b414b6-64dd-4fb5-86ae-8cbab93e39af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:54.503367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b414b6-64dd-4fb5-86ae-8cbab93e39af None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:54.503656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b414b6-64dd-4fb5-86ae-8cbab93e39af None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:54.504033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b414b6-64dd-4fb5-86ae-8cbab93e39af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:54.506117 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5e391-844d-41b5-be90-c04ce9dd18d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:54.506780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5e391-844d-41b5-be90-c04ce9dd18d1 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:54.507326 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5e391-844d-41b5-be90-c04ce9dd18d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:54.507604 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5e391-844d-41b5-be90-c04ce9dd18d1 None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:54.509655 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5e391-844d-41b5-be90-c04ce9dd18d1 None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:54.511130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5e391-844d-41b5-be90-c04ce9dd18d1 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:54.513319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 61/123] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:54 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:54.514282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5e391-844d-41b5-be90-c04ce9dd18d1 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:54.579799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b414b6-64dd-4fb5-86ae-8cbab93e39af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:54.581252 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b414b6-64dd-4fb5-86ae-8cbab93e39af None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:54.599874 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:54.609993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:54.655810 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5e391-844d-41b5-be90-c04ce9dd18d1 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:54.696957 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 63/124] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:54.698073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b414b6-64dd-4fb5-86ae-8cbab93e39af None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:54.705912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be652bb-8264-4559-b205-a316382a880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:54.706835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be652bb-8264-4559-b205-a316382a880c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:54.707365 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be652bb-8264-4559-b205-a316382a880c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:54.707838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be652bb-8264-4559-b205-a316382a880c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:54.719888 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be652bb-8264-4559-b205-a316382a880c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:54.725495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-3be652bb-8264-4559-b205-a316382a880c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:18:54.725495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:54.725495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:54.725495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:54.725495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:54.725495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:54.725495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:54.725495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:54.725495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:54.725495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:54.725495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:54.725495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:54.725495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:54.725495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:54.725495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:54.725495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:54.726346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:54.726346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:54.726346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:54.726346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:54.726346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:54.726346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:54.726346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:54.726346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:54.726346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:54.726346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:54.726346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:54.726346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:54.726346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:54.726346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:54.726346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:54.726346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:54.727150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:54.727150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:54.727150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:54.727150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:54.727150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:54.727150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:54.727150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:54.727150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:54.727150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:54.727150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:54.727150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:18:54.727150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:18:54.729660 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 62/125] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:18:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:54.731290 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be652bb-8264-4559-b205-a316382a880c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:54.825970 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b414b6-64dd-4fb5-86ae-8cbab93e39af None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:54.839468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be652bb-8264-4559-b205-a316382a880c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:54.846041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:54.868447 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b872c2-f418-4f84-8eca-ad972bdfac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:54.869689 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b872c2-f418-4f84-8eca-ad972bdfac54 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:54.870205 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b872c2-f418-4f84-8eca-ad972bdfac54 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:54.870706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b872c2-f418-4f84-8eca-ad972bdfac54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:54.876688 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:54.883627 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d725c-8cf7-41db-9d91-3a7fab6ce523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:54.884295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d725c-8cf7-41db-9d91-3a7fab6ce523 None admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:54.884574 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d725c-8cf7-41db-9d91-3a7fab6ce523 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:54.884850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d725c-8cf7-41db-9d91-3a7fab6ce523 None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f/users/935f6e33b5664b82a96e7a902653bf28/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:54.890638 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b872c2-f418-4f84-8eca-ad972bdfac54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:54.890757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d725c-8cf7-41db-9d91-3a7fab6ce523 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf4f1224bb02437e83d0ac7973ab2f2f, user_id=935f6e33b5664b82a96e7a902653bf28, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:54.890757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d725c-8cf7-41db-9d91-3a7fab6ce523 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:54.891805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-e9b872c2-f418-4f84-8eca-ad972bdfac54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:54.891805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:54.891805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:54.891805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:54.891805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:54.891805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:54.891805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:54.891805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:54.891805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:54.891805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:54.891805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:54.891805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:54.891805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:54.891805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:54.891805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:54.891805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:54.892653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:54.892653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:54.892653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:54.892653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:54.892653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:54.892653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:54.892653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:54.892653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:54.892653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:54.892653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:54.892653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:54.892653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:54.892653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:54.892653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:54.892653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:54.892653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:54.893428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:54.893428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:54.893428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:54.893428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:54.893428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:54.893428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:54.893428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:54.893428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:54.893428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:54.893428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:54.893428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:54.893428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:18:54.893428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 64/126] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:54.894066 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b872c2-f418-4f84-8eca-ad972bdfac54 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:54.911067 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 63/127] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:18:54 2022] PUT /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f/users/935f6e33b5664b82a96e7a902653bf28/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:18:54.912275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d725c-8cf7-41db-9d91-3a7fab6ce523 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:55.033708 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d725c-8cf7-41db-9d91-3a7fab6ce523 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:55.072664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29e897-ecb7-4f6a-83b5-85ab1651ca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:55.073687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29e897-ecb7-4f6a-83b5-85ab1651ca2d None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:55.074227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29e897-ecb7-4f6a-83b5-85ab1651ca2d None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:55.074747 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29e897-ecb7-4f6a-83b5-85ab1651ca2d None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:55.075630 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29e897-ecb7-4f6a-83b5-85ab1651ca2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:55.076149 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29e897-ecb7-4f6a-83b5-85ab1651ca2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:55.077736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29e897-ecb7-4f6a-83b5-85ab1651ca2d None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:55.087490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 64/128] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:18:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:55.088724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29e897-ecb7-4f6a-83b5-85ab1651ca2d None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:55.099544 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b872c2-f418-4f84-8eca-ad972bdfac54 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:55.136293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c7313-ec88-43f7-97b1-55d6eddb2e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:55.137015 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c7313-ec88-43f7-97b1-55d6eddb2e25 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:55.137299 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c7313-ec88-43f7-97b1-55d6eddb2e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:55.137575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c7313-ec88-43f7-97b1-55d6eddb2e25 None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:55.138824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c7313-ec88-43f7-97b1-55d6eddb2e25 None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:55.140337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c7313-ec88-43f7-97b1-55d6eddb2e25 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:55.142055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 65/129] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:54 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:55.142886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c7313-ec88-43f7-97b1-55d6eddb2e25 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:55.154388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:55.199877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:55.209593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29e897-ecb7-4f6a-83b5-85ab1651ca2d None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:55.251576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60348fe-52d5-4853-8e93-b199616d9f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:55.252674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60348fe-52d5-4853-8e93-b199616d9f0b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:55.253120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60348fe-52d5-4853-8e93-b199616d9f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:55.253460 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60348fe-52d5-4853-8e93-b199616d9f0b None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:55.254142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60348fe-52d5-4853-8e93-b199616d9f0b None admin] RBAC: Adding query filter params (name=member) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:55.254498 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60348fe-52d5-4853-8e93-b199616d9f0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:55.256798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60348fe-52d5-4853-8e93-b199616d9f0b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:55.268941 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 65/130] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:55.269604 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60348fe-52d5-4853-8e93-b199616d9f0b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:55.271090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c7313-ec88-43f7-97b1-55d6eddb2e25 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:55.314445 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2089d36-a6db-4d70-a798-64fb3afc15c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:55.315221 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2089d36-a6db-4d70-a798-64fb3afc15c7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:55.315507 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2089d36-a6db-4d70-a798-64fb3afc15c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:55.315781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2089d36-a6db-4d70-a798-64fb3afc15c7 None admin] PATH_INFO: `/v3/users/f6ba851c651742d19299e159edabe065` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:55.316949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2089d36-a6db-4d70-a798-64fb3afc15c7 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ba851c651742d19299e159edabe065)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:55.319074 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2089d36-a6db-4d70-a798-64fb3afc15c7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:55.320575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 66/131] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:55 2022] GET /identity/v3/users/f6ba851c651742d19299e159edabe065 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:55.321335 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2089d36-a6db-4d70-a798-64fb3afc15c7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:55.383029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60348fe-52d5-4853-8e93-b199616d9f0b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:55.397392 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:55.419107 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cfd44-64e4-40ff-b5bf-d6bb9cc195b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:55.419810 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cfd44-64e4-40ff-b5bf-d6bb9cc195b7 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:55.420160 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cfd44-64e4-40ff-b5bf-d6bb9cc195b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:55.420502 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cfd44-64e4-40ff-b5bf-d6bb9cc195b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:55.421301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cfd44-64e4-40ff-b5bf-d6bb9cc195b7 None admin] RBAC: Adding query filter params (role.id=dc7f92ba5a294b00afaa074d01532b7c, scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f, user.id=0486f53621574d2bb0739d034b961bfa) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:55.421683 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cfd44-64e4-40ff-b5bf-d6bb9cc195b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:55.423232 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cfd44-64e4-40ff-b5bf-d6bb9cc195b7 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:55.428888 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 66/132] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:55 2022] GET /identity/v3/role_assignments?user.id=0486f53621574d2bb0739d034b961bfa&scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f&role.id=dc7f92ba5a294b00afaa074d01532b7c => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:55.429674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cfd44-64e4-40ff-b5bf-d6bb9cc195b7 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:55.447086 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2089d36-a6db-4d70-a798-64fb3afc15c7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:55.468534 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:55.510196 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48d212-3128-4ab1-be71-1db8cf166f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:55.510983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48d212-3128-4ab1-be71-1db8cf166f67 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:55.511317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48d212-3128-4ab1-be71-1db8cf166f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:55.511637 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48d212-3128-4ab1-be71-1db8cf166f67 None admin] PATH_INFO: `/v3/users/f6ba851c651742d19299e159edabe065` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:55.512811 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48d212-3128-4ab1-be71-1db8cf166f67 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ba851c651742d19299e159edabe065)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:55.514313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48d212-3128-4ab1-be71-1db8cf166f67 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:55.516229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 67/133] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:55 2022] GET /identity/v3/users/f6ba851c651742d19299e159edabe065 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:55.522334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48d212-3128-4ab1-be71-1db8cf166f67 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:55.539702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cfd44-64e4-40ff-b5bf-d6bb9cc195b7 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:55.587974 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8188e6-89d6-4d20-b61c-c3d5e7949211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:55.588621 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8188e6-89d6-4d20-b61c-c3d5e7949211 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:55.588906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8188e6-89d6-4d20-b61c-c3d5e7949211 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:55.589184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8188e6-89d6-4d20-b61c-c3d5e7949211 None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:55.590675 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8188e6-89d6-4d20-b61c-c3d5e7949211 None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:55.592455 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8188e6-89d6-4d20-b61c-c3d5e7949211 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:55.598737 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 67/134] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:55 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:55.601043 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8188e6-89d6-4d20-b61c-c3d5e7949211 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:55.650205 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48d212-3128-4ab1-be71-1db8cf166f67 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:55.671085 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:55.687438 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c3a55-b987-43d9-aa7f-4bbc4c3f883e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:55.688026 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3a55-b987-43d9-aa7f-4bbc4c3f883e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:55.688308 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3a55-b987-43d9-aa7f-4bbc4c3f883e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:55.688624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3a55-b987-43d9-aa7f-4bbc4c3f883e None admin] PATH_INFO: `/v3/projects/57df8f79087f4788abf4edbd04834c72` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:55.689766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c3a55-b987-43d9-aa7f-4bbc4c3f883e None admin] RBAC: Authorizing `identity:get_project(project_id=57df8f79087f4788abf4edbd04834c72)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:55.691266 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c3a55-b987-43d9-aa7f-4bbc4c3f883e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:55.693084 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 68/135] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:55 2022] GET /identity/v3/projects/57df8f79087f4788abf4edbd04834c72 => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:55.699518 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c3a55-b987-43d9-aa7f-4bbc4c3f883e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:55.738020 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8188e6-89d6-4d20-b61c-c3d5e7949211 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:55.781178 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d59a0f-d67c-4dd7-b0a5-dd7eec9d23a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:55.782443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d59a0f-d67c-4dd7-b0a5-dd7eec9d23a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:55.782894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d59a0f-d67c-4dd7-b0a5-dd7eec9d23a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:55.783313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d59a0f-d67c-4dd7-b0a5-dd7eec9d23a4 None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f/users/f6ba851c651742d19299e159edabe065/roles/0e112f96840a483bb6dfeab1bb8af187` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:55.786176 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d59a0f-d67c-4dd7-b0a5-dd7eec9d23a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf4f1224bb02437e83d0ac7973ab2f2f, user_id=f6ba851c651742d19299e159edabe065, role_id=0e112f96840a483bb6dfeab1bb8af187)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:55.788027 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d59a0f-d67c-4dd7-b0a5-dd7eec9d23a4 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:55.807060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:55.810904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 68/136] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:18:55 2022] PUT /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f/users/f6ba851c651742d19299e159edabe065/roles/0e112f96840a483bb6dfeab1bb8af187 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:18:55.860650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c3a55-b987-43d9-aa7f-4bbc4c3f883e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:55.899767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b14bf2-7f13-4d46-bbda-fca8e1b92025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:55.900794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b14bf2-7f13-4d46-bbda-fca8e1b92025 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:55.901219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b14bf2-7f13-4d46-bbda-fca8e1b92025 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:55.901631 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b14bf2-7f13-4d46-bbda-fca8e1b92025 None admin] PATH_INFO: `/v3/projects/57df8f79087f4788abf4edbd04834c72/users/f6ba851c651742d19299e159edabe065/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:55.904575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b14bf2-7f13-4d46-bbda-fca8e1b92025 None admin] RBAC: Authorizing `identity:create_grant(project_id=57df8f79087f4788abf4edbd04834c72, user_id=f6ba851c651742d19299e159edabe065, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:55.906242 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b14bf2-7f13-4d46-bbda-fca8e1b92025 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:55.919446 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb62f5-5d74-44e6-9b40-6f8acce1b461 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:55.920117 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb62f5-5d74-44e6-9b40-6f8acce1b461 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:55.921064 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb62f5-5d74-44e6-9b40-6f8acce1b461 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:55.922817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 69/137] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:55.930793 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 69/138] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:18:55 2022] PUT /identity/v3/projects/57df8f79087f4788abf4edbd04834c72/users/f6ba851c651742d19299e159edabe065/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:18:55.944243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19609f-16b7-45b4-b133-15a2137fb7e0 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:55.944878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19609f-16b7-45b4-b133-15a2137fb7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:55.945141 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19609f-16b7-45b4-b133-15a2137fb7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:55.977629 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1d19609f-16b7-45b4-b133-15a2137fb7e0 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:55.978935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1d19609f-16b7-45b4-b133-15a2137fb7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:56.068602 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 70/139] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:18:56.275837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b673c9-2218-4cfe-8b85-2aaa710a1a66 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:56.275837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b673c9-2218-4cfe-8b85-2aaa710a1a66 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:56.275837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b673c9-2218-4cfe-8b85-2aaa710a1a66 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:56.275837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 70/140] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:56.282759 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d738822-3b92-45dc-b6a7-96de452eb636 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:56.283322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d738822-3b92-45dc-b6a7-96de452eb636 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:56.283788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d738822-3b92-45dc-b6a7-96de452eb636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:56.302796 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-3d738822-3b92-45dc-b6a7-96de452eb636 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:56.304276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3d738822-3b92-45dc-b6a7-96de452eb636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:56.335926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:56.374256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b673c9-2218-4cfe-8b85-2aaa710a1a66 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:56.381682 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 71/141] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:56.489516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b673c9-2218-4cfe-8b85-2aaa710a1a66 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:56.497590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:56.536792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97224a2-000c-44eb-b5fb-f9f99448831b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:56.537859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97224a2-000c-44eb-b5fb-f9f99448831b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:56.538543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97224a2-000c-44eb-b5fb-f9f99448831b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:56.539125 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97224a2-000c-44eb-b5fb-f9f99448831b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:56.543912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97224a2-000c-44eb-b5fb-f9f99448831b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:56.545691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97224a2-000c-44eb-b5fb-f9f99448831b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:56.547873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 71/142] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:56.553651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d738822-3b92-45dc-b6a7-96de452eb636 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:56.677452 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d738822-3b92-45dc-b6a7-96de452eb636 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:56.717713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb2483-a3ab-446b-be0b-3e30a7291468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:56.718333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb2483-a3ab-446b-be0b-3e30a7291468 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:56.718633 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb2483-a3ab-446b-be0b-3e30a7291468 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:56.718918 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb2483-a3ab-446b-be0b-3e30a7291468 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:56.719588 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb2483-a3ab-446b-be0b-3e30a7291468 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:56.721026 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb2483-a3ab-446b-be0b-3e30a7291468 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:56.739654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97224a2-000c-44eb-b5fb-f9f99448831b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:56.759043 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 72/143] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:18:56 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:56.855655 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97224a2-000c-44eb-b5fb-f9f99448831b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:56.893754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec381f0-e3f2-445a-8dab-360269de21a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:56.894811 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec381f0-e3f2-445a-8dab-360269de21a4 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:56.895334 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec381f0-e3f2-445a-8dab-360269de21a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:56.895835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec381f0-e3f2-445a-8dab-360269de21a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:56.907402 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec381f0-e3f2-445a-8dab-360269de21a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:56.913337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-6ec381f0-e3f2-445a-8dab-360269de21a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:56.913337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:56.913337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:56.913337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:56.913337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:56.913337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:56.913337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:56.913337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:56.913337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:56.913337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:56.913337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:56.913337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:56.913337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:56.913337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:56.913337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:56.913337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:56.914196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:56.914196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:56.914196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:56.914196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:56.914196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:56.914196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:56.914196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:56.914196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:56.914196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:56.914196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:56.914196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:56.914196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:56.914196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:56.914196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:56.914196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:56.914196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:56.914986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:56.914986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:56.914986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:56.914986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:56.914986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:56.914986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:56.914986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:56.914986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:56.914986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:56.914986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:56.914986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:56.914986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:18:56.922816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 72/144] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:18:56.927757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb2483-a3ab-446b-be0b-3e30a7291468 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:56.977553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:57.075254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb2483-a3ab-446b-be0b-3e30a7291468 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:57.123439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f85d0e-6989-4285-b4bc-e2058edf094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:57.124001 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f85d0e-6989-4285-b4bc-e2058edf094e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:57.124319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f85d0e-6989-4285-b4bc-e2058edf094e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:57.124594 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f85d0e-6989-4285-b4bc-e2058edf094e None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:57.125275 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f85d0e-6989-4285-b4bc-e2058edf094e None admin] RBAC: Adding query filter params (name=member) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:57.125581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f85d0e-6989-4285-b4bc-e2058edf094e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:57.127178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f85d0e-6989-4285-b4bc-e2058edf094e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:57.138678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 73/145] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:57.144812 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec381f0-e3f2-445a-8dab-360269de21a4 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:57.196259 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:57.275094 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec381f0-e3f2-445a-8dab-360269de21a4 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:57.309947 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621ca4d-a320-401d-a63e-a0cd322446c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:57.310754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621ca4d-a320-401d-a63e-a0cd322446c7 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:57.310942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621ca4d-a320-401d-a63e-a0cd322446c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:57.311188 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621ca4d-a320-401d-a63e-a0cd322446c7 None admin] PATH_INFO: `/v3/users/f6ba851c651742d19299e159edabe065` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:57.312445 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621ca4d-a320-401d-a63e-a0cd322446c7 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ba851c651742d19299e159edabe065)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:57.313919 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621ca4d-a320-401d-a63e-a0cd322446c7 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:57.315558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 73/146] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:57 2022] GET /identity/v3/users/f6ba851c651742d19299e159edabe065 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:57.321527 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f85d0e-6989-4285-b4bc-e2058edf094e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:57.445305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:57.462112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f85d0e-6989-4285-b4bc-e2058edf094e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:57.504378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5849ef1-b365-4b34-a8df-df85c9de4362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:57.505803 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5849ef1-b365-4b34-a8df-df85c9de4362 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:57.506139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5849ef1-b365-4b34-a8df-df85c9de4362 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:57.506462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5849ef1-b365-4b34-a8df-df85c9de4362 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:57.586703 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5849ef1-b365-4b34-a8df-df85c9de4362 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:57.588172 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5849ef1-b365-4b34-a8df-df85c9de4362 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:57.698366 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:57.719017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 74/147] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:57.724828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621ca4d-a320-401d-a63e-a0cd322446c7 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:57.854905 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621ca4d-a320-401d-a63e-a0cd322446c7 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:57.858404 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:57.899675 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe871a3-3c3a-4cf2-b7ea-c6091469b0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:57.900308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe871a3-3c3a-4cf2-b7ea-c6091469b0ad None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:57.900582 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe871a3-3c3a-4cf2-b7ea-c6091469b0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:57.900849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe871a3-3c3a-4cf2-b7ea-c6091469b0ad None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:57.903432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe871a3-3c3a-4cf2-b7ea-c6091469b0ad None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:57.904877 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe871a3-3c3a-4cf2-b7ea-c6091469b0ad None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:57.906693 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 74/148] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:57 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:57.913052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5849ef1-b365-4b34-a8df-df85c9de4362 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:58.059443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5849ef1-b365-4b34-a8df-df85c9de4362 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:58.081703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a4723-6a3f-4b14-9021-855a1330adbb None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:58.082005 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a4723-6a3f-4b14-9021-855a1330adbb None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:58.082257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a4723-6a3f-4b14-9021-855a1330adbb None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:58.083935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 75/149] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:58.088739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d423f-5431-4599-a2bb-973e1354184f None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:58.089019 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d423f-5431-4599-a2bb-973e1354184f None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:58.089294 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d423f-5431-4599-a2bb-973e1354184f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:58.122204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-959d423f-5431-4599-a2bb-973e1354184f None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:58.123585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-959d423f-5431-4599-a2bb-973e1354184f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:58.133235 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd241c40-9360-423b-8b9e-c1da6ca0a1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:58.133859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd241c40-9360-423b-8b9e-c1da6ca0a1da None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:58.134244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd241c40-9360-423b-8b9e-c1da6ca0a1da None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:58.134524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd241c40-9360-423b-8b9e-c1da6ca0a1da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:58.135300 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd241c40-9360-423b-8b9e-c1da6ca0a1da None admin] RBAC: Adding query filter params (role.id=8b655a66d879422db1b56ca98d77e490, scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f, user.id=f6ba851c651742d19299e159edabe065) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:58.135614 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd241c40-9360-423b-8b9e-c1da6ca0a1da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:58.137154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd241c40-9360-423b-8b9e-c1da6ca0a1da None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:58.152742 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 75/150] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:57 2022] GET /identity/v3/role_assignments?user.id=f6ba851c651742d19299e159edabe065&scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f&role.id=8b655a66d879422db1b56ca98d77e490 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:58.219968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 76/151] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:18:58.544464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f92ea-86d5-496c-a26d-bedd0914270c None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:58.544817 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f92ea-86d5-496c-a26d-bedd0914270c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:58.545014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f92ea-86d5-496c-a26d-bedd0914270c None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:58.547446 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d423f-5431-4599-a2bb-973e1354184f None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:58.549658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 76/152] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:58.553243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a5602-100d-4e16-8e8a-58a7c037b41d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:58.553526 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a5602-100d-4e16-8e8a-58a7c037b41d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:58.553802 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a5602-100d-4e16-8e8a-58a7c037b41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:58.589906 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-008a5602-100d-4e16-8e8a-58a7c037b41d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:58.592513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-008a5602-100d-4e16-8e8a-58a7c037b41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:58.676571 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:58.706783 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 77/153] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:58.732815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:58.736147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d423f-5431-4599-a2bb-973e1354184f None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:58.781315 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb20b4-7bcb-4609-a193-d20d825f1398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:58.782146 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb20b4-7bcb-4609-a193-d20d825f1398 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:58.782434 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb20b4-7bcb-4609-a193-d20d825f1398 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:58.782715 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb20b4-7bcb-4609-a193-d20d825f1398 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:58.793822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb20b4-7bcb-4609-a193-d20d825f1398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:58.798803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-6dbb20b4-7bcb-4609-a193-d20d825f1398 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:58.798803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:58.798803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:58.798803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:58.798803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:58.798803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:58.798803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:58.798803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:58.798803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:58.798803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:58.798803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:58.798803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:58.798803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:58.798803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:58.798803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:58.798803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:58.799709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:58.799709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:58.799709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:58.799709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:58.799709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:58.799709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:58.799709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:58.799709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:58.799709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:58.799709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:58.799709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:58.799709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:58.799709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:58.799709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:58.799709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:58.799709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:58.800465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:58.800465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:58.800465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:58.800465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:58.800465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:58.800465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:58.800465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:58.800465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:58.800465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:58.800465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:58.800465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:58.800465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:18:58.800465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 77/154] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:58.805833 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a5602-100d-4e16-8e8a-58a7c037b41d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:58.930327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a5602-100d-4e16-8e8a-58a7c037b41d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:58.978156 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d7a7d-7897-43b1-bae4-397f4b535050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:58.979229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d7a7d-7897-43b1-bae4-397f4b535050 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:58.979706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d7a7d-7897-43b1-bae4-397f4b535050 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:58.980253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d7a7d-7897-43b1-bae4-397f4b535050 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:58.981640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d7a7d-7897-43b1-bae4-397f4b535050 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:58.982136 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d7a7d-7897-43b1-bae4-397f4b535050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:58.983784 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d7a7d-7897-43b1-bae4-397f4b535050 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:58.992782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 78/155] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:58.998397 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb20b4-7bcb-4609-a193-d20d825f1398 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:59.037972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c3ecf-da5e-40ae-9a03-ffc8c76911ac None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:59.039115 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c3ecf-da5e-40ae-9a03-ffc8c76911ac None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:59.039866 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c3ecf-da5e-40ae-9a03-ffc8c76911ac None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:59.042161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 79/156] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:59.047974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa476b1-ab1c-488e-9ad2-ea299601114a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:59.049054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa476b1-ab1c-488e-9ad2-ea299601114a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:59.049788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa476b1-ab1c-488e-9ad2-ea299601114a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:59.071552 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5aa476b1-ab1c-488e-9ad2-ea299601114a None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:59.073684 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5aa476b1-ab1c-488e-9ad2-ea299601114a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:59.124593 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:59.152888 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 80/157] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:59.154057 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa476b1-ab1c-488e-9ad2-ea299601114a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:59.203886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb20b4-7bcb-4609-a193-d20d825f1398 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:59.262746 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9121568-6aeb-4f7a-9f65-3d4fb5b0dbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:59.263650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9121568-6aeb-4f7a-9f65-3d4fb5b0dbf4 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:59.264049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9121568-6aeb-4f7a-9f65-3d4fb5b0dbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:59.264451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9121568-6aeb-4f7a-9f65-3d4fb5b0dbf4 None admin] PATH_INFO: `/v3/users/935f6e33b5664b82a96e7a902653bf28` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:59.269030 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9121568-6aeb-4f7a-9f65-3d4fb5b0dbf4 None admin] RBAC: Authorizing `identity:get_user(user_id=935f6e33b5664b82a96e7a902653bf28)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:59.270688 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9121568-6aeb-4f7a-9f65-3d4fb5b0dbf4 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:59.273185 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 78/158] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:58 2022] GET /identity/v3/users/935f6e33b5664b82a96e7a902653bf28 => generated 247 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:59.277942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9121568-6aeb-4f7a-9f65-3d4fb5b0dbf4 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:59.326113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:59.350445 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa476b1-ab1c-488e-9ad2-ea299601114a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:59.390675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da3007-86ce-4809-94ab-95a36eaf8fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:59.391727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3007-86ce-4809-94ab-95a36eaf8fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:59.392279 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3007-86ce-4809-94ab-95a36eaf8fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:59.392743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3007-86ce-4809-94ab-95a36eaf8fa0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:59.403483 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da3007-86ce-4809-94ab-95a36eaf8fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:59.408809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-88da3007-86ce-4809-94ab-95a36eaf8fa0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:18:59.408809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:59.408809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:59.408809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:59.408809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:59.408809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:59.408809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:59.408809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:59.408809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:59.408809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:59.408809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:59.408809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:59.408809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:59.408809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:59.408809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:59.408809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:59.409773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:59.409773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:59.409773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:59.409773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:59.409773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:59.409773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:59.409773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:59.409773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:59.409773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:59.409773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:59.409773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:59.409773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:59.409773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:59.409773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:59.409773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:59.409773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:59.410537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:59.410537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:59.410537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:59.410537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:59.410537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:59.410537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:59.410537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:59.410537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:59.410537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:59.410537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:59.410537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:18:59.410537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:18:59.412861 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 81/159] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:59.419699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da3007-86ce-4809-94ab-95a36eaf8fa0 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:59.471151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:59.497378 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9121568-6aeb-4f7a-9f65-3d4fb5b0dbf4 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:59.563323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f03300-4d64-4292-8841-38b9313ce252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:59.563935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f03300-4d64-4292-8841-38b9313ce252 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:59.564202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f03300-4d64-4292-8841-38b9313ce252 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:59.564468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f03300-4d64-4292-8841-38b9313ce252 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:59.580066 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da3007-86ce-4809-94ab-95a36eaf8fa0 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:59.638752 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd26b0-56a3-4e3a-a8ee-17bafbe7827b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:59.639867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd26b0-56a3-4e3a-a8ee-17bafbe7827b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:59.640363 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd26b0-56a3-4e3a-a8ee-17bafbe7827b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:59.640830 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd26b0-56a3-4e3a-a8ee-17bafbe7827b None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:59.641704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd26b0-56a3-4e3a-a8ee-17bafbe7827b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:59.642255 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd26b0-56a3-4e3a-a8ee-17bafbe7827b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:59.643889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd26b0-56a3-4e3a-a8ee-17bafbe7827b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:59.661776 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 82/160] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:59.663112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd26b0-56a3-4e3a-a8ee-17bafbe7827b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:59.718273 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f03300-4d64-4292-8841-38b9313ce252 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:59.719768 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f03300-4d64-4292-8841-38b9313ce252 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:59.772296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:59.872420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 79/161] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:18:59.873027 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f03300-4d64-4292-8841-38b9313ce252 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:59.876517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:59.889548 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd26b0-56a3-4e3a-a8ee-17bafbe7827b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:59.947360 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66016cdf-3ecd-4e61-811d-ed8a14c99f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:59.947996 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66016cdf-3ecd-4e61-811d-ed8a14c99f04 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:59.948281 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66016cdf-3ecd-4e61-811d-ed8a14c99f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:59.948540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66016cdf-3ecd-4e61-811d-ed8a14c99f04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:59.977767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66016cdf-3ecd-4e61-811d-ed8a14c99f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:59.984263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-66016cdf-3ecd-4e61-811d-ed8a14c99f04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:18:59.984263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:59.984263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:59.984263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:59.984263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:59.984263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:59.984263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:59.984263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:59.984263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:59.984263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:59.984263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:59.984263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:59.984263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:59.984263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:59.984263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:59.984263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:59.985355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:59.985355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:59.985355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:59.985355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:59.985355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:59.985355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:59.985355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:59.985355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:59.985355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:59.985355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:59.985355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:59.985355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:59.985355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:59.985355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:59.985355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:59.985355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:59.986334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:59.986334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:59.986334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:59.986334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:59.986334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:59.986334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:59.986334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:59.986334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:59.986334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:59.986334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:59.986334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:18:59.986334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:18:59.996748 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 83/162] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:18:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:59.998203 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7966ee-f455-40f8-a255-f4e881bf3135 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:59.998867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7966ee-f455-40f8-a255-f4e881bf3135 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:00.000412 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7966ee-f455-40f8-a255-f4e881bf3135 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:00.002053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 84/163] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:18:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:00.003577 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7966ee-f455-40f8-a255-f4e881bf3135 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:00.042036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f03300-4d64-4292-8841-38b9313ce252 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:00.089319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:00.103793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f6e9b-8f35-4b34-8936-ebaa3e29dcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:00.104652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f6e9b-8f35-4b34-8936-ebaa3e29dcea None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:00.105072 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f6e9b-8f35-4b34-8936-ebaa3e29dcea None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:00.106012 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f6e9b-8f35-4b34-8936-ebaa3e29dcea None admin] PATH_INFO: `/v3/users/0486f53621574d2bb0739d034b961bfa` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:00.107348 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f6e9b-8f35-4b34-8936-ebaa3e29dcea None admin] RBAC: Authorizing `identity:get_user(user_id=0486f53621574d2bb0739d034b961bfa)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:00.109249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f6e9b-8f35-4b34-8936-ebaa3e29dcea None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:00.113296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 80/164] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:59 2022] GET /identity/v3/users/0486f53621574d2bb0739d034b961bfa => generated 289 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:00.114980 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f6e9b-8f35-4b34-8936-ebaa3e29dcea None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:00.193327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7966ee-f455-40f8-a255-f4e881bf3135 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:00.259894 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4ad50-ea5d-4442-8ada-57dba9ef6faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:00.260819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4ad50-ea5d-4442-8ada-57dba9ef6faf None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:00.261273 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4ad50-ea5d-4442-8ada-57dba9ef6faf None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:00.262271 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4ad50-ea5d-4442-8ada-57dba9ef6faf None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:00.263719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4ad50-ea5d-4442-8ada-57dba9ef6faf None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:00.265316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4ad50-ea5d-4442-8ada-57dba9ef6faf None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:00.268929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 85/165] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:00 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:00.269923 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a64de-b942-4718-a45c-6f8868187e0b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:00.270208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a64de-b942-4718-a45c-6f8868187e0b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:00.270482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a64de-b942-4718-a45c-6f8868187e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:00.288004 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f6e9b-8f35-4b34-8936-ebaa3e29dcea None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:00.300349 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-909a64de-b942-4718-a45c-6f8868187e0b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:00.301537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-909a64de-b942-4718-a45c-6f8868187e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:00.319704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:00.379162 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 86/166] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:00.380694 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a64de-b942-4718-a45c-6f8868187e0b None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:00.382679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee709d1-7dde-4e25-a564-932138cc7586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:00.383486 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee709d1-7dde-4e25-a564-932138cc7586 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:00.385443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee709d1-7dde-4e25-a564-932138cc7586 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:00.385897 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee709d1-7dde-4e25-a564-932138cc7586 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:00.386792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee709d1-7dde-4e25-a564-932138cc7586 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:00.388204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee709d1-7dde-4e25-a564-932138cc7586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:00.389776 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee709d1-7dde-4e25-a564-932138cc7586 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:00.407856 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 81/167] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:00.410133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee709d1-7dde-4e25-a564-932138cc7586 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:00.504649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:00.551173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee709d1-7dde-4e25-a564-932138cc7586 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:00.587160 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823bcb0-e516-483b-aa5f-c5492fbb4796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:00.587813 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823bcb0-e516-483b-aa5f-c5492fbb4796 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:00.588087 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823bcb0-e516-483b-aa5f-c5492fbb4796 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:00.588363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823bcb0-e516-483b-aa5f-c5492fbb4796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:00.589144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823bcb0-e516-483b-aa5f-c5492fbb4796 None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f, user.id=935f6e33b5664b82a96e7a902653bf28) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:00.589458 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823bcb0-e516-483b-aa5f-c5492fbb4796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:00.591523 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823bcb0-e516-483b-aa5f-c5492fbb4796 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:00.598241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 82/168] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:00 2022] GET /identity/v3/role_assignments?user.id=935f6e33b5664b82a96e7a902653bf28&scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f&role.id=3cd61239237441418529e9028ef801e4 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:00.603343 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823bcb0-e516-483b-aa5f-c5492fbb4796 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:00.618664 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a64de-b942-4718-a45c-6f8868187e0b None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:00.708794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f2c8c-a1ee-48dc-89e9-e2ead880ba44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:00.709453 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f2c8c-a1ee-48dc-89e9-e2ead880ba44 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:00.709733 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f2c8c-a1ee-48dc-89e9-e2ead880ba44 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:00.710010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f2c8c-a1ee-48dc-89e9-e2ead880ba44 None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:00.715468 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f2c8c-a1ee-48dc-89e9-e2ead880ba44 None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:00.716964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f2c8c-a1ee-48dc-89e9-e2ead880ba44 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:00.719315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 87/169] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:00 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:00.725034 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f2c8c-a1ee-48dc-89e9-e2ead880ba44 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:00.756793 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:00.824654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823bcb0-e516-483b-aa5f-c5492fbb4796 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:00.864897 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:00.879171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe35826-b85b-44f5-a2be-f0e3b06eecdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:00.879840 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe35826-b85b-44f5-a2be-f0e3b06eecdd None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:00.880127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe35826-b85b-44f5-a2be-f0e3b06eecdd None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:00.880397 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe35826-b85b-44f5-a2be-f0e3b06eecdd None admin] PATH_INFO: `/v3/users/f6ba851c651742d19299e159edabe065` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:00.881626 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe35826-b85b-44f5-a2be-f0e3b06eecdd None admin] RBAC: Authorizing `identity:get_user(user_id=f6ba851c651742d19299e159edabe065)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:00.883156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe35826-b85b-44f5-a2be-f0e3b06eecdd None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:00.883337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f2c8c-a1ee-48dc-89e9-e2ead880ba44 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:00.884799 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 83/170] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:00 2022] GET /identity/v3/users/f6ba851c651742d19299e159edabe065 => generated 275 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:00.887037 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ca9ab-1ed5-4414-9baf-13a66b0198fd None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:00.887484 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ca9ab-1ed5-4414-9baf-13a66b0198fd None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:00.887980 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ca9ab-1ed5-4414-9baf-13a66b0198fd None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:00.889320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 84/171] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:00.894865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ca9ab-1ed5-4414-9baf-13a66b0198fd None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:00.930525 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8f9cb-8fb6-4de4-8b1d-58e0557e7ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:00.932112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8f9cb-8fb6-4de4-8b1d-58e0557e7ba1 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:00.932579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8f9cb-8fb6-4de4-8b1d-58e0557e7ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:00.933272 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8f9cb-8fb6-4de4-8b1d-58e0557e7ba1 None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f/users/0486f53621574d2bb0739d034b961bfa/roles/dc7f92ba5a294b00afaa074d01532b7c` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:00.936382 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8f9cb-8fb6-4de4-8b1d-58e0557e7ba1 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf4f1224bb02437e83d0ac7973ab2f2f, user_id=0486f53621574d2bb0739d034b961bfa, role_id=dc7f92ba5a294b00afaa074d01532b7c)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:00.939043 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8f9cb-8fb6-4de4-8b1d-58e0557e7ba1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:00.958990 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 88/172] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:19:00 2022] PUT /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f/users/0486f53621574d2bb0739d034b961bfa/roles/dc7f92ba5a294b00afaa074d01532b7c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:19:00.960796 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e57b8-4609-4b04-a0de-5be66f9d6f6e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:00.961228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e57b8-4609-4b04-a0de-5be66f9d6f6e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:00.961648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e57b8-4609-4b04-a0de-5be66f9d6f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:00.985595 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-cf3e57b8-4609-4b04-a0de-5be66f9d6f6e None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:00.987490 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cf3e57b8-4609-4b04-a0de-5be66f9d6f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:01.062545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ca9ab-1ed5-4414-9baf-13a66b0198fd None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:01.074859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 89/173] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:01.075931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e57b8-4609-4b04-a0de-5be66f9d6f6e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:01.089634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:01.137444 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee12f4-2b61-4fd5-a93b-91ee6d287769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:01.138074 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee12f4-2b61-4fd5-a93b-91ee6d287769 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:01.138355 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee12f4-2b61-4fd5-a93b-91ee6d287769 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:01.138661 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee12f4-2b61-4fd5-a93b-91ee6d287769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:01.205545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e57b8-4609-4b04-a0de-5be66f9d6f6e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:01.253449 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339400f-80d5-4685-8b3d-ceb9971c621f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:01.254359 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339400f-80d5-4685-8b3d-ceb9971c621f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:01.254810 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339400f-80d5-4685-8b3d-ceb9971c621f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:01.255227 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339400f-80d5-4685-8b3d-ceb9971c621f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:01.272079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339400f-80d5-4685-8b3d-ceb9971c621f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:01.273318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:01.286371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-b339400f-80d5-4685-8b3d-ceb9971c621f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:01.286371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:01.286371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:01.286371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:01.286371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:01.286371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:01.286371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:01.286371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:01.286371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:01.286371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:01.286371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:01.286371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:01.286371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:01.286371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:01.286371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:01.286371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:01.287565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:01.287565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:01.287565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:01.287565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:01.287565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:01.287565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:01.287565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:01.287565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:01.287565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:01.287565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:01.287565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:01.287565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:01.287565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:01.287565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:01.287565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:01.287565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:01.288520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:01.288520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:01.288520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:01.288520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:01.288520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:01.288520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:01.288520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:01.288520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:01.288520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:01.288520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:01.288520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:01.288520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:01.290803 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 90/174] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:01.297546 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339400f-80d5-4685-8b3d-ceb9971c621f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:01.303918 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee12f4-2b61-4fd5-a93b-91ee6d287769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:01.305132 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee12f4-2b61-4fd5-a93b-91ee6d287769 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:01.388542 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:01.437363 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339400f-80d5-4685-8b3d-ceb9971c621f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:01.466716 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 85/175] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:01.468858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd1344-8eb5-4062-8240-f3c972a81d81 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:01.469292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd1344-8eb5-4062-8240-f3c972a81d81 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:01.469724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd1344-8eb5-4062-8240-f3c972a81d81 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:01.471182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 86/176] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:01.473173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd1344-8eb5-4062-8240-f3c972a81d81 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:01.480821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30366a-e7dd-4d80-acd4-2a73ef891c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:01.481441 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30366a-e7dd-4d80-acd4-2a73ef891c20 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:01.481720 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30366a-e7dd-4d80-acd4-2a73ef891c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:01.481988 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30366a-e7dd-4d80-acd4-2a73ef891c20 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:01.482697 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30366a-e7dd-4d80-acd4-2a73ef891c20 None admin] RBAC: Adding query filter params (name=member) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:01.483005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30366a-e7dd-4d80-acd4-2a73ef891c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:01.484387 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30366a-e7dd-4d80-acd4-2a73ef891c20 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:01.493306 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 91/177] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:01.494565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c26e4-cc0c-41d6-9f67-0410a71cc53b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:01.494869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c26e4-cc0c-41d6-9f67-0410a71cc53b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:01.495427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c26e4-cc0c-41d6-9f67-0410a71cc53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:01.514072 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ae9c26e4-cc0c-41d6-9f67-0410a71cc53b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:01.515494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ae9c26e4-cc0c-41d6-9f67-0410a71cc53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:01.590723 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 92/178] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:01.594829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:01.595253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576023e-bd30-453e-b5fc-a91b66b20724 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:01.595253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576023e-bd30-453e-b5fc-a91b66b20724 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:01.595253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576023e-bd30-453e-b5fc-a91b66b20724 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:01.595253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 93/179] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:01.595253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576023e-bd30-453e-b5fc-a91b66b20724 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:01.609338 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd1344-8eb5-4062-8240-f3c972a81d81 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:01.650256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732946f-640a-45e9-ba69-0c8545e2d257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:01.651250 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732946f-640a-45e9-ba69-0c8545e2d257 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:01.651749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732946f-640a-45e9-ba69-0c8545e2d257 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:01.652780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732946f-640a-45e9-ba69-0c8545e2d257 None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:01.654138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732946f-640a-45e9-ba69-0c8545e2d257 None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:01.655813 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732946f-640a-45e9-ba69-0c8545e2d257 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:01.658006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 87/180] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:01 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:01.659122 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732946f-640a-45e9-ba69-0c8545e2d257 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:01.675766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:01.712560 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576023e-bd30-453e-b5fc-a91b66b20724 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:01.749489 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363356e-c731-40c3-ba54-c2588847aba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:01.750207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363356e-c731-40c3-ba54-c2588847aba5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:01.750720 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363356e-c731-40c3-ba54-c2588847aba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:01.751252 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363356e-c731-40c3-ba54-c2588847aba5 None admin] PATH_INFO: `/v3/users/f6ba851c651742d19299e159edabe065` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:01.752857 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363356e-c731-40c3-ba54-c2588847aba5 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ba851c651742d19299e159edabe065)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:01.754758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363356e-c731-40c3-ba54-c2588847aba5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:01.756640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 94/181] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:01 2022] GET /identity/v3/users/f6ba851c651742d19299e159edabe065 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:01.758194 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6276b5-8ccc-4b24-a76e-d8036f352f1f None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:01.758693 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6276b5-8ccc-4b24-a76e-d8036f352f1f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:01.759157 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6276b5-8ccc-4b24-a76e-d8036f352f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:01.770713 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732946f-640a-45e9-ba69-0c8545e2d257 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:01.779866 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-bb6276b5-8ccc-4b24-a76e-d8036f352f1f None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:01.781474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bb6276b5-8ccc-4b24-a76e-d8036f352f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:01.806334 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad5e93-d54f-439a-859d-0b15386854e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:01.807002 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad5e93-d54f-439a-859d-0b15386854e4 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:01.807279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad5e93-d54f-439a-859d-0b15386854e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:01.807556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad5e93-d54f-439a-859d-0b15386854e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:01.819431 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad5e93-d54f-439a-859d-0b15386854e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:01.826133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-66ad5e93-d54f-439a-859d-0b15386854e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:01.826133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:01.826133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:01.826133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:01.826133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:01.826133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:01.826133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:01.826133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:01.826133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:01.826133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:01.826133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:01.826133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:01.826133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:01.826133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:01.826133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:01.826133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:01.827071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:01.827071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:01.827071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:01.827071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:01.827071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:01.827071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:01.827071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:01.827071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:01.827071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:01.827071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:01.827071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:01.827071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:01.827071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:01.827071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:01.827071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:01.827071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:01.827859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:01.827859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:01.827859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:01.827859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:01.827859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:01.827859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:01.827859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:01.827859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:01.827859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:01.827859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:01.827859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:01.827859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:01.827859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 88/182] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:19:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:01.828521 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad5e93-d54f-439a-859d-0b15386854e4 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:01.849396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:01.861711 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 95/183] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:01.863037 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6276b5-8ccc-4b24-a76e-d8036f352f1f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:01.935121 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:01.937624 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad5e93-d54f-439a-859d-0b15386854e4 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:01.984658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26587d-44ea-4eaf-95dc-19570377f355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:01.985623 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26587d-44ea-4eaf-95dc-19570377f355 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:01.986098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26587d-44ea-4eaf-95dc-19570377f355 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:01.986566 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26587d-44ea-4eaf-95dc-19570377f355 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:01.987521 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26587d-44ea-4eaf-95dc-19570377f355 None admin] RBAC: Adding query filter params (role.id=0e112f96840a483bb6dfeab1bb8af187, scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f, user.id=f6ba851c651742d19299e159edabe065) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:01.988054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26587d-44ea-4eaf-95dc-19570377f355 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:01.989685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26587d-44ea-4eaf-95dc-19570377f355 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:01.993629 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6276b5-8ccc-4b24-a76e-d8036f352f1f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:01.996147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 89/184] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:01 2022] GET /identity/v3/role_assignments?user.id=f6ba851c651742d19299e159edabe065&scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f&role.id=0e112f96840a483bb6dfeab1bb8af187 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:01.997135 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26587d-44ea-4eaf-95dc-19570377f355 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:02.034412 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41549ab-4ce9-48b9-a455-e6cd68932704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:02.035473 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41549ab-4ce9-48b9-a455-e6cd68932704 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:02.035947 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41549ab-4ce9-48b9-a455-e6cd68932704 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:02.036411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41549ab-4ce9-48b9-a455-e6cd68932704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:02.105858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:02.117591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41549ab-4ce9-48b9-a455-e6cd68932704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:02.119535 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41549ab-4ce9-48b9-a455-e6cd68932704 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:02.128389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26587d-44ea-4eaf-95dc-19570377f355 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:02.165417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeacdf6-05fd-4dc9-9f93-420f5bc2b82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:02.166034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeacdf6-05fd-4dc9-9f93-420f5bc2b82d None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:02.166316 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeacdf6-05fd-4dc9-9f93-420f5bc2b82d None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:02.166592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeacdf6-05fd-4dc9-9f93-420f5bc2b82d None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:02.167318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeacdf6-05fd-4dc9-9f93-420f5bc2b82d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:02.167650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeacdf6-05fd-4dc9-9f93-420f5bc2b82d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:02.169053 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeacdf6-05fd-4dc9-9f93-420f5bc2b82d None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:02.178310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 90/185] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:02.179251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeacdf6-05fd-4dc9-9f93-420f5bc2b82d None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:02.187029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:02.234555 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 96/186] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:02.236151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41549ab-4ce9-48b9-a455-e6cd68932704 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:02.294060 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeacdf6-05fd-4dc9-9f93-420f5bc2b82d None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:02.334647 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62960a-f856-482d-a922-dafffbf08f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:02.335275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62960a-f856-482d-a922-dafffbf08f84 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:02.335556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62960a-f856-482d-a922-dafffbf08f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:02.335834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62960a-f856-482d-a922-dafffbf08f84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:02.336943 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62960a-f856-482d-a922-dafffbf08f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:02.338375 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62960a-f856-482d-a922-dafffbf08f84 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:02.340537 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 91/187] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:02.341304 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62960a-f856-482d-a922-dafffbf08f84 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:02.357945 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:02.361270 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41549ab-4ce9-48b9-a455-e6cd68932704 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:02.398705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36dd8f-43e9-4939-b09a-8ced76234cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:02.399344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36dd8f-43e9-4939-b09a-8ced76234cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:02.399627 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36dd8f-43e9-4939-b09a-8ced76234cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:02.399900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36dd8f-43e9-4939-b09a-8ced76234cc1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:02.410658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36dd8f-43e9-4939-b09a-8ced76234cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:02.415944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-cf36dd8f-43e9-4939-b09a-8ced76234cc1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:02.415944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:02.415944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:02.415944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:02.415944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:02.415944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:02.415944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:02.415944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:02.415944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:02.415944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:02.415944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:02.415944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:02.415944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:02.415944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:02.415944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:02.415944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:02.416986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:02.416986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:02.416986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:02.416986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:02.416986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:02.416986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:02.416986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:02.416986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:02.416986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:02.416986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:02.416986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:02.416986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:02.416986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:02.416986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:02.416986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:02.416986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:02.418448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:02.418448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:02.418448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:02.418448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:02.418448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:02.418448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:02.418448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:02.418448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:02.418448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:02.418448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:02.418448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:02.418448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:02.418448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 97/188] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:02.418448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36dd8f-43e9-4939-b09a-8ced76234cc1 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:02.440800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:02.455911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62960a-f856-482d-a922-dafffbf08f84 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:02.497136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706700b-dddd-410b-a7e0-6a1d941c6553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:02.497815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706700b-dddd-410b-a7e0-6a1d941c6553 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:02.498096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706700b-dddd-410b-a7e0-6a1d941c6553 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:02.498372 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706700b-dddd-410b-a7e0-6a1d941c6553 None admin] PATH_INFO: `/v3/users/aae9321bb6ee4f5e906bcb26364640ae` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:02.516260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706700b-dddd-410b-a7e0-6a1d941c6553 None admin] RBAC: Authorizing `identity:get_user(user_id=aae9321bb6ee4f5e906bcb26364640ae)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:02.517745 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706700b-dddd-410b-a7e0-6a1d941c6553 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:02.519704 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 92/189] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:02 2022] GET /identity/v3/users/aae9321bb6ee4f5e906bcb26364640ae => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:02.520324 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706700b-dddd-410b-a7e0-6a1d941c6553 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:02.531515 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36dd8f-43e9-4939-b09a-8ced76234cc1 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:02.567844 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb370a-45ad-4ea2-9747-4dfe43d63db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:02.568460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb370a-45ad-4ea2-9747-4dfe43d63db5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:02.568736 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb370a-45ad-4ea2-9747-4dfe43d63db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:02.569003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb370a-45ad-4ea2-9747-4dfe43d63db5 None admin] PATH_INFO: `/v3/projects/57df8f79087f4788abf4edbd04834c72` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:02.570121 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb370a-45ad-4ea2-9747-4dfe43d63db5 None admin] RBAC: Authorizing `identity:get_project(project_id=57df8f79087f4788abf4edbd04834c72)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:02.571582 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb370a-45ad-4ea2-9747-4dfe43d63db5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:02.573188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 98/190] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:02 2022] GET /identity/v3/projects/57df8f79087f4788abf4edbd04834c72 => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:02.573958 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb370a-45ad-4ea2-9747-4dfe43d63db5 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:02.596994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:02.636148 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706700b-dddd-410b-a7e0-6a1d941c6553 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:02.669568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:02.673174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfb7ab-ef2c-45ab-957b-7c6117bcec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:02.674273 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfb7ab-ef2c-45ab-957b-7c6117bcec83 None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:02.674837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfb7ab-ef2c-45ab-957b-7c6117bcec83 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:02.675349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfb7ab-ef2c-45ab-957b-7c6117bcec83 None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:02.676137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfb7ab-ef2c-45ab-957b-7c6117bcec83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:02.677777 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfb7ab-ef2c-45ab-957b-7c6117bcec83 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:02.681945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb370a-45ad-4ea2-9747-4dfe43d63db5 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:02.719384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 93/191] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:19:02 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:19:02.719384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfb7ab-ef2c-45ab-957b-7c6117bcec83 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:02.731167 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2b525-72ca-46e3-9bfb-cde95ce86a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:02.731801 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2b525-72ca-46e3-9bfb-cde95ce86a0f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:02.732131 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2b525-72ca-46e3-9bfb-cde95ce86a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:02.732562 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2b525-72ca-46e3-9bfb-cde95ce86a0f None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:02.733405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2b525-72ca-46e3-9bfb-cde95ce86a0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:02.733714 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2b525-72ca-46e3-9bfb-cde95ce86a0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:02.735361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2b525-72ca-46e3-9bfb-cde95ce86a0f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:02.745202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 99/192] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:02.746075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2b525-72ca-46e3-9bfb-cde95ce86a0f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:02.865129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfb7ab-ef2c-45ab-957b-7c6117bcec83 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:02.896822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:02.911854 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964a7db-7a19-4368-8994-ce32c805df91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:02.911854 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964a7db-7a19-4368-8994-ce32c805df91 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:02.912113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964a7db-7a19-4368-8994-ce32c805df91 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:02.912210 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964a7db-7a19-4368-8994-ce32c805df91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:02.912762 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2b525-72ca-46e3-9bfb-cde95ce86a0f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:02.951583 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e02724-b31e-4f1c-b3c0-14bd0a791add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:02.952550 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e02724-b31e-4f1c-b3c0-14bd0a791add None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:02.953009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e02724-b31e-4f1c-b3c0-14bd0a791add None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:02.953475 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e02724-b31e-4f1c-b3c0-14bd0a791add None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:02.954377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e02724-b31e-4f1c-b3c0-14bd0a791add None admin] RBAC: Adding query filter params (role.id=8b655a66d879422db1b56ca98d77e490, scope.project.id=57df8f79087f4788abf4edbd04834c72, user.id=f6ba851c651742d19299e159edabe065) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:02.954930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e02724-b31e-4f1c-b3c0-14bd0a791add None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:02.956554 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e02724-b31e-4f1c-b3c0-14bd0a791add None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:02.963041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 100/193] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:02 2022] GET /identity/v3/role_assignments?user.id=f6ba851c651742d19299e159edabe065&scope.project.id=57df8f79087f4788abf4edbd04834c72&role.id=8b655a66d879422db1b56ca98d77e490 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:02.964095 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e02724-b31e-4f1c-b3c0-14bd0a791add None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:02.988940 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:02.992127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964a7db-7a19-4368-8994-ce32c805df91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:02.993670 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964a7db-7a19-4368-8994-ce32c805df91 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:03.087047 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e02724-b31e-4f1c-b3c0-14bd0a791add None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:03.106492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 94/194] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:03.112127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964a7db-7a19-4368-8994-ce32c805df91 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:03.145272 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77fb77-bc60-4159-a640-4aa4959cfc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:03.145599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:03.146300 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77fb77-bc60-4159-a640-4aa4959cfc19 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:03.146626 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77fb77-bc60-4159-a640-4aa4959cfc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:03.146950 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77fb77-bc60-4159-a640-4aa4959cfc19 None admin] PATH_INFO: `/v3/users/aae9321bb6ee4f5e906bcb26364640ae` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:03.148592 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77fb77-bc60-4159-a640-4aa4959cfc19 None admin] RBAC: Authorizing `identity:get_user(user_id=aae9321bb6ee4f5e906bcb26364640ae)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:03.150176 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77fb77-bc60-4159-a640-4aa4959cfc19 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:03.152031 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 101/195] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:02 2022] GET /identity/v3/users/aae9321bb6ee4f5e906bcb26364640ae => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:03.175694 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77fb77-bc60-4159-a640-4aa4959cfc19 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:03.240543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964a7db-7a19-4368-8994-ce32c805df91 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:03.290903 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014972d3-c381-4d83-a742-7a0f16d61d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:03.291857 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014972d3-c381-4d83-a742-7a0f16d61d2e None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:03.292142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014972d3-c381-4d83-a742-7a0f16d61d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:03.292411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014972d3-c381-4d83-a742-7a0f16d61d2e None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:03.295382 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014972d3-c381-4d83-a742-7a0f16d61d2e None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:03.296858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014972d3-c381-4d83-a742-7a0f16d61d2e None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:03.298940 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:03.299628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 95/196] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:03 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:03.307480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014972d3-c381-4d83-a742-7a0f16d61d2e None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:03.326673 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77fb77-bc60-4159-a640-4aa4959cfc19 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:03.369486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f1efe-4802-498f-abf1-8c29e610e5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:03.370077 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f1efe-4802-498f-abf1-8c29e610e5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:03.370349 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f1efe-4802-498f-abf1-8c29e610e5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:03.370625 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f1efe-4802-498f-abf1-8c29e610e5e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:03.437807 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:03.448916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014972d3-c381-4d83-a742-7a0f16d61d2e None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:03.451518 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f1efe-4802-498f-abf1-8c29e610e5e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:03.453066 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f1efe-4802-498f-abf1-8c29e610e5e8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:03.489829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82653548-2abd-46c4-bc71-7b770a7cf849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:03.490437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653548-2abd-46c4-bc71-7b770a7cf849 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:03.490800 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653548-2abd-46c4-bc71-7b770a7cf849 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:03.491016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653548-2abd-46c4-bc71-7b770a7cf849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:03.491817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82653548-2abd-46c4-bc71-7b770a7cf849 None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127, user.id=aae9321bb6ee4f5e906bcb26364640ae) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:03.492127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82653548-2abd-46c4-bc71-7b770a7cf849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:03.493566 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82653548-2abd-46c4-bc71-7b770a7cf849 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:03.500182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 96/197] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:03 2022] GET /identity/v3/role_assignments?user.id=aae9321bb6ee4f5e906bcb26364640ae&scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127&role.id=3cd61239237441418529e9028ef801e4 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:03.501441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daa544-811c-4bd8-a9eb-04f52cdadca6 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:03.501729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daa544-811c-4bd8-a9eb-04f52cdadca6 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:03.502006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daa544-811c-4bd8-a9eb-04f52cdadca6 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:03.503460 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 97/198] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:03.509058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640f9d0-51ef-4557-ab5e-0fd5d0f471ed None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:03.509345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640f9d0-51ef-4557-ab5e-0fd5d0f471ed None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:03.509612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640f9d0-51ef-4557-ab5e-0fd5d0f471ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:03.529442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-b640f9d0-51ef-4557-ab5e-0fd5d0f471ed None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:03.530732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b640f9d0-51ef-4557-ab5e-0fd5d0f471ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:03.571011 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:03.589889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 102/199] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:03.599764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f1efe-4802-498f-abf1-8c29e610e5e8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:03.623871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 98/200] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:03.741214 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f1efe-4802-498f-abf1-8c29e610e5e8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:03.778794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51eeb0-3162-4e7d-b907-bd96a6008b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:03.779444 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51eeb0-3162-4e7d-b907-bd96a6008b38 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:03.779719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51eeb0-3162-4e7d-b907-bd96a6008b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:03.779988 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51eeb0-3162-4e7d-b907-bd96a6008b38 None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:03.781148 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51eeb0-3162-4e7d-b907-bd96a6008b38 None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:03.782684 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51eeb0-3162-4e7d-b907-bd96a6008b38 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:03.784376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 103/201] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:03 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:03.791288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640f9d0-51ef-4557-ab5e-0fd5d0f471ed None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:03.916267 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:03.928427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640f9d0-51ef-4557-ab5e-0fd5d0f471ed None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:03.935958 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51eeb0-3162-4e7d-b907-bd96a6008b38 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:03.974373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27f584-e91e-4d40-82c1-fb97a8497462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:03.975025 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27f584-e91e-4d40-82c1-fb97a8497462 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:03.975306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27f584-e91e-4d40-82c1-fb97a8497462 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:03.975572 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27f584-e91e-4d40-82c1-fb97a8497462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:03.977239 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27f584-e91e-4d40-82c1-fb97a8497462 None admin] RBAC: Adding query filter params (role.id=0e112f96840a483bb6dfeab1bb8af187, scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127, user.id=aae9321bb6ee4f5e906bcb26364640ae) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:03.977555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27f584-e91e-4d40-82c1-fb97a8497462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:03.979104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27f584-e91e-4d40-82c1-fb97a8497462 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:03.986243 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 99/202] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:03 2022] GET /identity/v3/role_assignments?user.id=aae9321bb6ee4f5e906bcb26364640ae&scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127&role.id=0e112f96840a483bb6dfeab1bb8af187 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:04.007105 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:04.051453 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51eeb0-3162-4e7d-b907-bd96a6008b38 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:04.089058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c28ea3-6f3f-4fdc-a52f-a81e0ce26410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:04.090043 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c28ea3-6f3f-4fdc-a52f-a81e0ce26410 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:04.090506 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c28ea3-6f3f-4fdc-a52f-a81e0ce26410 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:04.090990 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c28ea3-6f3f-4fdc-a52f-a81e0ce26410 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:04.103236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c28ea3-6f3f-4fdc-a52f-a81e0ce26410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:04.108540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-e8c28ea3-6f3f-4fdc-a52f-a81e0ce26410 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:04.108540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:04.108540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:04.108540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:04.108540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:04.108540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:04.108540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:04.108540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:04.108540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:04.108540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:04.108540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:04.108540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:04.108540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:04.108540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:04.108540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:04.108540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:04.109482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:04.109482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:04.109482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:04.109482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:04.109482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:04.109482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:04.109482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:04.109482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:04.109482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:04.109482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:04.109482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:04.109482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:04.109482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:04.109482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:04.109482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:04.109482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:04.110316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:04.110316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:04.110316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:04.110316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:04.110316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:04.110316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:04.110316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:04.110316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:04.110316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:04.110316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:04.110316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:04.110316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:04.112599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 104/203] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:04.118702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27f584-e91e-4d40-82c1-fb97a8497462 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:04.262516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27f584-e91e-4d40-82c1-fb97a8497462 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:04.303983 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe056e3-5c6a-4358-9c82-1bd5545567ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:04.304595 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe056e3-5c6a-4358-9c82-1bd5545567ef None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:04.304870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe056e3-5c6a-4358-9c82-1bd5545567ef None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:04.305141 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe056e3-5c6a-4358-9c82-1bd5545567ef None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:04.305806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe056e3-5c6a-4358-9c82-1bd5545567ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:04.306106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe056e3-5c6a-4358-9c82-1bd5545567ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:04.307505 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe056e3-5c6a-4358-9c82-1bd5545567ef None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:04.322674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 100/204] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:04.328703 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c28ea3-6f3f-4fdc-a52f-a81e0ce26410 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:04.452351 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c28ea3-6f3f-4fdc-a52f-a81e0ce26410 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:04.466983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:04.488765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b8b8f-a80b-4bac-b0cf-714e3095d328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:04.489630 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b8b8f-a80b-4bac-b0cf-714e3095d328 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:04.490065 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b8b8f-a80b-4bac-b0cf-714e3095d328 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:04.490494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b8b8f-a80b-4bac-b0cf-714e3095d328 None admin] PATH_INFO: `/v3/users/0486f53621574d2bb0739d034b961bfa` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:04.491793 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b8b8f-a80b-4bac-b0cf-714e3095d328 None admin] RBAC: Authorizing `identity:get_user(user_id=0486f53621574d2bb0739d034b961bfa)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:04.493383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b8b8f-a80b-4bac-b0cf-714e3095d328 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:04.495439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 105/205] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:04 2022] GET /identity/v3/users/0486f53621574d2bb0739d034b961bfa => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:04.501221 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe056e3-5c6a-4358-9c82-1bd5545567ef None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:04.518641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:04.628239 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe056e3-5c6a-4358-9c82-1bd5545567ef None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:04.663702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3004a0-f1df-43b3-8ca1-3fa0c7f803c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:04.664547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3004a0-f1df-43b3-8ca1-3fa0c7f803c2 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:04.664996 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3004a0-f1df-43b3-8ca1-3fa0c7f803c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:04.665417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3004a0-f1df-43b3-8ca1-3fa0c7f803c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:04.747934 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3004a0-f1df-43b3-8ca1-3fa0c7f803c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:04.749653 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3004a0-f1df-43b3-8ca1-3fa0c7f803c2 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:04.764765 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:04.879256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 101/206] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:04.885133 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b8b8f-a80b-4bac-b0cf-714e3095d328 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:04.994922 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b8b8f-a80b-4bac-b0cf-714e3095d328 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:05.029400 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62418e-3b57-4582-94d4-da40ffc965f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:05.030313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62418e-3b57-4582-94d4-da40ffc965f5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:05.030816 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62418e-3b57-4582-94d4-da40ffc965f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:05.031287 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62418e-3b57-4582-94d4-da40ffc965f5 None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:05.032660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62418e-3b57-4582-94d4-da40ffc965f5 None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:05.034241 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62418e-3b57-4582-94d4-da40ffc965f5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:05.036032 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 106/207] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:04 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:05.041961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3004a0-f1df-43b3-8ca1-3fa0c7f803c2 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:05.177377 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3004a0-f1df-43b3-8ca1-3fa0c7f803c2 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:05.202377 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:05.235951 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48809fc-c040-4b31-af28-4065467a08b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:05.236573 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48809fc-c040-4b31-af28-4065467a08b8 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:05.236855 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48809fc-c040-4b31-af28-4065467a08b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:05.237132 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48809fc-c040-4b31-af28-4065467a08b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:05.237881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48809fc-c040-4b31-af28-4065467a08b8 None admin] RBAC: Adding query filter params (role.id=dc7f92ba5a294b00afaa074d01532b7c, scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f, user.id=0486f53621574d2bb0739d034b961bfa) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:05.238177 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48809fc-c040-4b31-af28-4065467a08b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:05.239653 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48809fc-c040-4b31-af28-4065467a08b8 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:05.251550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 102/208] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:05 2022] GET /identity/v3/role_assignments?user.id=0486f53621574d2bb0739d034b961bfa&scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f&role.id=dc7f92ba5a294b00afaa074d01532b7c => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:05.614114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b0de6-6749-4582-97bf-30779d757f8e None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:05.615021 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b0de6-6749-4582-97bf-30779d757f8e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:05.615533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b0de6-6749-4582-97bf-30779d757f8e None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:05.617146 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 107/209] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:05.624705 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3c851-40cc-489c-a683-d373b0dfe268 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:05.624705 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3c851-40cc-489c-a683-d373b0dfe268 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:05.624705 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3c851-40cc-489c-a683-d373b0dfe268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:05.650730 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-e8a3c851-40cc-489c-a683-d373b0dfe268 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:05.652715 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e8a3c851-40cc-489c-a683-d373b0dfe268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:05.740430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 103/210] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:05.808007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cdf2b-ff52-4878-bd22-e1f73beb6d25 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:05.808908 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cdf2b-ff52-4878-bd22-e1f73beb6d25 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:05.809256 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cdf2b-ff52-4878-bd22-e1f73beb6d25 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:05.814968 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 108/211] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:05.818321 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c30b5-3c34-4746-b4a7-a81c0cb9333c None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:05.818625 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c30b5-3c34-4746-b4a7-a81c0cb9333c None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:05.820326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f1ef4-c573-4b30-ae99-7a4888cb050b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:05.820607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f1ef4-c573-4b30-ae99-7a4888cb050b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:05.820877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f1ef4-c573-4b30-ae99-7a4888cb050b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:05.823794 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c30b5-3c34-4746-b4a7-a81c0cb9333c None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:05.828205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 104/212] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:05 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:19:05.832400 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6bb6-3c70-4a93-919a-b25dc4515920 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:05.832681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6bb6-3c70-4a93-919a-b25dc4515920 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:05.832956 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6bb6-3c70-4a93-919a-b25dc4515920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:05.849790 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5e4f1ef4-c573-4b30-ae99-7a4888cb050b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:05.851059 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5e4f1ef4-c573-4b30-ae99-7a4888cb050b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:05.856179 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-67bc6bb6-3c70-4a93-919a-b25dc4515920 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:05.857571 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-67bc6bb6-3c70-4a93-919a-b25dc4515920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:05.904188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:05.931491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 109/213] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:05.942291 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 105/214] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:06.031746 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f1ef4-c573-4b30-ae99-7a4888cb050b None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:06.141967 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f1ef4-c573-4b30-ae99-7a4888cb050b None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:06.180331 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd32a8e-9767-4f89-a453-6499a1eb96d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:06.180886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32a8e-9767-4f89-a453-6499a1eb96d6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.181165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32a8e-9767-4f89-a453-6499a1eb96d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.181443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32a8e-9767-4f89-a453-6499a1eb96d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.193697 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd32a8e-9767-4f89-a453-6499a1eb96d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:06.198573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-5dd32a8e-9767-4f89-a453-6499a1eb96d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:06.198573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:06.198573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:06.198573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:06.198573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:06.198573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:06.198573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:06.198573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:06.198573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:06.198573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:06.198573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:06.198573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:06.198573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:06.198573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:06.198573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:06.198573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:06.200023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:06.200023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:06.200023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:06.200023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:06.200023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:06.200023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:06.200023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:06.200023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:06.200023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:06.200023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:06.200023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:06.200023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:06.200023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:06.200023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:06.200023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:06.200023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:06.200814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:06.200814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:06.200814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:06.200814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:06.200814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:06.200814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:06.200814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:06.200814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:06.200814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:06.200814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:06.200814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:06.200814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:06.200814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 110/215] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:06.203546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc6bb6-3c70-4a93-919a-b25dc4515920 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:06.204710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd32a8e-9767-4f89-a453-6499a1eb96d6 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:06.241468 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:06.248938 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:06.305641 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd32a8e-9767-4f89-a453-6499a1eb96d6 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:06.315809 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc6bb6-3c70-4a93-919a-b25dc4515920 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:06.341639 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2da282-217f-4135-a33f-8376737bd6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:06.342609 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2da282-217f-4135-a33f-8376737bd6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.342914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2da282-217f-4135-a33f-8376737bd6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.343188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2da282-217f-4135-a33f-8376737bd6d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.352155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef05f7-d9c7-49d5-8763-7b425e73bb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:06.352785 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef05f7-d9c7-49d5-8763-7b425e73bb9d None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.353064 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef05f7-d9c7-49d5-8763-7b425e73bb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.353405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef05f7-d9c7-49d5-8763-7b425e73bb9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.354122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2da282-217f-4135-a33f-8376737bd6d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:06.354427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef05f7-d9c7-49d5-8763-7b425e73bb9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:06.355959 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef05f7-d9c7-49d5-8763-7b425e73bb9d None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:06.357771 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 106/216] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:06.359280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-8d2da282-217f-4135-a33f-8376737bd6d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:06.359280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:06.359280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:06.359280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:06.359280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:06.359280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:06.359280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:06.359280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:06.359280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:06.359280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:06.359280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:06.359280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:06.359280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:06.359280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:06.359280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:06.359280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:06.360154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:06.360154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:06.360154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:06.360154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:06.360154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:06.360154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:06.360154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:06.360154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:06.360154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:06.360154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:06.360154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:06.360154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:06.360154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:06.360154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:06.360154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:06.360154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:06.360929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:06.360929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:06.360929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:06.360929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:06.360929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:06.360929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:06.360929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:06.360929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:06.360929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:06.360929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:06.360929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:06.360929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:06.360929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 111/217] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:19:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:19:06.367018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2da282-217f-4135-a33f-8376737bd6d5 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:06.367161 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef05f7-d9c7-49d5-8763-7b425e73bb9d None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:06.460526 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:06.466672 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef05f7-d9c7-49d5-8763-7b425e73bb9d None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:06.467152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2da282-217f-4135-a33f-8376737bd6d5 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:06.473719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:06.501238 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb1f4c-75da-4b0d-81d3-277df83af53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:06.501620 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5eef7-8bf6-418a-8f3d-81747d0b7d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:06.501829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb1f4c-75da-4b0d-81d3-277df83af53a None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.502102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb1f4c-75da-4b0d-81d3-277df83af53a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.502205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5eef7-8bf6-418a-8f3d-81747d0b7d6b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.502365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb1f4c-75da-4b0d-81d3-277df83af53a None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.502487 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5eef7-8bf6-418a-8f3d-81747d0b7d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.502794 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5eef7-8bf6-418a-8f3d-81747d0b7d6b None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.503045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb1f4c-75da-4b0d-81d3-277df83af53a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:06.503457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5eef7-8bf6-418a-8f3d-81747d0b7d6b None admin] RBAC: Adding query filter params (name=member) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:06.503759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5eef7-8bf6-418a-8f3d-81747d0b7d6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:06.504474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb1f4c-75da-4b0d-81d3-277df83af53a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:06.505116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5eef7-8bf6-418a-8f3d-81747d0b7d6b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:06.513591 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 107/218] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:06.514472 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5eef7-8bf6-418a-8f3d-81747d0b7d6b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:06.528690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 112/219] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:19:06 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:19:06.530051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f734c-3a48-4ed0-9d96-8997d829ae1d None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.530336 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f734c-3a48-4ed0-9d96-8997d829ae1d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.530631 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f734c-3a48-4ed0-9d96-8997d829ae1d None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.531838 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 113/220] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:06.536400 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f734c-3a48-4ed0-9d96-8997d829ae1d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:06.650262 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5eef7-8bf6-418a-8f3d-81747d0b7d6b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:06.652347 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f734c-3a48-4ed0-9d96-8997d829ae1d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:06.694202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55b7e7-407c-4df6-a299-cfe311bb55e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:06.694930 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55b7e7-407c-4df6-a299-cfe311bb55e4 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.695212 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55b7e7-407c-4df6-a299-cfe311bb55e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.695481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55b7e7-407c-4df6-a299-cfe311bb55e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.696201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55b7e7-407c-4df6-a299-cfe311bb55e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:06.696673 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55b7e7-407c-4df6-a299-cfe311bb55e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:06.698120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55b7e7-407c-4df6-a299-cfe311bb55e4 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:06.698227 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86842d3-e2e3-4fb7-a820-b24dd9a1b8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:06.698711 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86842d3-e2e3-4fb7-a820-b24dd9a1b8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.699367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86842d3-e2e3-4fb7-a820-b24dd9a1b8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.699483 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86842d3-e2e3-4fb7-a820-b24dd9a1b8a7 None admin] PATH_INFO: `/v3/users/d7fdcb973bc548a39eb779d3046bdc17` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.707120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 108/221] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:06.708141 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46640ec5-b4f5-4a78-a26d-f8db89498877 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.708420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46640ec5-b4f5-4a78-a26d-f8db89498877 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.708690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46640ec5-b4f5-4a78-a26d-f8db89498877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.716056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86842d3-e2e3-4fb7-a820-b24dd9a1b8a7 None admin] RBAC: Authorizing `identity:get_user(user_id=d7fdcb973bc548a39eb779d3046bdc17)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:06.717097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86842d3-e2e3-4fb7-a820-b24dd9a1b8a7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:06.722686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 114/222] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:06 2022] GET /identity/v3/users/d7fdcb973bc548a39eb779d3046bdc17 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:06.722686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86842d3-e2e3-4fb7-a820-b24dd9a1b8a7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:06.733723 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:06.739885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-46640ec5-b4f5-4a78-a26d-f8db89498877 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:06.741375 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-46640ec5-b4f5-4a78-a26d-f8db89498877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:06.770763 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:06.828448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 109/223] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:06.828448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46640ec5-b4f5-4a78-a26d-f8db89498877 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:06.844119 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86842d3-e2e3-4fb7-a820-b24dd9a1b8a7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:06.889881 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7dff1-d511-42fe-b146-6ec857c021b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:06.890641 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7dff1-d511-42fe-b146-6ec857c021b5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.890949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7dff1-d511-42fe-b146-6ec857c021b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.891223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7dff1-d511-42fe-b146-6ec857c021b5 None admin] PATH_INFO: `/v3/users/aae9321bb6ee4f5e906bcb26364640ae` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.892384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7dff1-d511-42fe-b146-6ec857c021b5 None admin] RBAC: Authorizing `identity:get_user(user_id=aae9321bb6ee4f5e906bcb26364640ae)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:06.894065 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7dff1-d511-42fe-b146-6ec857c021b5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:06.897426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 115/224] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:06 2022] GET /identity/v3/users/aae9321bb6ee4f5e906bcb26364640ae => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:06.903119 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7dff1-d511-42fe-b146-6ec857c021b5 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:06.952952 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46640ec5-b4f5-4a78-a26d-f8db89498877 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:07.009102 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437acb3c-623d-4db2-8181-5e24f01b5dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:07.009639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437acb3c-623d-4db2-8181-5e24f01b5dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:07.009921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437acb3c-623d-4db2-8181-5e24f01b5dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:07.010192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437acb3c-623d-4db2-8181-5e24f01b5dc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:07.027977 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:07.069048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7dff1-d511-42fe-b146-6ec857c021b5 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:07.073090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:07.129188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbcff8-8175-4d2f-8b4c-e31430303c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:07.129945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbcff8-8175-4d2f-8b4c-e31430303c18 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:07.130225 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbcff8-8175-4d2f-8b4c-e31430303c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:07.130498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbcff8-8175-4d2f-8b4c-e31430303c18 None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:07.131702 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbcff8-8175-4d2f-8b4c-e31430303c18 None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:07.134051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbcff8-8175-4d2f-8b4c-e31430303c18 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:07.135657 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437acb3c-623d-4db2-8181-5e24f01b5dc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:07.136411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 116/225] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:06 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:07.137242 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbcff8-8175-4d2f-8b4c-e31430303c18 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:07.137362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437acb3c-623d-4db2-8181-5e24f01b5dc1 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:07.266951 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbcff8-8175-4d2f-8b4c-e31430303c18 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:07.267520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 110/226] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:07.268119 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437acb3c-623d-4db2-8181-5e24f01b5dc1 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:07.306964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702154e-e87c-4fa8-b20d-dcb71c577968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:07.307597 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702154e-e87c-4fa8-b20d-dcb71c577968 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:07.307876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702154e-e87c-4fa8-b20d-dcb71c577968 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:07.308175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702154e-e87c-4fa8-b20d-dcb71c577968 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:07.319041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702154e-e87c-4fa8-b20d-dcb71c577968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:07.324319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-2702154e-e87c-4fa8-b20d-dcb71c577968 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:07.324319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:07.324319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:07.324319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:07.324319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:07.324319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:07.324319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:07.324319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:07.324319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:07.324319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:07.324319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:07.324319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:07.324319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:07.324319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:07.324319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:07.324319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:07.325210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:07.325210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:07.325210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:07.325210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:07.325210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:07.325210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:07.325210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:07.325210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:07.325210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:07.325210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:07.325210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:07.325210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:07.325210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:07.325210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:07.325210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:07.325210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:07.327566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:07.327566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:07.327566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:07.327566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:07.327566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:07.327566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:07.327566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:07.327566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:07.327566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:07.327566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:07.327566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:07.327566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:07.327566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 117/227] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:07.327566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702154e-e87c-4fa8-b20d-dcb71c577968 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:07.334938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:07.343206 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:07.388813 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437acb3c-623d-4db2-8181-5e24f01b5dc1 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:07.426198 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8d27e-677a-4b72-b4c4-aabcb3409dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:07.426880 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8d27e-677a-4b72-b4c4-aabcb3409dce None admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:07.427162 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8d27e-677a-4b72-b4c4-aabcb3409dce None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:07.427540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8d27e-677a-4b72-b4c4-aabcb3409dce None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127/users/aae9321bb6ee4f5e906bcb26364640ae/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:07.429577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8d27e-677a-4b72-b4c4-aabcb3409dce None admin] RBAC: Authorizing `identity:create_grant(project_id=63e679fbf8c3498a8cc0860b3a0f5127, user_id=aae9321bb6ee4f5e906bcb26364640ae, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:07.431056 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8d27e-677a-4b72-b4c4-aabcb3409dce None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:07.431246 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702154e-e87c-4fa8-b20d-dcb71c577968 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:07.445272 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 111/228] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:19:07 2022] PUT /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127/users/aae9321bb6ee4f5e906bcb26364640ae/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:07.446326 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8d27e-677a-4b72-b4c4-aabcb3409dce None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:07.471669 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5338b-a1f7-4381-ba3d-3fa19969680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:07.472315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5338b-a1f7-4381-ba3d-3fa19969680b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:07.472692 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5338b-a1f7-4381-ba3d-3fa19969680b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:07.472969 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5338b-a1f7-4381-ba3d-3fa19969680b None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:07.474191 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5338b-a1f7-4381-ba3d-3fa19969680b None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:07.475975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5338b-a1f7-4381-ba3d-3fa19969680b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:07.477783 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 118/229] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:07 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:07.483774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5338b-a1f7-4381-ba3d-3fa19969680b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:07.569949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:07.572890 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8d27e-677a-4b72-b4c4-aabcb3409dce None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:07.599811 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:07.601952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5338b-a1f7-4381-ba3d-3fa19969680b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:07.617734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a928d88-a3f2-4711-b6fd-d991d9bd3052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:07.619180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a928d88-a3f2-4711-b6fd-d991d9bd3052 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:07.619541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a928d88-a3f2-4711-b6fd-d991d9bd3052 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:07.619881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a928d88-a3f2-4711-b6fd-d991d9bd3052 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:07.620667 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a928d88-a3f2-4711-b6fd-d991d9bd3052 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:07.621042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a928d88-a3f2-4711-b6fd-d991d9bd3052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:07.625201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a928d88-a3f2-4711-b6fd-d991d9bd3052 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:07.634835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 112/230] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:07.641616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a928d88-a3f2-4711-b6fd-d991d9bd3052 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:07.659142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00f5ed-b31a-4950-a6b1-05b5be035c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:07.659885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00f5ed-b31a-4950-a6b1-05b5be035c33 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:07.660084 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00f5ed-b31a-4950-a6b1-05b5be035c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:07.660356 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00f5ed-b31a-4950-a6b1-05b5be035c33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:07.661293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00f5ed-b31a-4950-a6b1-05b5be035c33 None admin] RBAC: Adding query filter params (role.id=8b655a66d879422db1b56ca98d77e490, scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127, user.id=d7fdcb973bc548a39eb779d3046bdc17) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:07.661553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00f5ed-b31a-4950-a6b1-05b5be035c33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:07.663038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00f5ed-b31a-4950-a6b1-05b5be035c33 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:07.670071 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 119/231] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:07 2022] GET /identity/v3/role_assignments?user.id=d7fdcb973bc548a39eb779d3046bdc17&scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127&role.id=8b655a66d879422db1b56ca98d77e490 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:07.762062 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a928d88-a3f2-4711-b6fd-d991d9bd3052 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:07.801307 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e0df3-4371-4f7e-81e7-aa3da544a48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:07.802325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e0df3-4371-4f7e-81e7-aa3da544a48b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:07.802849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e0df3-4371-4f7e-81e7-aa3da544a48b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:07.803320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e0df3-4371-4f7e-81e7-aa3da544a48b None admin] PATH_INFO: `/v3/users/aae9321bb6ee4f5e906bcb26364640ae` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:07.804735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e0df3-4371-4f7e-81e7-aa3da544a48b None admin] RBAC: Authorizing `identity:get_user(user_id=aae9321bb6ee4f5e906bcb26364640ae)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:07.806452 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e0df3-4371-4f7e-81e7-aa3da544a48b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:07.809208 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 113/232] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:07 2022] GET /identity/v3/users/aae9321bb6ee4f5e906bcb26364640ae => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:07.815122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00f5ed-b31a-4950-a6b1-05b5be035c33 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:07.947976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00f5ed-b31a-4950-a6b1-05b5be035c33 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:07.996894 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b444f-e195-4a72-9f21-ed3cb3fdf103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:07.997536 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b444f-e195-4a72-9f21-ed3cb3fdf103 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:07.997819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b444f-e195-4a72-9f21-ed3cb3fdf103 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:07.998098 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b444f-e195-4a72-9f21-ed3cb3fdf103 None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:07.999252 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b444f-e195-4a72-9f21-ed3cb3fdf103 None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:08.000711 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b444f-e195-4a72-9f21-ed3cb3fdf103 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:08.002681 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 120/233] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:07 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:08.008527 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e0df3-4371-4f7e-81e7-aa3da544a48b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:08.085981 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:08.157347 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e0df3-4371-4f7e-81e7-aa3da544a48b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:08.204276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b659e-7130-4bcf-8aed-f7c6f4151599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:08.204862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b659e-7130-4bcf-8aed-f7c6f4151599 None admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:08.205138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b659e-7130-4bcf-8aed-f7c6f4151599 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:08.205407 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b659e-7130-4bcf-8aed-f7c6f4151599 None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127/users/aae9321bb6ee4f5e906bcb26364640ae/roles/0e112f96840a483bb6dfeab1bb8af187` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:08.207602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b659e-7130-4bcf-8aed-f7c6f4151599 None admin] RBAC: Authorizing `identity:create_grant(project_id=63e679fbf8c3498a8cc0860b3a0f5127, user_id=aae9321bb6ee4f5e906bcb26364640ae, role_id=0e112f96840a483bb6dfeab1bb8af187)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:08.209039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b659e-7130-4bcf-8aed-f7c6f4151599 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:08.225401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 114/234] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:19:08 2022] PUT /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127/users/aae9321bb6ee4f5e906bcb26364640ae/roles/0e112f96840a483bb6dfeab1bb8af187 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:08.849517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87b7e1-d77b-4feb-8aeb-050ee1283cb8 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:08.850023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87b7e1-d77b-4feb-8aeb-050ee1283cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:08.850098 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87b7e1-d77b-4feb-8aeb-050ee1283cb8 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:08.851695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 121/235] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:08.857363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1afb2-2654-4dc9-beb5-836a0a083b3f None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:08.857769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1afb2-2654-4dc9-beb5-836a0a083b3f None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:08.857955 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1afb2-2654-4dc9-beb5-836a0a083b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:08.881393 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-e0f1afb2-2654-4dc9-beb5-836a0a083b3f None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:08.882511 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e0f1afb2-2654-4dc9-beb5-836a0a083b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:08.983700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 115/236] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:09.210458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cd679-a702-41ec-a3cd-5e320ec77791 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:09.210813 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cd679-a702-41ec-a3cd-5e320ec77791 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:09.210990 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cd679-a702-41ec-a3cd-5e320ec77791 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:09.212618 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 122/237] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:09.217682 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63694b29-e58b-4ad1-bfc4-e04c546ee758 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:09.217968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63694b29-e58b-4ad1-bfc4-e04c546ee758 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:09.218238 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63694b29-e58b-4ad1-bfc4-e04c546ee758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:09.247552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-63694b29-e58b-4ad1-bfc4-e04c546ee758 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:09.248736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-63694b29-e58b-4ad1-bfc4-e04c546ee758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:09.292577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:09.336291 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 116/238] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:09.397018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cd679-a702-41ec-a3cd-5e320ec77791 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:09.408407 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:09.551161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cd679-a702-41ec-a3cd-5e320ec77791 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:09.604482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38633870-faac-4673-9ca0-8d2c81b62d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:09.608599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38633870-faac-4673-9ca0-8d2c81b62d2c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:09.608599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38633870-faac-4673-9ca0-8d2c81b62d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:09.608599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38633870-faac-4673-9ca0-8d2c81b62d2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:09.614333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38633870-faac-4673-9ca0-8d2c81b62d2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:09.614333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38633870-faac-4673-9ca0-8d2c81b62d2c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:09.614543 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 123/239] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:09.621615 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63694b29-e58b-4ad1-bfc4-e04c546ee758 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:09.674704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38633870-faac-4673-9ca0-8d2c81b62d2c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:09.812916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63694b29-e58b-4ad1-bfc4-e04c546ee758 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:09.821590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:09.865948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f78ad-698b-4e94-a320-3bd7c0ab6d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:09.866912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f78ad-698b-4e94-a320-3bd7c0ab6d5a None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:09.866912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f78ad-698b-4e94-a320-3bd7c0ab6d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:09.867163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f78ad-698b-4e94-a320-3bd7c0ab6d5a None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:09.867785 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f78ad-698b-4e94-a320-3bd7c0ab6d5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:09.869215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f78ad-698b-4e94-a320-3bd7c0ab6d5a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:09.885459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38633870-faac-4673-9ca0-8d2c81b62d2c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:09.897661 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 117/240] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:19:09 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:19:09.932877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24ef71-6ae5-4a88-90ba-24472a731722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:09.933622 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24ef71-6ae5-4a88-90ba-24472a731722 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:09.933957 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24ef71-6ae5-4a88-90ba-24472a731722 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:09.934365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24ef71-6ae5-4a88-90ba-24472a731722 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:09.945098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c657d12-a96c-44bf-8f95-3a43622938ae None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:09.945628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c657d12-a96c-44bf-8f95-3a43622938ae None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:09.946050 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c657d12-a96c-44bf-8f95-3a43622938ae None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:09.948291 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 118/241] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:19:09.954175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24ef71-6ae5-4a88-90ba-24472a731722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:09.954488 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660846bb-516e-43f7-82a7-c628a44e7af2 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:09.954760 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660846bb-516e-43f7-82a7-c628a44e7af2 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:09.955032 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660846bb-516e-43f7-82a7-c628a44e7af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:09.961081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-dd24ef71-6ae5-4a88-90ba-24472a731722 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:09.961081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:09.961081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:09.961081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:09.961081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:09.961081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:09.961081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:09.961081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:09.961081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:09.961081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:09.961081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:09.961081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:09.961081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:09.961081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:09.961081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:09.961081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:09.962010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:09.962010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:09.962010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:09.962010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:09.962010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:09.962010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:09.962010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:09.962010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:09.962010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:09.962010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:09.962010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:09.962010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:09.962010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:09.962010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:09.962010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:09.962010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:09.962851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:09.962851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:09.962851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:09.962851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:09.962851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:09.962851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:09.962851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:09.962851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:09.962851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:09.962851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:09.962851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:09.962851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:09.965727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 124/242] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:09.971990 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24ef71-6ae5-4a88-90ba-24472a731722 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:09.976687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-660846bb-516e-43f7-82a7-c628a44e7af2 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:09.978436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-660846bb-516e-43f7-82a7-c628a44e7af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:10.003282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:10.103454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 119/243] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:10.113157 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa7d0b-ef67-43af-a381-2de409e79489 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:10.113471 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa7d0b-ef67-43af-a381-2de409e79489 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:10.113714 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa7d0b-ef67-43af-a381-2de409e79489 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:10.115543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 120/244] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:10.126777 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ae8dd-9680-4323-a834-ac22730b5b33 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:10.127139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ae8dd-9680-4323-a834-ac22730b5b33 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:10.127418 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ae8dd-9680-4323-a834-ac22730b5b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:10.151076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-990ae8dd-9680-4323-a834-ac22730b5b33 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:10.153120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-990ae8dd-9680-4323-a834-ac22730b5b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:10.172914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24ef71-6ae5-4a88-90ba-24472a731722 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:10.215507 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bb09f-5ed3-426e-b789-7af71070c9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:10.216116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bb09f-5ed3-426e-b789-7af71070c9db None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:10.216389 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bb09f-5ed3-426e-b789-7af71070c9db None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:10.216665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bb09f-5ed3-426e-b789-7af71070c9db None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:10.219555 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bb09f-5ed3-426e-b789-7af71070c9db None admin] RBAC: Adding query filter params (name=reader) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:10.219886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bb09f-5ed3-426e-b789-7af71070c9db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:10.221589 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bb09f-5ed3-426e-b789-7af71070c9db None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:10.222990 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:10.233321 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 125/245] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:10.240737 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bb09f-5ed3-426e-b789-7af71070c9db None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:10.265003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 121/246] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:10.360775 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bb09f-5ed3-426e-b789-7af71070c9db None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:10.396785 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc17f0f-86c7-4e23-aa69-d1fe3a576775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:10.397418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc17f0f-86c7-4e23-aa69-d1fe3a576775 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:10.397690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc17f0f-86c7-4e23-aa69-d1fe3a576775 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:10.397959 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc17f0f-86c7-4e23-aa69-d1fe3a576775 None admin] PATH_INFO: `/v3/users/adcced2f21084a09acc57985b3984ae2` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:10.412037 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc17f0f-86c7-4e23-aa69-d1fe3a576775 None admin] RBAC: Authorizing `identity:get_user(user_id=adcced2f21084a09acc57985b3984ae2)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:10.412203 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ae8dd-9680-4323-a834-ac22730b5b33 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:10.413484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc17f0f-86c7-4e23-aa69-d1fe3a576775 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:10.416057 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 126/247] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:10 2022] GET /identity/v3/users/adcced2f21084a09acc57985b3984ae2 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:10.421813 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc17f0f-86c7-4e23-aa69-d1fe3a576775 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:10.485538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:10.534599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc17f0f-86c7-4e23-aa69-d1fe3a576775 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:10.542377 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:10.561544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ae8dd-9680-4323-a834-ac22730b5b33 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:10.578819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b26e1c-84df-493a-a5be-9146ced52e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:10.579426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26e1c-84df-493a-a5be-9146ced52e4a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:10.579698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26e1c-84df-493a-a5be-9146ced52e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:10.579961 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26e1c-84df-493a-a5be-9146ced52e4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:10.617335 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f90802-8ef1-46f6-b4b7-0d952293187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:10.617912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f90802-8ef1-46f6-b4b7-0d952293187b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:10.618194 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f90802-8ef1-46f6-b4b7-0d952293187b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:10.618469 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f90802-8ef1-46f6-b4b7-0d952293187b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:10.633263 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f90802-8ef1-46f6-b4b7-0d952293187b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:10.640171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-14f90802-8ef1-46f6-b4b7-0d952293187b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:10.640171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:10.640171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:10.640171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:10.640171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:10.640171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:10.640171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:10.640171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:10.640171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:10.640171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:10.640171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:10.640171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:10.640171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:10.640171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:10.640171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:10.640171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:10.641081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:10.641081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:10.641081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:10.641081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:10.641081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:10.641081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:10.641081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:10.641081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:10.641081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:10.641081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:10.641081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:10.641081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:10.641081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:10.641081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:10.641081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:10.641081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:10.641876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:10.641876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:10.641876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:10.641876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:10.641876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:10.641876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:10.641876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:10.641876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:10.641876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:10.641876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:10.641876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:10.641876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:10.641876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 122/248] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:19:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:10.642529 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f90802-8ef1-46f6-b4b7-0d952293187b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:10.686429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b26e1c-84df-493a-a5be-9146ced52e4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:10.688297 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b26e1c-84df-493a-a5be-9146ced52e4a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:10.764740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:10.776520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f90802-8ef1-46f6-b4b7-0d952293187b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:10.819567 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddcebc-7fca-4da2-bc98-c9231c6dc99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:10.820581 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddcebc-7fca-4da2-bc98-c9231c6dc99d None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:10.821067 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddcebc-7fca-4da2-bc98-c9231c6dc99d None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:10.821530 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddcebc-7fca-4da2-bc98-c9231c6dc99d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:10.826657 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 127/249] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:10.826657 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b26e1c-84df-493a-a5be-9146ced52e4a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:10.838869 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddcebc-7fca-4da2-bc98-c9231c6dc99d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:10.844579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-8eddcebc-7fca-4da2-bc98-c9231c6dc99d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:10.844579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:10.844579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:10.844579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:10.844579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:10.844579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:10.844579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:10.844579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:10.844579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:10.844579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:10.844579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:10.844579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:10.844579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:10.844579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:10.844579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:10.844579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:10.845474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:10.845474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:10.845474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:10.845474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:10.845474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:10.845474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:10.845474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:10.845474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:10.845474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:10.845474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:10.845474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:10.845474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:10.845474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:10.845474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:10.845474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:10.845474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:10.846275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:10.846275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:10.846275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:10.846275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:10.846275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:10.846275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:10.846275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:10.846275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:10.846275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:10.846275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:10.846275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:10.846275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:10.846275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 123/250] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:10.850116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2262b6-a719-465a-af5f-02090846a0a6 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:10.850116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2262b6-a719-465a-af5f-02090846a0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:10.850116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2262b6-a719-465a-af5f-02090846a0a6 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:10.850116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 124/251] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:10.850877 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2262b6-a719-465a-af5f-02090846a0a6 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:10.861154 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:10.933151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b26e1c-84df-493a-a5be-9146ced52e4a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:10.967288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2262b6-a719-465a-af5f-02090846a0a6 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:10.969677 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23393e5-e685-4880-829d-f247f220655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:10.970281 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23393e5-e685-4880-829d-f247f220655a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:10.970557 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23393e5-e685-4880-829d-f247f220655a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:10.970858 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23393e5-e685-4880-829d-f247f220655a None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:10.971530 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23393e5-e685-4880-829d-f247f220655a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:10.971830 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23393e5-e685-4880-829d-f247f220655a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:10.973200 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23393e5-e685-4880-829d-f247f220655a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:10.982672 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 128/252] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:10.983511 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23393e5-e685-4880-829d-f247f220655a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:11.004914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04250008-e799-4633-b669-76b593676814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:11.005541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04250008-e799-4633-b669-76b593676814 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:11.005822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04250008-e799-4633-b669-76b593676814 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:11.006102 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04250008-e799-4633-b669-76b593676814 None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:11.006890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:11.007243 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04250008-e799-4633-b669-76b593676814 None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:11.009112 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04250008-e799-4633-b669-76b593676814 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:11.010788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 125/253] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:10 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:11.017031 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d262b-b21d-4df1-aa93-88f728a16b71 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:11.017317 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d262b-b21d-4df1-aa93-88f728a16b71 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:11.017597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d262b-b21d-4df1-aa93-88f728a16b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:11.036642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-102d262b-b21d-4df1-aa93-88f728a16b71 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:11.037850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-102d262b-b21d-4df1-aa93-88f728a16b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:11.089720 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23393e5-e685-4880-829d-f247f220655a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:11.122639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 126/254] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:11.122639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d262b-b21d-4df1-aa93-88f728a16b71 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:11.122639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:11.170662 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f409cb3-3531-4180-8763-43603a52f333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:11.170662 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f409cb3-3531-4180-8763-43603a52f333 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:11.170662 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f409cb3-3531-4180-8763-43603a52f333 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:11.170978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f409cb3-3531-4180-8763-43603a52f333 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:11.171416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f409cb3-3531-4180-8763-43603a52f333 None admin] RBAC: Adding query filter params (name=member) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:11.171719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f409cb3-3531-4180-8763-43603a52f333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:11.173102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f409cb3-3531-4180-8763-43603a52f333 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:11.194348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 129/255] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:11.211391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f409cb3-3531-4180-8763-43603a52f333 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:11.238953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d262b-b21d-4df1-aa93-88f728a16b71 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:11.308835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f91b8-018e-45e9-9fca-b61872aa930c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:11.309475 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f91b8-018e-45e9-9fca-b61872aa930c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:11.309757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f91b8-018e-45e9-9fca-b61872aa930c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:11.310033 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f91b8-018e-45e9-9fca-b61872aa930c None admin] PATH_INFO: `/v3/users/aae9321bb6ee4f5e906bcb26364640ae` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:11.311963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f91b8-018e-45e9-9fca-b61872aa930c None admin] RBAC: Authorizing `identity:get_user(user_id=aae9321bb6ee4f5e906bcb26364640ae)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:11.313419 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f91b8-018e-45e9-9fca-b61872aa930c None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:11.315380 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 127/256] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:11 2022] GET /identity/v3/users/aae9321bb6ee4f5e906bcb26364640ae => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:11.316158 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f91b8-018e-45e9-9fca-b61872aa930c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:11.388470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:11.401059 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:11.435587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f91b8-018e-45e9-9fca-b61872aa930c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:11.437936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f409cb3-3531-4180-8763-43603a52f333 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:11.472594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ac8d7-c64a-4d53-9ece-7382ccccf6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:11.473160 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ac8d7-c64a-4d53-9ece-7382ccccf6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:11.473441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ac8d7-c64a-4d53-9ece-7382ccccf6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:11.473709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ac8d7-c64a-4d53-9ece-7382ccccf6b1 None admin] PATH_INFO: `/v3/users/d7fdcb973bc548a39eb779d3046bdc17` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:11.475334 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ac8d7-c64a-4d53-9ece-7382ccccf6b1 None admin] RBAC: Authorizing `identity:get_user(user_id=d7fdcb973bc548a39eb779d3046bdc17)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:11.476778 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ac8d7-c64a-4d53-9ece-7382ccccf6b1 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:11.478362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 128/257] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:11 2022] GET /identity/v3/users/d7fdcb973bc548a39eb779d3046bdc17 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:11.479399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ac8d7-c64a-4d53-9ece-7382ccccf6b1 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:11.531316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d84e67-4501-46c3-8168-bc293b1b8ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:11.531931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d84e67-4501-46c3-8168-bc293b1b8ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:11.532208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d84e67-4501-46c3-8168-bc293b1b8ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:11.532475 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d84e67-4501-46c3-8168-bc293b1b8ed3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:11.533219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d84e67-4501-46c3-8168-bc293b1b8ed3 None admin] RBAC: Adding query filter params (role.id=dc7f92ba5a294b00afaa074d01532b7c, scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127, user.id=adcced2f21084a09acc57985b3984ae2) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:11.533523 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d84e67-4501-46c3-8168-bc293b1b8ed3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:11.534983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d84e67-4501-46c3-8168-bc293b1b8ed3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:11.546889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 130/258] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:11 2022] GET /identity/v3/role_assignments?user.id=adcced2f21084a09acc57985b3984ae2&scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127&role.id=dc7f92ba5a294b00afaa074d01532b7c => generated 259 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:11.547762 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d84e67-4501-46c3-8168-bc293b1b8ed3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:11.709835 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d84e67-4501-46c3-8168-bc293b1b8ed3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:11.744880 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ac8d7-c64a-4d53-9ece-7382ccccf6b1 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:11.778372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9f196-12d5-49dc-965b-66e40f58b766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:11.779304 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9f196-12d5-49dc-965b-66e40f58b766 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:11.779728 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9f196-12d5-49dc-965b-66e40f58b766 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:11.780176 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9f196-12d5-49dc-965b-66e40f58b766 None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:11.781543 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9f196-12d5-49dc-965b-66e40f58b766 None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:11.783315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9f196-12d5-49dc-965b-66e40f58b766 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:11.785256 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 131/259] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:11 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:11.786303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9f196-12d5-49dc-965b-66e40f58b766 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:11.800963 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:11.902727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9f196-12d5-49dc-965b-66e40f58b766 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:11.928875 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812e60b-9bc6-411d-81b0-101da883ab51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:11.929641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812e60b-9bc6-411d-81b0-101da883ab51 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:11.929843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812e60b-9bc6-411d-81b0-101da883ab51 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:11.930091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812e60b-9bc6-411d-81b0-101da883ab51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:11.940143 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d19a53-18ee-4b0e-8e29-93dce43e302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:11.941832 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d19a53-18ee-4b0e-8e29-93dce43e302e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:11.942444 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d19a53-18ee-4b0e-8e29-93dce43e302e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:11.943058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d19a53-18ee-4b0e-8e29-93dce43e302e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:11.952251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:11.957254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d19a53-18ee-4b0e-8e29-93dce43e302e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:11.962974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-12d19a53-18ee-4b0e-8e29-93dce43e302e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:11.962974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:11.962974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:11.962974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:11.962974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:11.962974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:11.962974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:11.962974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:11.962974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:11.962974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:11.962974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:11.962974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:11.962974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:11.962974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:11.962974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:11.962974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:11.963855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:11.963855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:11.963855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:11.963855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:11.963855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:11.963855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:11.963855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:11.963855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:11.963855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:11.963855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:11.963855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:11.963855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:11.963855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:11.963855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:11.963855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:11.963855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:11.964690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:11.964690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:11.964690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:11.964690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:11.964690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:11.964690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:11.964690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:11.964690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:11.964690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:11.964690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:11.964690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:11.964690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:11.967572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 132/260] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:11.968487 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d19a53-18ee-4b0e-8e29-93dce43e302e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:12.049377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:12.075753 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d19a53-18ee-4b0e-8e29-93dce43e302e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:12.090639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812e60b-9bc6-411d-81b0-101da883ab51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:12.090639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812e60b-9bc6-411d-81b0-101da883ab51 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:12.140216 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d03c2-5a8e-46ba-aa97-a5e70f9b3d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:12.140889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d03c2-5a8e-46ba-aa97-a5e70f9b3d53 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:12.141162 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d03c2-5a8e-46ba-aa97-a5e70f9b3d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:12.141432 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d03c2-5a8e-46ba-aa97-a5e70f9b3d53 None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127/users/d7fdcb973bc548a39eb779d3046bdc17/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:12.143396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d03c2-5a8e-46ba-aa97-a5e70f9b3d53 None admin] RBAC: Authorizing `identity:create_grant(project_id=63e679fbf8c3498a8cc0860b3a0f5127, user_id=d7fdcb973bc548a39eb779d3046bdc17, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:12.144839 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d03c2-5a8e-46ba-aa97-a5e70f9b3d53 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:12.170982 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 133/261] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:19:11 2022] PUT /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127/users/d7fdcb973bc548a39eb779d3046bdc17/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:12.174839 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d03c2-5a8e-46ba-aa97-a5e70f9b3d53 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:12.191492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 129/262] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:12.200257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812e60b-9bc6-411d-81b0-101da883ab51 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:12.279019 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:12.403133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812e60b-9bc6-411d-81b0-101da883ab51 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:12.407440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d03c2-5a8e-46ba-aa97-a5e70f9b3d53 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:12.439030 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:12.452972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbf8ac-e9cc-422f-bec9-4f672e294e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:12.453589 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbf8ac-e9cc-422f-bec9-4f672e294e27 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:12.453870 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbf8ac-e9cc-422f-bec9-4f672e294e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:12.454210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbf8ac-e9cc-422f-bec9-4f672e294e27 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:12.454913 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbf8ac-e9cc-422f-bec9-4f672e294e27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:12.455217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbf8ac-e9cc-422f-bec9-4f672e294e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:12.457898 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbf8ac-e9cc-422f-bec9-4f672e294e27 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:12.473078 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 134/263] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:12.477485 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ff889-0a13-4ed1-82cd-335a6930088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:12.478194 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ff889-0a13-4ed1-82cd-335a6930088f None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:12.478481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ff889-0a13-4ed1-82cd-335a6930088f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:12.478787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ff889-0a13-4ed1-82cd-335a6930088f None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:12.479726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbf8ac-e9cc-422f-bec9-4f672e294e27 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:12.479965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ff889-0a13-4ed1-82cd-335a6930088f None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:12.481515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ff889-0a13-4ed1-82cd-335a6930088f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:12.483482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 130/264] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:12 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:12.489745 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ff889-0a13-4ed1-82cd-335a6930088f None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:12.655715 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ff889-0a13-4ed1-82cd-335a6930088f None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:12.671074 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:12.685408 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbf8ac-e9cc-422f-bec9-4f672e294e27 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:12.721531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84aeb4-f751-4b0f-8e40-a232f5cf76cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:12.722137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84aeb4-f751-4b0f-8e40-a232f5cf76cc None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:12.722419 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84aeb4-f751-4b0f-8e40-a232f5cf76cc None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:12.722727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84aeb4-f751-4b0f-8e40-a232f5cf76cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:12.723463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84aeb4-f751-4b0f-8e40-a232f5cf76cc None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127, user.id=aae9321bb6ee4f5e906bcb26364640ae) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:12.723770 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84aeb4-f751-4b0f-8e40-a232f5cf76cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:12.725219 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84aeb4-f751-4b0f-8e40-a232f5cf76cc None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:12.736234 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 131/265] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:12 2022] GET /identity/v3/role_assignments?user.id=aae9321bb6ee4f5e906bcb26364640ae&scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127&role.id=3cd61239237441418529e9028ef801e4 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:12.744581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3588b36-7e94-4a5e-a1e5-f80c5b479bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:12.745236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3588b36-7e94-4a5e-a1e5-f80c5b479bfe None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:12.745566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3588b36-7e94-4a5e-a1e5-f80c5b479bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:12.746352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3588b36-7e94-4a5e-a1e5-f80c5b479bfe None admin] PATH_INFO: `/v3/users/aae9321bb6ee4f5e906bcb26364640ae` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:12.747646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3588b36-7e94-4a5e-a1e5-f80c5b479bfe None admin] RBAC: Authorizing `identity:get_user(user_id=aae9321bb6ee4f5e906bcb26364640ae)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:12.749134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3588b36-7e94-4a5e-a1e5-f80c5b479bfe None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:12.751147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 135/266] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:12 2022] GET /identity/v3/users/aae9321bb6ee4f5e906bcb26364640ae => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:12.759826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84aeb4-f751-4b0f-8e40-a232f5cf76cc None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:12.907357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84aeb4-f751-4b0f-8e40-a232f5cf76cc None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:12.943640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad93ae3-f897-42c0-9cd7-cd7cba5520c4 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:12.944147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad93ae3-f897-42c0-9cd7-cd7cba5520c4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:12.944362 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad93ae3-f897-42c0-9cd7-cd7cba5520c4 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:12.945948 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 136/267] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:12.951019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9e77b-d403-4c3f-8569-0fea82e28fb7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:12.951299 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9e77b-d403-4c3f-8569-0fea82e28fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:12.951571 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9e77b-d403-4c3f-8569-0fea82e28fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:12.972579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7371d9d-555a-42ee-9c46-052cd7a95df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:12.973210 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7371d9d-555a-42ee-9c46-052cd7a95df5 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:12.973487 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7371d9d-555a-42ee-9c46-052cd7a95df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:12.973757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7371d9d-555a-42ee-9c46-052cd7a95df5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:12.981188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ecb9e77b-d403-4c3f-8569-0fea82e28fb7 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:12.982406 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ecb9e77b-d403-4c3f-8569-0fea82e28fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:13.052137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:13.084562 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:13.092745 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 137/268] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:13.092909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7371d9d-555a-42ee-9c46-052cd7a95df5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:13.093799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bedca-879b-43f3-b578-8ce8bb0d4bdd None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:13.094081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bedca-879b-43f3-b578-8ce8bb0d4bdd None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:13.094359 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7371d9d-555a-42ee-9c46-052cd7a95df5 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:13.094462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bedca-879b-43f3-b578-8ce8bb0d4bdd None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:13.095896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 138/269] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:13.101129 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba7fbd-fce1-48e0-ac2c-12309f554c47 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:13.101510 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba7fbd-fce1-48e0-ac2c-12309f554c47 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:13.101786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba7fbd-fce1-48e0-ac2c-12309f554c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:13.124613 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a3ba7fbd-fce1-48e0-ac2c-12309f554c47 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:13.125795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a3ba7fbd-fce1-48e0-ac2c-12309f554c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:13.211506 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 139/270] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:13.275333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 132/271] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:13.281365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba7fbd-fce1-48e0-ac2c-12309f554c47 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:13.428361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba7fbd-fce1-48e0-ac2c-12309f554c47 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:13.456048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:13.474598 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c4baa-084b-4416-8a98-e8fbddab8b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:13.476089 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7371d9d-555a-42ee-9c46-052cd7a95df5 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:13.478503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c4baa-084b-4416-8a98-e8fbddab8b9d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:13.478503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c4baa-084b-4416-8a98-e8fbddab8b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:13.478503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c4baa-084b-4416-8a98-e8fbddab8b9d None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:13.483348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c4baa-084b-4416-8a98-e8fbddab8b9d None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:13.484800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c4baa-084b-4416-8a98-e8fbddab8b9d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:13.486648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 140/272] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:13 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:13.492293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c4baa-084b-4416-8a98-e8fbddab8b9d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:13.603032 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:13.644061 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7371d9d-555a-42ee-9c46-052cd7a95df5 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:13.666280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c4baa-084b-4416-8a98-e8fbddab8b9d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:13.694439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8263e-dd16-4a89-b2b4-823872da9435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:13.695238 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8263e-dd16-4a89-b2b4-823872da9435 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:13.695585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8263e-dd16-4a89-b2b4-823872da9435 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:13.696157 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8263e-dd16-4a89-b2b4-823872da9435 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:13.708953 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0c421-2bed-4828-bfbf-25af8b939529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:13.709607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0c421-2bed-4828-bfbf-25af8b939529 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:13.709887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0c421-2bed-4828-bfbf-25af8b939529 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:13.710308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8263e-dd16-4a89-b2b4-823872da9435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:13.710410 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0c421-2bed-4828-bfbf-25af8b939529 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:13.711290 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0c421-2bed-4828-bfbf-25af8b939529 None admin] RBAC: Adding query filter params (role.id=0e112f96840a483bb6dfeab1bb8af187, scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127, user.id=aae9321bb6ee4f5e906bcb26364640ae) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:13.711599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0c421-2bed-4828-bfbf-25af8b939529 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:13.713014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0c421-2bed-4828-bfbf-25af8b939529 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:13.716923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-3ab8263e-dd16-4a89-b2b4-823872da9435 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:13.716923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:13.716923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:13.716923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:13.716923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:13.716923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:13.716923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:13.716923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:13.716923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:13.716923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:13.716923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:13.716923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:13.716923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:13.716923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:13.716923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:13.716923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:13.718251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:13.718251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:13.718251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:13.718251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:13.718251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:13.718251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:13.718251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:13.718251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:13.718251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:13.718251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:13.718251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:13.718251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:13.718251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:13.718251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:13.718251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:13.718251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:13.719481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:13.719481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:13.719481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:13.719481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:13.719481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:13.719481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:13.719481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:13.719481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:13.719481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:13.719481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:13.719481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:13.719481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:13.720556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 133/273] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:19:13.722657 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8263e-dd16-4a89-b2b4-823872da9435 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:13.722897 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 141/274] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:13 2022] GET /identity/v3/role_assignments?user.id=aae9321bb6ee4f5e906bcb26364640ae&scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127&role.id=0e112f96840a483bb6dfeab1bb8af187 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:13.730527 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0c421-2bed-4828-bfbf-25af8b939529 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:13.843092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:13.847691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8263e-dd16-4a89-b2b4-823872da9435 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:13.883945 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:13.898883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527427ff-ffa9-41dc-8f2a-a89b0a9e810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:13.899531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527427ff-ffa9-41dc-8f2a-a89b0a9e810b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:13.899809 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527427ff-ffa9-41dc-8f2a-a89b0a9e810b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:13.900095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527427ff-ffa9-41dc-8f2a-a89b0a9e810b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:13.903465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527427ff-ffa9-41dc-8f2a-a89b0a9e810b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:13.904938 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527427ff-ffa9-41dc-8f2a-a89b0a9e810b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:13.906751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 134/275] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:13.911864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527427ff-ffa9-41dc-8f2a-a89b0a9e810b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:13.938322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0c421-2bed-4828-bfbf-25af8b939529 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:13.978977 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3563e34-4415-454b-8560-d3ee93db7653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:13.979581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3563e34-4415-454b-8560-d3ee93db7653 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:13.979961 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3563e34-4415-454b-8560-d3ee93db7653 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:13.980794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3563e34-4415-454b-8560-d3ee93db7653 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:13.981409 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3563e34-4415-454b-8560-d3ee93db7653 None admin] RBAC: Adding query filter params (name=member) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:13.981711 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3563e34-4415-454b-8560-d3ee93db7653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:13.983362 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3563e34-4415-454b-8560-d3ee93db7653 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:13.992486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 142/276] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:13.998947 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3563e34-4415-454b-8560-d3ee93db7653 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:14.020751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527427ff-ffa9-41dc-8f2a-a89b0a9e810b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:14.066297 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76856bda-004d-488b-b191-e4509ceb0d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:14.066945 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856bda-004d-488b-b191-e4509ceb0d43 None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:14.067222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856bda-004d-488b-b191-e4509ceb0d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:14.067494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856bda-004d-488b-b191-e4509ceb0d43 None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:14.068146 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76856bda-004d-488b-b191-e4509ceb0d43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:14.069601 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76856bda-004d-488b-b191-e4509ceb0d43 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:14.094473 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 135/277] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:19:13 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:19:14.100008 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a9b4e-ca79-43f4-b700-97e1cd42f760 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:14.100344 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a9b4e-ca79-43f4-b700-97e1cd42f760 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:14.100566 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a9b4e-ca79-43f4-b700-97e1cd42f760 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:14.101952 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 136/278] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:14.108849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913526c1-9ee5-4fbf-a712-6e043af0e0c2 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:14.109156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913526c1-9ee5-4fbf-a712-6e043af0e0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:14.111027 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913526c1-9ee5-4fbf-a712-6e043af0e0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:14.132048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3563e34-4415-454b-8560-d3ee93db7653 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:14.137642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-913526c1-9ee5-4fbf-a712-6e043af0e0c2 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:14.139277 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-913526c1-9ee5-4fbf-a712-6e043af0e0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:14.153167 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:14.180186 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b0748-a22b-4e20-84f4-589d89eeb062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:14.181591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b0748-a22b-4e20-84f4-589d89eeb062 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:14.182282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b0748-a22b-4e20-84f4-589d89eeb062 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:14.182730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b0748-a22b-4e20-84f4-589d89eeb062 None admin] PATH_INFO: `/v3/users/0d733c75431448e3b1cd439eb06a7606` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:14.204520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b0748-a22b-4e20-84f4-589d89eeb062 None admin] RBAC: Authorizing `identity:get_user(user_id=0d733c75431448e3b1cd439eb06a7606)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:14.207117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b0748-a22b-4e20-84f4-589d89eeb062 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:14.210433 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:14.211634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 143/279] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:13 2022] GET /identity/v3/users/0d733c75431448e3b1cd439eb06a7606 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:14.221717 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b0748-a22b-4e20-84f4-589d89eeb062 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:14.234439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 137/280] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:14.334727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b0748-a22b-4e20-84f4-589d89eeb062 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:14.372908 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcbbb8-1145-49e6-9acc-0c6aeef4e22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:14.373866 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcbbb8-1145-49e6-9acc-0c6aeef4e22f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:14.374362 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcbbb8-1145-49e6-9acc-0c6aeef4e22f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:14.374867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcbbb8-1145-49e6-9acc-0c6aeef4e22f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:14.375819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcbbb8-1145-49e6-9acc-0c6aeef4e22f None admin] RBAC: Adding query filter params (role.id=8b655a66d879422db1b56ca98d77e490, user.id=0d733c75431448e3b1cd439eb06a7606, scope.system=all) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:14.376344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcbbb8-1145-49e6-9acc-0c6aeef4e22f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:14.377985 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcbbb8-1145-49e6-9acc-0c6aeef4e22f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:14.383665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 144/281] 10.222.0.71 () {56 vars in 1308 bytes} [Thu Sep 1 16:19:14 2022] GET /identity/v3/role_assignments?user.id=0d733c75431448e3b1cd439eb06a7606&scope.system=all&role.id=8b655a66d879422db1b56ca98d77e490 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:14.514397 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913526c1-9ee5-4fbf-a712-6e043af0e0c2 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:14.633209 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913526c1-9ee5-4fbf-a712-6e043af0e0c2 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:14.672231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940f474-a35c-4f90-9dda-53e381bc4470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:14.672864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940f474-a35c-4f90-9dda-53e381bc4470 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:14.673142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940f474-a35c-4f90-9dda-53e381bc4470 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:14.673411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940f474-a35c-4f90-9dda-53e381bc4470 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:14.684920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940f474-a35c-4f90-9dda-53e381bc4470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:14.689985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-e940f474-a35c-4f90-9dda-53e381bc4470 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:14.689985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:14.689985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:14.689985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:14.689985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:14.689985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:14.689985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:14.689985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:14.689985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:14.689985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:14.689985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:14.689985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:14.689985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:14.689985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:14.689985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:14.689985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:14.690896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:14.690896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:14.690896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:14.690896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:14.690896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:14.690896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:14.690896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:14.690896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:14.690896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:14.690896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:14.690896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:14.690896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:14.690896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:14.690896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:14.690896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:14.690896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:14.691690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:14.691690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:14.691690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:14.691690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:14.691690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:14.691690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:14.691690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:14.691690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:14.691690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:14.691690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:14.691690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:14.691690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:14.691690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 138/282] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:14.697477 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcbbb8-1145-49e6-9acc-0c6aeef4e22f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:14.724148 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc303-af60-40ab-8907-2e3ff35edf3e None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:14.724434 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc303-af60-40ab-8907-2e3ff35edf3e None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:14.724709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc303-af60-40ab-8907-2e3ff35edf3e None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:14.726342 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 139/283] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:14.731551 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c07d9-ddfb-45d4-9798-2a78ae5e8bcc None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:14.731813 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c07d9-ddfb-45d4-9798-2a78ae5e8bcc None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:14.732088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c07d9-ddfb-45d4-9798-2a78ae5e8bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:14.735239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:14.751814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-364c07d9-ddfb-45d4-9798-2a78ae5e8bcc None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:14.752994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-364c07d9-ddfb-45d4-9798-2a78ae5e8bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:14.800475 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:14.807292 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcbbb8-1145-49e6-9acc-0c6aeef4e22f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:14.842726 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 140/284] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:14.871306 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3666d-ca21-4363-a259-29923fd7e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:14.872262 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3666d-ca21-4363-a259-29923fd7e1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:14.872737 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3666d-ca21-4363-a259-29923fd7e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:14.873231 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3666d-ca21-4363-a259-29923fd7e1b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:14.874094 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3666d-ca21-4363-a259-29923fd7e1b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:14.874590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3666d-ca21-4363-a259-29923fd7e1b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:14.876225 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3666d-ca21-4363-a259-29923fd7e1b4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:14.886949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 145/285] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:14.891588 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c07d9-ddfb-45d4-9798-2a78ae5e8bcc None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:15.000609 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c07d9-ddfb-45d4-9798-2a78ae5e8bcc None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:15.059465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0b98e-bc6b-40e2-be1d-42325946d9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:15.060144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0b98e-bc6b-40e2-be1d-42325946d9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:15.060429 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0b98e-bc6b-40e2-be1d-42325946d9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:15.060707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0b98e-bc6b-40e2-be1d-42325946d9f6 None admin] PATH_INFO: `/v3/users/adcced2f21084a09acc57985b3984ae2` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:15.061981 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0b98e-bc6b-40e2-be1d-42325946d9f6 None admin] RBAC: Authorizing `identity:get_user(user_id=adcced2f21084a09acc57985b3984ae2)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:15.063622 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0b98e-bc6b-40e2-be1d-42325946d9f6 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:15.065661 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 141/286] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:14 2022] GET /identity/v3/users/adcced2f21084a09acc57985b3984ae2 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:15.071029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3666d-ca21-4363-a259-29923fd7e1b4 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:15.240968 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:15.247177 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0b98e-bc6b-40e2-be1d-42325946d9f6 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:15.248347 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3666d-ca21-4363-a259-29923fd7e1b4 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:15.313661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dd292-a48a-419d-97ff-ee350a9b90b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:15.314262 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dd292-a48a-419d-97ff-ee350a9b90b3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:15.314598 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dd292-a48a-419d-97ff-ee350a9b90b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:15.314895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dd292-a48a-419d-97ff-ee350a9b90b3 None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:15.318501 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791dd292-a48a-419d-97ff-ee350a9b90b3 None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:15.318943 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:15.320100 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791dd292-a48a-419d-97ff-ee350a9b90b3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:15.324910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 146/287] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:15 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:15.331970 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dd292-a48a-419d-97ff-ee350a9b90b3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:15.451520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dd292-a48a-419d-97ff-ee350a9b90b3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:15.490490 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83266300-be6f-49d9-b430-f1aa3bb3cd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:15.491187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83266300-be6f-49d9-b430-f1aa3bb3cd99 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:15.491468 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83266300-be6f-49d9-b430-f1aa3bb3cd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:15.491743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83266300-be6f-49d9-b430-f1aa3bb3cd99 None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127/users/adcced2f21084a09acc57985b3984ae2/roles/dc7f92ba5a294b00afaa074d01532b7c` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:15.493420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0b98e-bc6b-40e2-be1d-42325946d9f6 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:15.493876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83266300-be6f-49d9-b430-f1aa3bb3cd99 None admin] RBAC: Authorizing `identity:create_grant(project_id=63e679fbf8c3498a8cc0860b3a0f5127, user_id=adcced2f21084a09acc57985b3984ae2, role_id=dc7f92ba5a294b00afaa074d01532b7c)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:15.496191 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83266300-be6f-49d9-b430-f1aa3bb3cd99 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:15.513383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 147/288] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:19:15 2022] PUT /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127/users/adcced2f21084a09acc57985b3984ae2/roles/dc7f92ba5a294b00afaa074d01532b7c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:15.548696 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ab3f5-1f8d-4a00-8c4a-3b484f6b15cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:15.549747 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ab3f5-1f8d-4a00-8c4a-3b484f6b15cf None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:15.550245 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ab3f5-1f8d-4a00-8c4a-3b484f6b15cf None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:15.550831 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ab3f5-1f8d-4a00-8c4a-3b484f6b15cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:15.567251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ab3f5-1f8d-4a00-8c4a-3b484f6b15cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:15.573842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-ac4ab3f5-1f8d-4a00-8c4a-3b484f6b15cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:15.573842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:15.573842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:15.573842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:15.573842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:15.573842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:15.573842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:15.573842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:15.573842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:15.573842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:15.573842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:15.573842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:15.573842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:15.573842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:15.573842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:15.573842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:15.574774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:15.574774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:15.574774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:15.574774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:15.574774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:15.574774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:15.574774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:15.574774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:15.574774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:15.574774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:15.574774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:15.574774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:15.574774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:15.574774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:15.574774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:15.574774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:15.575652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:15.575652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:15.575652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:15.575652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:15.575652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:15.575652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:15.575652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:15.575652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:15.575652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:15.575652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:15.575652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:15.575652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:15.578784 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 142/289] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:19:15.584997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83266300-be6f-49d9-b430-f1aa3bb3cd99 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:15.631076 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:15.725106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83266300-be6f-49d9-b430-f1aa3bb3cd99 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:15.765153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900edd7-d523-4c74-b566-c07eccccff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:15.765780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900edd7-d523-4c74-b566-c07eccccff48 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:15.766058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900edd7-d523-4c74-b566-c07eccccff48 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:15.766330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900edd7-d523-4c74-b566-c07eccccff48 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:15.767113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900edd7-d523-4c74-b566-c07eccccff48 None admin] RBAC: Adding query filter params (name=member) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:15.767420 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900edd7-d523-4c74-b566-c07eccccff48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:15.768826 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900edd7-d523-4c74-b566-c07eccccff48 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:15.779487 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 148/290] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:15.785197 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ab3f5-1f8d-4a00-8c4a-3b484f6b15cf None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:15.930657 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ab3f5-1f8d-4a00-8c4a-3b484f6b15cf None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:15.934707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:15.984724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d876b-8312-402e-b66a-c448eee23686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:15.985390 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d876b-8312-402e-b66a-c448eee23686 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:15.985659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d876b-8312-402e-b66a-c448eee23686 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:15.985977 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d876b-8312-402e-b66a-c448eee23686 None admin] PATH_INFO: `/v3/users/d7fdcb973bc548a39eb779d3046bdc17` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:15.987160 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d876b-8312-402e-b66a-c448eee23686 None admin] RBAC: Authorizing `identity:get_user(user_id=d7fdcb973bc548a39eb779d3046bdc17)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:15.988591 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d876b-8312-402e-b66a-c448eee23686 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:15.990463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 143/291] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:15 2022] GET /identity/v3/users/d7fdcb973bc548a39eb779d3046bdc17 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:15.996709 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900edd7-d523-4c74-b566-c07eccccff48 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:16.148455 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:16.169847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900edd7-d523-4c74-b566-c07eccccff48 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:16.219336 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246cd98-e5eb-4542-bb84-67e7e9ea3a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:16.219862 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246cd98-e5eb-4542-bb84-67e7e9ea3a15 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:16.220144 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246cd98-e5eb-4542-bb84-67e7e9ea3a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:16.220413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246cd98-e5eb-4542-bb84-67e7e9ea3a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:16.322080 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246cd98-e5eb-4542-bb84-67e7e9ea3a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:16.324594 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246cd98-e5eb-4542-bb84-67e7e9ea3a15 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:16.432602 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:16.447644 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 149/292] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:16.452818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d876b-8312-402e-b66a-c448eee23686 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:16.621962 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d876b-8312-402e-b66a-c448eee23686 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:16.660995 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bcf8d-59a6-40ba-8beb-fe1d5eb787cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:16.661623 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bcf8d-59a6-40ba-8beb-fe1d5eb787cd None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:16.662182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bcf8d-59a6-40ba-8beb-fe1d5eb787cd None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:16.662459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bcf8d-59a6-40ba-8beb-fe1d5eb787cd None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:16.663632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bcf8d-59a6-40ba-8beb-fe1d5eb787cd None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:16.665072 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bcf8d-59a6-40ba-8beb-fe1d5eb787cd None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:16.666708 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 144/293] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:16 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:16.673103 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246cd98-e5eb-4542-bb84-67e7e9ea3a15 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:16.700804 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413545b4-b867-4121-9c29-c8a8372f8029 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:16.701094 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413545b4-b867-4121-9c29-c8a8372f8029 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:16.701355 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413545b4-b867-4121-9c29-c8a8372f8029 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:16.703029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 145/294] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:19:16.708104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d59bde-0d43-4a86-8bb3-c1cce222ce83 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:16.708390 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d59bde-0d43-4a86-8bb3-c1cce222ce83 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:16.708668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d59bde-0d43-4a86-8bb3-c1cce222ce83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:16.728198 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-05d59bde-0d43-4a86-8bb3-c1cce222ce83 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:16.729558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-05d59bde-0d43-4a86-8bb3-c1cce222ce83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:16.775749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:16.812741 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246cd98-e5eb-4542-bb84-67e7e9ea3a15 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:16.813317 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 146/295] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:16.822888 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746aa05-d186-419e-83fc-6ed9e43268f6 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:16.823192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746aa05-d186-419e-83fc-6ed9e43268f6 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:16.823619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746aa05-d186-419e-83fc-6ed9e43268f6 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:16.825546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 147/296] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:16 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:16.831906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf26b5a-b134-457f-b1ec-0fff012833b4 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:16.832193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf26b5a-b134-457f-b1ec-0fff012833b4 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:16.832467 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf26b5a-b134-457f-b1ec-0fff012833b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:16.855662 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240f593-8307-49f8-b8c7-fe6ad2a3bdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:16.856270 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240f593-8307-49f8-b8c7-fe6ad2a3bdc5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:16.862646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240f593-8307-49f8-b8c7-fe6ad2a3bdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:16.862646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240f593-8307-49f8-b8c7-fe6ad2a3bdc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:16.862646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240f593-8307-49f8-b8c7-fe6ad2a3bdc5 None admin] RBAC: Adding query filter params (role.id=8b655a66d879422db1b56ca98d77e490, scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127, user.id=d7fdcb973bc548a39eb779d3046bdc17) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:16.862646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240f593-8307-49f8-b8c7-fe6ad2a3bdc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:16.862646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240f593-8307-49f8-b8c7-fe6ad2a3bdc5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:16.866717 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 150/297] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:16 2022] GET /identity/v3/role_assignments?user.id=d7fdcb973bc548a39eb779d3046bdc17&scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127&role.id=8b655a66d879422db1b56ca98d77e490 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:16.872432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-aaf26b5a-b134-457f-b1ec-0fff012833b4 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:16.873583 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-aaf26b5a-b134-457f-b1ec-0fff012833b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:16.896466 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca394179-b3a9-4b90-a92e-1404c73237be None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:16.896808 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca394179-b3a9-4b90-a92e-1404c73237be None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:16.897013 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca394179-b3a9-4b90-a92e-1404c73237be None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:16.898574 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 151/298] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:16.904792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15927f18-0331-4f61-8f93-f0725b1b995d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:16.905140 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15927f18-0331-4f61-8f93-f0725b1b995d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:16.905483 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15927f18-0331-4f61-8f93-f0725b1b995d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:16.927621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-15927f18-0331-4f61-8f93-f0725b1b995d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:16.931610 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-15927f18-0331-4f61-8f93-f0725b1b995d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:17.037408 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:17.046575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 148/299] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:17.065607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 152/300] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:17.139249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf26b5a-b134-457f-b1ec-0fff012833b4 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:17.248809 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:17.253470 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf26b5a-b134-457f-b1ec-0fff012833b4 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:17.293867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8cd7e-320c-4af9-ae0b-54d5683dd939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:17.294495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8cd7e-320c-4af9-ae0b-54d5683dd939 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:17.294808 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8cd7e-320c-4af9-ae0b-54d5683dd939 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:17.295084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8cd7e-320c-4af9-ae0b-54d5683dd939 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:17.307710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8cd7e-320c-4af9-ae0b-54d5683dd939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:17.312976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-9de8cd7e-320c-4af9-ae0b-54d5683dd939 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:17.312976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:17.312976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:17.312976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:17.312976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:17.312976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:17.312976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:17.312976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:17.312976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:17.312976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:17.312976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:17.312976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:17.312976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:17.312976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:17.312976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:17.312976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:17.313848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:17.313848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:17.313848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:17.313848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:17.313848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:17.313848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:17.313848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:17.313848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:17.313848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:17.313848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:17.313848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:17.313848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:17.313848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:17.313848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:17.313848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:17.313848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:17.314659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:17.314659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:17.314659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:17.314659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:17.314659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:17.314659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:17.314659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:17.314659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:17.314659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:17.314659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:17.314659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:17.314659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:17.314659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 149/301] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:17.319954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15927f18-0331-4f61-8f93-f0725b1b995d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:17.350499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8cd7e-320c-4af9-ae0b-54d5683dd939 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:17.440024 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15927f18-0331-4f61-8f93-f0725b1b995d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:17.473545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8cd7e-320c-4af9-ae0b-54d5683dd939 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:17.477372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2e66e-4607-4ec8-9f5a-95f180f8f9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:17.478219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2e66e-4607-4ec8-9f5a-95f180f8f9eb None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:17.478719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2e66e-4607-4ec8-9f5a-95f180f8f9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:17.479188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2e66e-4607-4ec8-9f5a-95f180f8f9eb None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:17.480571 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2e66e-4607-4ec8-9f5a-95f180f8f9eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:17.481080 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2e66e-4607-4ec8-9f5a-95f180f8f9eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:17.482662 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2e66e-4607-4ec8-9f5a-95f180f8f9eb None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:17.491305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 153/302] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:17.492231 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2e66e-4607-4ec8-9f5a-95f180f8f9eb None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:17.512992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0351c9c-883f-489d-a90c-2d4819aabbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:17.513711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0351c9c-883f-489d-a90c-2d4819aabbdf None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:17.514055 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0351c9c-883f-489d-a90c-2d4819aabbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:17.514330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0351c9c-883f-489d-a90c-2d4819aabbdf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:17.515860 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0351c9c-883f-489d-a90c-2d4819aabbdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:17.517290 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0351c9c-883f-489d-a90c-2d4819aabbdf None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:17.519041 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 150/303] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:17.524026 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0351c9c-883f-489d-a90c-2d4819aabbdf None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:17.539450 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:17.553084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:17.599900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2e66e-4607-4ec8-9f5a-95f180f8f9eb None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:17.633472 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0351c9c-883f-489d-a90c-2d4819aabbdf None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:17.641553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca440c24-9654-43d0-a137-fb8e5f2ee01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:17.642190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca440c24-9654-43d0-a137-fb8e5f2ee01e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:17.642470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca440c24-9654-43d0-a137-fb8e5f2ee01e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:17.642777 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca440c24-9654-43d0-a137-fb8e5f2ee01e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:17.654841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca440c24-9654-43d0-a137-fb8e5f2ee01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:17.660183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-ca440c24-9654-43d0-a137-fb8e5f2ee01e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:17.660183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:17.660183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:17.660183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:17.660183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:17.660183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:17.660183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:17.660183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:17.660183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:17.660183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:17.660183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:17.660183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:17.660183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:17.660183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:17.660183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:17.660183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:17.661083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:17.661083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:17.661083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:17.661083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:17.661083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:17.661083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:17.661083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:17.661083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:17.661083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:17.661083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:17.661083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:17.661083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:17.661083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:17.661083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:17.661083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:17.661083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:17.661956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:17.661956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:17.661956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:17.661956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:17.661956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:17.661956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:17.661956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:17.661956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:17.661956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:17.661956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:17.661956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:17.661956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:17.661956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 154/304] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:17.662598 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca440c24-9654-43d0-a137-fb8e5f2ee01e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:17.675735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765e2c3-6e0d-435f-9e62-266040837a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:17.676499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765e2c3-6e0d-435f-9e62-266040837a6f None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:17.676850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765e2c3-6e0d-435f-9e62-266040837a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:17.677195 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765e2c3-6e0d-435f-9e62-266040837a6f None admin] PATH_INFO: `/v3/users/1a79bd531b1d48dba878e00ad6b65937` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:17.690953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765e2c3-6e0d-435f-9e62-266040837a6f None admin] RBAC: Authorizing `identity:get_user(user_id=1a79bd531b1d48dba878e00ad6b65937)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:17.692330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765e2c3-6e0d-435f-9e62-266040837a6f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:17.694088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 151/305] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:17 2022] GET /identity/v3/users/1a79bd531b1d48dba878e00ad6b65937 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:17.695455 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765e2c3-6e0d-435f-9e62-266040837a6f None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:17.769427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca440c24-9654-43d0-a137-fb8e5f2ee01e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:17.771908 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:17.781935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:17.797711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765e2c3-6e0d-435f-9e62-266040837a6f None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:17.808211 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2e12b-4a30-43d3-8c16-3de3b5a449da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:17.808814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2e12b-4a30-43d3-8c16-3de3b5a449da None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:17.809099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2e12b-4a30-43d3-8c16-3de3b5a449da None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:17.809370 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2e12b-4a30-43d3-8c16-3de3b5a449da None admin] PATH_INFO: `/v3/groups` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:17.809989 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2e12b-4a30-43d3-8c16-3de3b5a449da None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:17.811558 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2e12b-4a30-43d3-8c16-3de3b5a449da None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:17.828483 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 155/306] 10.222.0.71 () {60 vars in 1134 bytes} [Thu Sep 1 16:19:17 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:19:17.829381 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2e12b-4a30-43d3-8c16-3de3b5a449da None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:17.841157 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bb0fc-8ed5-43b4-8c03-f55b6699ad25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:17.842701 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bb0fc-8ed5-43b4-8c03-f55b6699ad25 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:17.843229 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bb0fc-8ed5-43b4-8c03-f55b6699ad25 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:17.844573 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bb0fc-8ed5-43b4-8c03-f55b6699ad25 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:17.845524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bb0fc-8ed5-43b4-8c03-f55b6699ad25 None admin] RBAC: Adding query filter params (name=member) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:17.846114 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bb0fc-8ed5-43b4-8c03-f55b6699ad25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:17.848964 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bb0fc-8ed5-43b4-8c03-f55b6699ad25 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:17.862801 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 152/307] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:17.867685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bb0fc-8ed5-43b4-8c03-f55b6699ad25 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:17.978433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2e12b-4a30-43d3-8c16-3de3b5a449da None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:18.008302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bb0fc-8ed5-43b4-8c03-f55b6699ad25 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:18.017327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4517b-4ecb-427f-82fa-7d40b47b6914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:18.017933 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4517b-4ecb-427f-82fa-7d40b47b6914 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:18.018212 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4517b-4ecb-427f-82fa-7d40b47b6914 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:18.018481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4517b-4ecb-427f-82fa-7d40b47b6914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:18.019272 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4517b-4ecb-427f-82fa-7d40b47b6914 None admin] RBAC: Adding query filter params (role.id=dc7f92ba5a294b00afaa074d01532b7c, user.id=1a79bd531b1d48dba878e00ad6b65937, scope.system=all) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:18.019577 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4517b-4ecb-427f-82fa-7d40b47b6914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:18.021001 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4517b-4ecb-427f-82fa-7d40b47b6914 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:18.025936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 156/308] 10.222.0.71 () {56 vars in 1308 bytes} [Thu Sep 1 16:19:17 2022] GET /identity/v3/role_assignments?user.id=1a79bd531b1d48dba878e00ad6b65937&scope.system=all&role.id=dc7f92ba5a294b00afaa074d01532b7c => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:18.027712 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a24c8b-98fe-4e43-9286-c68e5810dc47 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:18.027992 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a24c8b-98fe-4e43-9286-c68e5810dc47 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:18.028263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a24c8b-98fe-4e43-9286-c68e5810dc47 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:18.029510 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 157/309] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:18.035216 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b8077-55bc-43a0-899f-0d6aa5cb7f5e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:18.035503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b8077-55bc-43a0-899f-0d6aa5cb7f5e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:18.035778 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b8077-55bc-43a0-899f-0d6aa5cb7f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:18.048881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30bce8-66ae-43aa-94da-4b433005bce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:18.049679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30bce8-66ae-43aa-94da-4b433005bce4 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:18.050059 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30bce8-66ae-43aa-94da-4b433005bce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:18.050426 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30bce8-66ae-43aa-94da-4b433005bce4 None admin] PATH_INFO: `/v3/users/0d733c75431448e3b1cd439eb06a7606` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:18.051764 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30bce8-66ae-43aa-94da-4b433005bce4 None admin] RBAC: Authorizing `identity:get_user(user_id=0d733c75431448e3b1cd439eb06a7606)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:18.054157 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30bce8-66ae-43aa-94da-4b433005bce4 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:18.056581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-823b8077-55bc-43a0-899f-0d6aa5cb7f5e None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:18.057659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 153/310] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:17 2022] GET /identity/v3/users/0d733c75431448e3b1cd439eb06a7606 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:18.058228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-823b8077-55bc-43a0-899f-0d6aa5cb7f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:18.063352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30bce8-66ae-43aa-94da-4b433005bce4 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:18.085247 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:18.093923 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:18.163787 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 158/311] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:18.195223 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30bce8-66ae-43aa-94da-4b433005bce4 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:18.232149 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6143bf-796d-411c-b225-9760d3455d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:18.232729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6143bf-796d-411c-b225-9760d3455d04 None admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:18.233012 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6143bf-796d-411c-b225-9760d3455d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:18.233286 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6143bf-796d-411c-b225-9760d3455d04 None admin] PATH_INFO: `/v3/system/users/0d733c75431448e3b1cd439eb06a7606/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:18.234850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6143bf-796d-411c-b225-9760d3455d04 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0d733c75431448e3b1cd439eb06a7606, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:18.236245 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6143bf-796d-411c-b225-9760d3455d04 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:18.245866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 154/312] 10.222.0.71 () {58 vars in 1334 bytes} [Thu Sep 1 16:19:18 2022] PUT /identity/v3/system/users/0d733c75431448e3b1cd439eb06a7606/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:19:18.452294 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b8077-55bc-43a0-899f-0d6aa5cb7f5e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:18.561382 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b8077-55bc-43a0-899f-0d6aa5cb7f5e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:18.598175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c8563-c96d-47ee-b56b-17ebc908c89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:18.598846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c8563-c96d-47ee-b56b-17ebc908c89c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:18.599126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c8563-c96d-47ee-b56b-17ebc908c89c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:18.599394 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c8563-c96d-47ee-b56b-17ebc908c89c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:18.610245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c8563-c96d-47ee-b56b-17ebc908c89c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:18.615727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-0e5c8563-c96d-47ee-b56b-17ebc908c89c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:18.615727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:18.615727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:18.615727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:18.615727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:18.615727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:18.615727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:18.615727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:18.615727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:18.615727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:18.615727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:18.615727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:18.615727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:18.615727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:18.615727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:18.615727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:18.616623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:18.616623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:18.616623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:18.616623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:18.616623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:18.616623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:18.616623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:18.616623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:18.616623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:18.616623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:18.616623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:18.616623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:18.616623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:18.616623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:18.616623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:18.616623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:18.617405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:18.617405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:18.617405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:18.617405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:18.617405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:18.617405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:18.617405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:18.617405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:18.617405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:18.617405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:18.617405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:18.617405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:18.617405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 159/313] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:18.625900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6143bf-796d-411c-b225-9760d3455d04 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:18.714454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:18.738812 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6143bf-796d-411c-b225-9760d3455d04 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:18.774473 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a88ac0-0a51-41c6-accb-6aaa40a747b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:18.775221 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a88ac0-0a51-41c6-accb-6aaa40a747b9 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:18.775505 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a88ac0-0a51-41c6-accb-6aaa40a747b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:18.775776 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a88ac0-0a51-41c6-accb-6aaa40a747b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:18.776443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a88ac0-0a51-41c6-accb-6aaa40a747b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:18.776776 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a88ac0-0a51-41c6-accb-6aaa40a747b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:18.778168 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a88ac0-0a51-41c6-accb-6aaa40a747b9 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:18.787163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 155/314] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:18.795925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c8563-c96d-47ee-b56b-17ebc908c89c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:18.816226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:18.904390 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c8563-c96d-47ee-b56b-17ebc908c89c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:18.942005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f208740-b2c9-4300-a3ae-3f4b44f2fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:18.943054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f208740-b2c9-4300-a3ae-3f4b44f2fb32 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:18.943535 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f208740-b2c9-4300-a3ae-3f4b44f2fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:18.944039 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f208740-b2c9-4300-a3ae-3f4b44f2fb32 None admin] PATH_INFO: `/v3/users/adcced2f21084a09acc57985b3984ae2` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:18.945395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f208740-b2c9-4300-a3ae-3f4b44f2fb32 None admin] RBAC: Authorizing `identity:get_user(user_id=adcced2f21084a09acc57985b3984ae2)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:18.947069 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f208740-b2c9-4300-a3ae-3f4b44f2fb32 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:18.948871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 160/315] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:18 2022] GET /identity/v3/users/adcced2f21084a09acc57985b3984ae2 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:18.954894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a88ac0-0a51-41c6-accb-6aaa40a747b9 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:19.063959 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a88ac0-0a51-41c6-accb-6aaa40a747b9 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:19.099923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98f9e4-9ddf-4ac7-aa9f-a5142af1b4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:19.100445 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98f9e4-9ddf-4ac7-aa9f-a5142af1b4ae None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:19.100725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98f9e4-9ddf-4ac7-aa9f-a5142af1b4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:19.100998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98f9e4-9ddf-4ac7-aa9f-a5142af1b4ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:19.113699 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:19.174717 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98f9e4-9ddf-4ac7-aa9f-a5142af1b4ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:19.176341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98f9e4-9ddf-4ac7-aa9f-a5142af1b4ae None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:19.285080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 156/316] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:19.291717 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f208740-b2c9-4300-a3ae-3f4b44f2fb32 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:19.381073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:19.397684 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f208740-b2c9-4300-a3ae-3f4b44f2fb32 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:19.432728 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067c333-6a80-4bbf-b075-30595fdc7b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:19.434022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067c333-6a80-4bbf-b075-30595fdc7b48 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:19.434298 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067c333-6a80-4bbf-b075-30595fdc7b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:19.434567 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067c333-6a80-4bbf-b075-30595fdc7b48 None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:19.435796 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067c333-6a80-4bbf-b075-30595fdc7b48 None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:19.437302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067c333-6a80-4bbf-b075-30595fdc7b48 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:19.439255 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 161/317] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:19 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:19.445375 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98f9e4-9ddf-4ac7-aa9f-a5142af1b4ae None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:19.493792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:19.552729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98f9e4-9ddf-4ac7-aa9f-a5142af1b4ae None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:19.587818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62057740-e9c2-443a-969b-af527ea98051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:19.588427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62057740-e9c2-443a-969b-af527ea98051 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:19.588704 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62057740-e9c2-443a-969b-af527ea98051 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:19.588975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62057740-e9c2-443a-969b-af527ea98051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:19.589758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62057740-e9c2-443a-969b-af527ea98051 None admin] RBAC: Adding query filter params (role.id=dc7f92ba5a294b00afaa074d01532b7c, scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127, user.id=adcced2f21084a09acc57985b3984ae2) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:19.590066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62057740-e9c2-443a-969b-af527ea98051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:19.591531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62057740-e9c2-443a-969b-af527ea98051 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:19.598083 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 157/318] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:19 2022] GET /identity/v3/role_assignments?user.id=adcced2f21084a09acc57985b3984ae2&scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127&role.id=dc7f92ba5a294b00afaa074d01532b7c => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:19.853673 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0459c-1e4c-4421-8730-980c793eef71 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:19.854181 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0459c-1e4c-4421-8730-980c793eef71 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:19.854181 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0459c-1e4c-4421-8730-980c793eef71 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:19.856249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 162/319] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:19.861301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabaad2-84d9-4122-8def-7df21bd8f473 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:19.861711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabaad2-84d9-4122-8def-7df21bd8f473 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:19.861898 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabaad2-84d9-4122-8def-7df21bd8f473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:19.879688 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-adabaad2-84d9-4122-8def-7df21bd8f473 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:19.880863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-adabaad2-84d9-4122-8def-7df21bd8f473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:19.948281 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 158/320] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:20.013849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4bda1-9108-4476-b36d-fbf5f737b417 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:20.014155 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4bda1-9108-4476-b36d-fbf5f737b417 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:20.014412 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4bda1-9108-4476-b36d-fbf5f737b417 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:20.015925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 163/321] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:20.020976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c40104-1646-4be1-808d-6bd47c135fa7 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:20.021268 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c40104-1646-4be1-808d-6bd47c135fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:20.021542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c40104-1646-4be1-808d-6bd47c135fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:20.039826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-54c40104-1646-4be1-808d-6bd47c135fa7 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:20.041002 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-54c40104-1646-4be1-808d-6bd47c135fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:20.070336 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:20.110210 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 159/322] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:20.216730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4bda1-9108-4476-b36d-fbf5f737b417 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:20.302328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd2866-a76d-41dd-a566-57ee17a238d1 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:20.302639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd2866-a76d-41dd-a566-57ee17a238d1 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:20.302913 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd2866-a76d-41dd-a566-57ee17a238d1 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:20.304379 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 160/323] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:19:20.309178 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b91ac2-555f-4b50-ba77-437a9aba5109 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:20.309465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b91ac2-555f-4b50-ba77-437a9aba5109 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:20.309741 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b91ac2-555f-4b50-ba77-437a9aba5109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:20.318345 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4bda1-9108-4476-b36d-fbf5f737b417 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:20.327936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-a9b91ac2-555f-4b50-ba77-437a9aba5109 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:20.329109 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a9b91ac2-555f-4b50-ba77-437a9aba5109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:20.352084 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60069e-8cb5-43fa-856b-cf79af73d34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:20.352703 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60069e-8cb5-43fa-856b-cf79af73d34f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:20.352972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60069e-8cb5-43fa-856b-cf79af73d34f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:20.353236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60069e-8cb5-43fa-856b-cf79af73d34f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:20.354317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60069e-8cb5-43fa-856b-cf79af73d34f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:20.356309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60069e-8cb5-43fa-856b-cf79af73d34f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:20.358014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 164/324] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:20.363360 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60069e-8cb5-43fa-856b-cf79af73d34f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:20.388056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:20.399575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 161/325] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:20.400415 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b91ac2-555f-4b50-ba77-437a9aba5109 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:20.464843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60069e-8cb5-43fa-856b-cf79af73d34f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:20.498908 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:20.506051 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b91ac2-555f-4b50-ba77-437a9aba5109 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:20.507290 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f5e55-b594-4a2b-a54b-6e32292f2f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:20.507914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f5e55-b594-4a2b-a54b-6e32292f2f04 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:20.508192 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f5e55-b594-4a2b-a54b-6e32292f2f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:20.508465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f5e55-b594-4a2b-a54b-6e32292f2f04 None admin] PATH_INFO: `/v3/groups` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:20.509096 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f5e55-b594-4a2b-a54b-6e32292f2f04 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:20.510512 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f5e55-b594-4a2b-a54b-6e32292f2f04 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:20.528806 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 165/326] 10.222.0.71 () {60 vars in 1134 bytes} [Thu Sep 1 16:19:20 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:19:20.551316 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00099896-f786-442f-9500-2ae938737029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:20.551968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00099896-f786-442f-9500-2ae938737029 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:20.552268 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00099896-f786-442f-9500-2ae938737029 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:20.552545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00099896-f786-442f-9500-2ae938737029 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:20.565267 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00099896-f786-442f-9500-2ae938737029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:20.570252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-00099896-f786-442f-9500-2ae938737029 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:20.570252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:20.570252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:20.570252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:20.570252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:20.570252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:20.570252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:20.570252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:20.570252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:20.570252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:20.570252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:20.570252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:20.570252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:20.570252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:20.570252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:20.570252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:20.571235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:20.571235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:20.571235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:20.571235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:20.571235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:20.571235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:20.571235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:20.571235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:20.571235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:20.571235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:20.571235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:20.571235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:20.571235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:20.571235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:20.571235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:20.571235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:20.575570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:20.575570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:20.575570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:20.575570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:20.575570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:20.575570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:20.575570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:20.575570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:20.575570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:20.575570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:20.575570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:20.575570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:20.575570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 162/327] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:20.578111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f5e55-b594-4a2b-a54b-6e32292f2f04 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:20.672302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00099896-f786-442f-9500-2ae938737029 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:20.674791 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:20.698046 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f5e55-b594-4a2b-a54b-6e32292f2f04 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:20.737790 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed89ab4-329c-47ce-8958-583b9b0a5233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:20.738411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed89ab4-329c-47ce-8958-583b9b0a5233 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:20.739133 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed89ab4-329c-47ce-8958-583b9b0a5233 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:20.739133 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed89ab4-329c-47ce-8958-583b9b0a5233 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:20.739743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed89ab4-329c-47ce-8958-583b9b0a5233 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:20.740049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed89ab4-329c-47ce-8958-583b9b0a5233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:20.741420 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed89ab4-329c-47ce-8958-583b9b0a5233 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:20.750742 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 166/328] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:20.756592 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed89ab4-329c-47ce-8958-583b9b0a5233 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:20.801616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00099896-f786-442f-9500-2ae938737029 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:20.850455 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036e472-5ab6-486d-96fd-7a95470c976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:20.851356 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036e472-5ab6-486d-96fd-7a95470c976d None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:20.852130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036e472-5ab6-486d-96fd-7a95470c976d None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:20.852400 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036e472-5ab6-486d-96fd-7a95470c976d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:20.865410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036e472-5ab6-486d-96fd-7a95470c976d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:20.873576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-b036e472-5ab6-486d-96fd-7a95470c976d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:20.873576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:20.873576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:20.873576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:20.873576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:20.873576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:20.873576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:20.873576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:20.873576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:20.873576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:20.873576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:20.873576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:20.873576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:20.873576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:20.873576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:20.873576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:20.874490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:20.874490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:20.874490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:20.874490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:20.874490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:20.874490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:20.874490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:20.874490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:20.874490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:20.874490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:20.874490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:20.874490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:20.874490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:20.874490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:20.874490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:20.874490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:20.875369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:20.875369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:20.875369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:20.875369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:20.875369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:20.875369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:20.875369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:20.875369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:20.875369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:20.875369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:20.875369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:20.875369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:20.877531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 163/329] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:19:20.882711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036e472-5ab6-486d-96fd-7a95470c976d None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:20.885461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed89ab4-329c-47ce-8958-583b9b0a5233 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:20.904584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:20.936302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae058d-12f3-4a7f-b1d0-f5eea40a577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:20.937284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae058d-12f3-4a7f-b1d0-f5eea40a577a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:20.937754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae058d-12f3-4a7f-b1d0-f5eea40a577a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:20.938239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae058d-12f3-4a7f-b1d0-f5eea40a577a None admin] PATH_INFO: `/v3/users/1a79bd531b1d48dba878e00ad6b65937` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:20.939678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae058d-12f3-4a7f-b1d0-f5eea40a577a None admin] RBAC: Authorizing `identity:get_user(user_id=1a79bd531b1d48dba878e00ad6b65937)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:20.941134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae058d-12f3-4a7f-b1d0-f5eea40a577a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:20.944013 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 167/330] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:20 2022] GET /identity/v3/users/1a79bd531b1d48dba878e00ad6b65937 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:20.952265 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae058d-12f3-4a7f-b1d0-f5eea40a577a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:20.970569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:21.013430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036e472-5ab6-486d-96fd-7a95470c976d None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:21.057954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd7571-4e71-4797-889a-b0d65015e2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:21.059022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd7571-4e71-4797-889a-b0d65015e2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:21.059301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd7571-4e71-4797-889a-b0d65015e2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:21.059570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd7571-4e71-4797-889a-b0d65015e2a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:21.060281 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd7571-4e71-4797-889a-b0d65015e2a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:21.060584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd7571-4e71-4797-889a-b0d65015e2a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:21.062480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd7571-4e71-4797-889a-b0d65015e2a4 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:21.074882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 164/331] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:21.075765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae058d-12f3-4a7f-b1d0-f5eea40a577a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:21.081401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd7571-4e71-4797-889a-b0d65015e2a4 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:21.123917 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f397a-362b-4a02-88ee-eddb1dab5943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:21.124742 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f397a-362b-4a02-88ee-eddb1dab5943 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:21.125019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f397a-362b-4a02-88ee-eddb1dab5943 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:21.125665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f397a-362b-4a02-88ee-eddb1dab5943 None admin] PATH_INFO: `/v3/system/users/1a79bd531b1d48dba878e00ad6b65937/roles/dc7f92ba5a294b00afaa074d01532b7c` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:21.127411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f397a-362b-4a02-88ee-eddb1dab5943 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1a79bd531b1d48dba878e00ad6b65937, role_id=dc7f92ba5a294b00afaa074d01532b7c)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:21.128965 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f397a-362b-4a02-88ee-eddb1dab5943 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:21.140723 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 168/332] 10.222.0.71 () {58 vars in 1334 bytes} [Thu Sep 1 16:19:20 2022] PUT /identity/v3/system/users/1a79bd531b1d48dba878e00ad6b65937/roles/dc7f92ba5a294b00afaa074d01532b7c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:21.187280 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:21.216192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd7571-4e71-4797-889a-b0d65015e2a4 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:21.253803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756a665-511f-4a87-a66e-232dc07886ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:21.254452 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756a665-511f-4a87-a66e-232dc07886ac None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:21.254794 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756a665-511f-4a87-a66e-232dc07886ac None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:21.255066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756a665-511f-4a87-a66e-232dc07886ac None admin] PATH_INFO: `/v3/users/0d733c75431448e3b1cd439eb06a7606` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:21.256379 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756a665-511f-4a87-a66e-232dc07886ac None admin] RBAC: Authorizing `identity:get_user(user_id=0d733c75431448e3b1cd439eb06a7606)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:21.257843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756a665-511f-4a87-a66e-232dc07886ac None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:21.259525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 165/333] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:21 2022] GET /identity/v3/users/0d733c75431448e3b1cd439eb06a7606 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:21.267777 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f397a-362b-4a02-88ee-eddb1dab5943 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:21.362874 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:21.388143 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f397a-362b-4a02-88ee-eddb1dab5943 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:21.422819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47bded-0648-45a8-b8ec-3e4c97d4d93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:21.423422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47bded-0648-45a8-b8ec-3e4c97d4d93d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:21.423700 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47bded-0648-45a8-b8ec-3e4c97d4d93d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:21.423973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47bded-0648-45a8-b8ec-3e4c97d4d93d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:21.424727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47bded-0648-45a8-b8ec-3e4c97d4d93d None admin] RBAC: Adding query filter params (role.id=8b655a66d879422db1b56ca98d77e490, user.id=0d733c75431448e3b1cd439eb06a7606, scope.system=all) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:21.425005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47bded-0648-45a8-b8ec-3e4c97d4d93d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:21.426444 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47bded-0648-45a8-b8ec-3e4c97d4d93d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:21.439883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 169/334] 10.222.0.71 () {56 vars in 1308 bytes} [Thu Sep 1 16:19:21 2022] GET /identity/v3/role_assignments?user.id=0d733c75431448e3b1cd439eb06a7606&scope.system=all&role.id=8b655a66d879422db1b56ca98d77e490 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:22.876420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b1d6e-cbe3-4ccf-b89c-dd5efb4ed526 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:22.876891 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b1d6e-cbe3-4ccf-b89c-dd5efb4ed526 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:22.876891 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b1d6e-cbe3-4ccf-b89c-dd5efb4ed526 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:22.878326 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 166/335] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:22.883572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73bf2-37b0-44d1-892a-337e21bb70be None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:22.884349 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73bf2-37b0-44d1-892a-337e21bb70be None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:22.884833 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73bf2-37b0-44d1-892a-337e21bb70be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:22.911682 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d5d73bf2-37b0-44d1-892a-337e21bb70be None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:22.913198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d5d73bf2-37b0-44d1-892a-337e21bb70be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:22.996883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 170/336] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:23.096859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03622400-8e0b-4194-bfb3-ba81df5732e6 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:23.097490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03622400-8e0b-4194-bfb3-ba81df5732e6 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:23.097953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03622400-8e0b-4194-bfb3-ba81df5732e6 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:23.099780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 167/337] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:23.104860 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46fff-b2b0-457b-8dcc-7a4b8ab6e486 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:23.105385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46fff-b2b0-457b-8dcc-7a4b8ab6e486 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:23.105881 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46fff-b2b0-457b-8dcc-7a4b8ab6e486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:23.127729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-dff46fff-b2b0-457b-8dcc-7a4b8ab6e486 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:23.129205 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-dff46fff-b2b0-457b-8dcc-7a4b8ab6e486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:23.203844 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:23.217141 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 171/338] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:23.560144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03622400-8e0b-4194-bfb3-ba81df5732e6 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:23.622118 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b1ec2-81b2-45bd-9f41-f77e30b54570 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:23.622451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b1ec2-81b2-45bd-9f41-f77e30b54570 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:23.622692 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b1ec2-81b2-45bd-9f41-f77e30b54570 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:23.624719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 172/339] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:23.639383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cb64c-f14c-4643-9662-89ea6f18f050 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:23.639659 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cb64c-f14c-4643-9662-89ea6f18f050 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:23.639927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cb64c-f14c-4643-9662-89ea6f18f050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:23.664576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d74cb64c-f14c-4643-9662-89ea6f18f050 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:23.665781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d74cb64c-f14c-4643-9662-89ea6f18f050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:23.737856 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03622400-8e0b-4194-bfb3-ba81df5732e6 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:23.787919 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 173/340] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:23.788823 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cb64c-f14c-4643-9662-89ea6f18f050 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:23.802981 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe23c4-ca83-4bd0-89a4-6869587cb59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:23.803915 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe23c4-ca83-4bd0-89a4-6869587cb59b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:23.804431 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe23c4-ca83-4bd0-89a4-6869587cb59b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:23.804941 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe23c4-ca83-4bd0-89a4-6869587cb59b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:23.829801 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe23c4-ca83-4bd0-89a4-6869587cb59b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:23.841787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-1bfe23c4-ca83-4bd0-89a4-6869587cb59b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:23.841787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:23.841787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:23.841787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:23.841787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:23.841787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:23.841787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:23.841787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:23.841787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:23.841787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:23.841787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:23.841787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:23.841787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:23.841787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:23.841787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:23.841787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:23.843022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:23.843022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:23.843022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:23.843022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:23.843022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:23.843022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:23.843022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:23.843022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:23.843022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:23.843022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:23.843022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:23.843022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:23.843022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:23.843022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:23.843022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:23.843022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:23.843864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:23.843864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:23.843864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:23.843864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:23.843864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:23.843864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:23.843864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:23.843864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:23.843864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:23.843864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:23.843864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:23.843864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:23.846546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 168/341] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:23.856066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe23c4-ca83-4bd0-89a4-6869587cb59b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:23.869146 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:23.963837 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cb64c-f14c-4643-9662-89ea6f18f050 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:23.999928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:24.014532 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7625d09-4d63-42c5-9494-6fc589eb1b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:24.015209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7625d09-4d63-42c5-9494-6fc589eb1b8f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.015481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7625d09-4d63-42c5-9494-6fc589eb1b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.015746 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7625d09-4d63-42c5-9494-6fc589eb1b8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.033007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7625d09-4d63-42c5-9494-6fc589eb1b8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:24.043584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-c7625d09-4d63-42c5-9494-6fc589eb1b8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:24.043584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:24.043584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:24.043584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:24.043584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:24.043584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:24.043584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:24.043584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:24.043584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:24.043584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:24.043584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:24.043584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:24.043584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:24.043584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:24.043584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:24.043584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:24.044467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:24.044467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:24.044467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:24.044467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:24.044467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:24.044467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:24.044467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:24.044467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:24.044467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:24.044467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:24.044467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:24.044467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:24.044467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:24.044467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:24.044467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:24.044467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:24.045254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:24.045254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:24.045254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:24.045254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:24.045254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:24.045254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:24.045254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:24.045254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:24.045254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:24.045254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:24.045254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:24.045254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:24.045254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 174/342] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:24.053826 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7625d09-4d63-42c5-9494-6fc589eb1b8f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:24.092224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe23c4-ca83-4bd0-89a4-6869587cb59b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:24.168490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b779f-34d6-4d0f-b1ca-e274a0dd696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:24.169470 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b779f-34d6-4d0f-b1ca-e274a0dd696f None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.170038 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b779f-34d6-4d0f-b1ca-e274a0dd696f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.170499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b779f-34d6-4d0f-b1ca-e274a0dd696f None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.171378 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b779f-34d6-4d0f-b1ca-e274a0dd696f None admin] RBAC: Adding query filter params (name=member) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:24.171869 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b779f-34d6-4d0f-b1ca-e274a0dd696f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:24.173635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b779f-34d6-4d0f-b1ca-e274a0dd696f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:24.182507 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7625d09-4d63-42c5-9494-6fc589eb1b8f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:24.189981 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 169/343] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:24.191200 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b779f-34d6-4d0f-b1ca-e274a0dd696f None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:24.225038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3161e-0251-4086-a50d-8d4ffe01a2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:24.225642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3161e-0251-4086-a50d-8d4ffe01a2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.225922 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3161e-0251-4086-a50d-8d4ffe01a2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.226191 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3161e-0251-4086-a50d-8d4ffe01a2f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.226883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3161e-0251-4086-a50d-8d4ffe01a2f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:24.227183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3161e-0251-4086-a50d-8d4ffe01a2f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:24.228558 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3161e-0251-4086-a50d-8d4ffe01a2f8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:24.242316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 175/344] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:24.242316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e4d2d-fc76-4193-aa65-502968b9d129 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.242316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e4d2d-fc76-4193-aa65-502968b9d129 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.242316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e4d2d-fc76-4193-aa65-502968b9d129 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.242316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 176/345] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:24.242316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e4d2d-fc76-4193-aa65-502968b9d129 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:24.283057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:24.302243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:24.328395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b779f-34d6-4d0f-b1ca-e274a0dd696f None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:24.361457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e4d2d-fc76-4193-aa65-502968b9d129 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:24.366283 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a27e2-771b-486d-91bd-d9af27e69273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:24.367192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a27e2-771b-486d-91bd-d9af27e69273 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.367663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a27e2-771b-486d-91bd-d9af27e69273 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.368121 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a27e2-771b-486d-91bd-d9af27e69273 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.380585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a27e2-771b-486d-91bd-d9af27e69273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:24.387358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-df6a27e2-771b-486d-91bd-d9af27e69273 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:24.387358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:24.387358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:24.387358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:24.387358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:24.387358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:24.387358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:24.387358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:24.387358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:24.387358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:24.387358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:24.387358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:24.387358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:24.387358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:24.387358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:24.387358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:24.388303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:24.388303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:24.388303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:24.388303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:24.388303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:24.388303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:24.388303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:24.388303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:24.388303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:24.388303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:24.388303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:24.388303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:24.388303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:24.388303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:24.388303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:24.388303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:24.389257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:24.389257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:24.389257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:24.389257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:24.389257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:24.389257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:24.389257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:24.389257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:24.389257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:24.389257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:24.389257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:24.389257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:24.391951 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 170/346] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:24.393036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a27e2-771b-486d-91bd-d9af27e69273 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:24.405376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22b91e-7533-4550-968b-ffd3fb275bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:24.405986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22b91e-7533-4550-968b-ffd3fb275bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.406267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22b91e-7533-4550-968b-ffd3fb275bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.406540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22b91e-7533-4550-968b-ffd3fb275bd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.477438 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22b91e-7533-4550-968b-ffd3fb275bd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:24.478916 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22b91e-7533-4550-968b-ffd3fb275bd5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:24.508561 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a27e2-771b-486d-91bd-d9af27e69273 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:24.525313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:24.540222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:24.550980 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131fa6e-c702-4e59-996c-9713d7c876f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:24.551941 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131fa6e-c702-4e59-996c-9713d7c876f5 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.552526 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131fa6e-c702-4e59-996c-9713d7c876f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.553198 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131fa6e-c702-4e59-996c-9713d7c876f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.582785 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 177/347] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:24.584821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807701a5-c890-4a78-9a83-5db8afb66b66 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.585102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807701a5-c890-4a78-9a83-5db8afb66b66 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.585374 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807701a5-c890-4a78-9a83-5db8afb66b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.604206 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-807701a5-c890-4a78-9a83-5db8afb66b66 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:24.606435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-807701a5-c890-4a78-9a83-5db8afb66b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:24.634787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131fa6e-c702-4e59-996c-9713d7c876f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:24.637561 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131fa6e-c702-4e59-996c-9713d7c876f5 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:24.685635 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 178/348] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:24.685635 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807701a5-c890-4a78-9a83-5db8afb66b66 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:24.763948 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:24.779272 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 171/349] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:24.780711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131fa6e-c702-4e59-996c-9713d7c876f5 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:24.798928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807701a5-c890-4a78-9a83-5db8afb66b66 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:24.819346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:24.835589 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4696e-aa0f-4df4-9541-b482583d571d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:24.836205 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4696e-aa0f-4df4-9541-b482583d571d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.836482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4696e-aa0f-4df4-9541-b482583d571d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.836752 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4696e-aa0f-4df4-9541-b482583d571d None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.837531 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4696e-aa0f-4df4-9541-b482583d571d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:24.837836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4696e-aa0f-4df4-9541-b482583d571d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:24.841025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4696e-aa0f-4df4-9541-b482583d571d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:24.849048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 179/350] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:24.857713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b53146-9647-467c-8597-310d37c432b4 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.857713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b53146-9647-467c-8597-310d37c432b4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.857713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b53146-9647-467c-8597-310d37c432b4 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.857713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 180/351] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:24.857713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b53146-9647-467c-8597-310d37c432b4 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:24.912863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131fa6e-c702-4e59-996c-9713d7c876f5 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:24.953251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e9628-e70e-4ea5-8608-b02b52f6417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:24.954238 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e9628-e70e-4ea5-8608-b02b52f6417e None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.954776 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e9628-e70e-4ea5-8608-b02b52f6417e None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.955384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e9628-e70e-4ea5-8608-b02b52f6417e None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.956802 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e9628-e70e-4ea5-8608-b02b52f6417e None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:24.958570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e9628-e70e-4ea5-8608-b02b52f6417e None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:24.960492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 172/352] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:24 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:24.961632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e9628-e70e-4ea5-8608-b02b52f6417e None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:24.966361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b53146-9647-467c-8597-310d37c432b4 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:25.003011 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af1562-ea27-48a3-b7a1-e847a022412e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:25.003637 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af1562-ea27-48a3-b7a1-e847a022412e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.003915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af1562-ea27-48a3-b7a1-e847a022412e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.004247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af1562-ea27-48a3-b7a1-e847a022412e None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.005438 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af1562-ea27-48a3-b7a1-e847a022412e None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:25.006927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af1562-ea27-48a3-b7a1-e847a022412e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:25.013165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 181/353] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:24 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:25.014711 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a27ade-c372-475d-bc59-becf002a52c6 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.014890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a27ade-c372-475d-bc59-becf002a52c6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.015161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a27ade-c372-475d-bc59-becf002a52c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.028558 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:25.034422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-c9a27ade-c372-475d-bc59-becf002a52c6 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:25.035638 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c9a27ade-c372-475d-bc59-becf002a52c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:25.073758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:25.080549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e9628-e70e-4ea5-8608-b02b52f6417e None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:25.113215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 182/354] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:25.114137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a27ade-c372-475d-bc59-becf002a52c6 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:25.117819 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449c29d-7e4c-4ce2-b4b1-c7d7c17ddc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:25.119034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449c29d-7e4c-4ce2-b4b1-c7d7c17ddc45 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.119546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449c29d-7e4c-4ce2-b4b1-c7d7c17ddc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.119820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449c29d-7e4c-4ce2-b4b1-c7d7c17ddc45 None admin] PATH_INFO: `/v3/users/1a79bd531b1d48dba878e00ad6b65937` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.121028 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449c29d-7e4c-4ce2-b4b1-c7d7c17ddc45 None admin] RBAC: Authorizing `identity:get_user(user_id=1a79bd531b1d48dba878e00ad6b65937)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:25.122558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449c29d-7e4c-4ce2-b4b1-c7d7c17ddc45 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:25.128924 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 173/355] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:24 2022] GET /identity/v3/users/1a79bd531b1d48dba878e00ad6b65937 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:25.128924 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449c29d-7e4c-4ce2-b4b1-c7d7c17ddc45 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:25.237665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a27ade-c372-475d-bc59-becf002a52c6 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:25.238587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449c29d-7e4c-4ce2-b4b1-c7d7c17ddc45 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:25.277735 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8149e-8bc6-4985-abee-25660a198591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:25.278369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8149e-8bc6-4985-abee-25660a198591 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.278728 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8149e-8bc6-4985-abee-25660a198591 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.279002 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8149e-8bc6-4985-abee-25660a198591 None admin] PATH_INFO: `/v3/groups/53bbfea5cdaf4a388b206eb67798667a` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.283300 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:25.286240 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8149e-8bc6-4985-abee-25660a198591 None admin] RBAC: Authorizing `identity:get_group(group_id=53bbfea5cdaf4a388b206eb67798667a)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:25.287051 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840c059-8378-4e3e-b0a6-6ae810ea9116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:25.287682 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840c059-8378-4e3e-b0a6-6ae810ea9116 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.287963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840c059-8378-4e3e-b0a6-6ae810ea9116 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.288169 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8149e-8bc6-4985-abee-25660a198591 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:25.288283 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840c059-8378-4e3e-b0a6-6ae810ea9116 None admin] PATH_INFO: `/v3/groups/53bbfea5cdaf4a388b206eb67798667a` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.289334 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840c059-8378-4e3e-b0a6-6ae810ea9116 None admin] RBAC: Authorizing `identity:get_group(group_id=53bbfea5cdaf4a388b206eb67798667a)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:25.290402 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 183/356] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:25 2022] GET /identity/v3/groups/53bbfea5cdaf4a388b206eb67798667a => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:25.293130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840c059-8378-4e3e-b0a6-6ae810ea9116 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:25.293244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8149e-8bc6-4985-abee-25660a198591 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:25.293318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 174/357] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:25 2022] GET /identity/v3/groups/53bbfea5cdaf4a388b206eb67798667a => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:25.294010 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840c059-8378-4e3e-b0a6-6ae810ea9116 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:25.337771 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:25.427107 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8149e-8bc6-4985-abee-25660a198591 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:25.437508 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840c059-8378-4e3e-b0a6-6ae810ea9116 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:25.466526 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79720ef2-5d60-42ed-a1bb-9c00053b5eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:25.467188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79720ef2-5d60-42ed-a1bb-9c00053b5eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.469603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79720ef2-5d60-42ed-a1bb-9c00053b5eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.469603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79720ef2-5d60-42ed-a1bb-9c00053b5eb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.475706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af3e71-01e4-4f60-9082-a1bfccdea18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:25.476306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af3e71-01e4-4f60-9082-a1bfccdea18d None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.476578 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af3e71-01e4-4f60-9082-a1bfccdea18d None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.476848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af3e71-01e4-4f60-9082-a1bfccdea18d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.477603 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af3e71-01e4-4f60-9082-a1bfccdea18d None admin] RBAC: Adding query filter params (role.id=dc7f92ba5a294b00afaa074d01532b7c, user.id=1a79bd531b1d48dba878e00ad6b65937, scope.system=all) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:25.477864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af3e71-01e4-4f60-9082-a1bfccdea18d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:25.479077 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79720ef2-5d60-42ed-a1bb-9c00053b5eb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:25.479384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af3e71-01e4-4f60-9082-a1bfccdea18d None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:25.485009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-79720ef2-5d60-42ed-a1bb-9c00053b5eb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:25.485009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:25.485009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:25.485009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:25.485009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:25.485009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:25.485009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:25.485009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:25.485009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:25.485009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:25.485009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:25.485009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:25.485009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:25.485009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:25.485009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:25.485009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:25.485896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:25.485896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:25.485896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:25.485896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:25.485896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:25.485896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:25.485896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:25.485896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:25.485896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:25.485896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:25.485896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:25.485896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:25.485896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:25.485896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:25.485896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:25.485896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:25.486792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:25.486792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:25.486792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:25.486792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:25.486792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:25.486792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:25.486792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:25.486792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:25.486792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:25.486792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:25.486792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:25.486792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:25.486792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 184/358] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:25.487828 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3870c-6388-4ebd-a9e5-f1c5de7090d1 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.488033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3870c-6388-4ebd-a9e5-f1c5de7090d1 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.488284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3870c-6388-4ebd-a9e5-f1c5de7090d1 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.489476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 185/359] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:25.490220 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3870c-6388-4ebd-a9e5-f1c5de7090d1 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:25.499469 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 175/360] 10.222.0.71 () {56 vars in 1308 bytes} [Thu Sep 1 16:19:25 2022] GET /identity/v3/role_assignments?user.id=1a79bd531b1d48dba878e00ad6b65937&scope.system=all&role.id=dc7f92ba5a294b00afaa074d01532b7c => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:25.500642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af3e71-01e4-4f60-9082-a1bfccdea18d None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:25.575036 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:25.625840 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:25.635224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3870c-6388-4ebd-a9e5-f1c5de7090d1 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:25.637507 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af3e71-01e4-4f60-9082-a1bfccdea18d None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:25.677711 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea8d8f-7abc-4942-8c93-c5d1ec2f78d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:25.678646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea8d8f-7abc-4942-8c93-c5d1ec2f78d5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.678930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea8d8f-7abc-4942-8c93-c5d1ec2f78d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.679255 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea8d8f-7abc-4942-8c93-c5d1ec2f78d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.680094 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea8d8f-7abc-4942-8c93-c5d1ec2f78d5 None admin] RBAC: Adding query filter params (group.id=53bbfea5cdaf4a388b206eb67798667a, role.id=8b655a66d879422db1b56ca98d77e490, scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:25.680539 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea8d8f-7abc-4942-8c93-c5d1ec2f78d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:25.681694 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea8d8f-7abc-4942-8c93-c5d1ec2f78d5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:25.688487 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 186/361] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:25 2022] GET /identity/v3/role_assignments?group.id=53bbfea5cdaf4a388b206eb67798667a&scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f&role.id=8b655a66d879422db1b56ca98d77e490 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:25.689366 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea8d8f-7abc-4942-8c93-c5d1ec2f78d5 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:25.693006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52752d01-314f-4a51-9ae6-7b832661b4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:25.693644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52752d01-314f-4a51-9ae6-7b832661b4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.693925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52752d01-314f-4a51-9ae6-7b832661b4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.694201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52752d01-314f-4a51-9ae6-7b832661b4b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.695010 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52752d01-314f-4a51-9ae6-7b832661b4b8 None admin] RBAC: Adding query filter params (group.id=53bbfea5cdaf4a388b206eb67798667a, role.id=0e112f96840a483bb6dfeab1bb8af187, scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:25.695322 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52752d01-314f-4a51-9ae6-7b832661b4b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:25.696828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52752d01-314f-4a51-9ae6-7b832661b4b8 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:25.703882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 176/362] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:25 2022] GET /identity/v3/role_assignments?group.id=53bbfea5cdaf4a388b206eb67798667a&scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f&role.id=0e112f96840a483bb6dfeab1bb8af187 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:25.704542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52752d01-314f-4a51-9ae6-7b832661b4b8 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:25.825601 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea8d8f-7abc-4942-8c93-c5d1ec2f78d5 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:25.857873 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:25.868910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52752d01-314f-4a51-9ae6-7b832661b4b8 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:25.874292 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3a28c-3f27-4cbf-8184-8e7417aa99db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:25.874969 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3a28c-3f27-4cbf-8184-8e7417aa99db None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.875245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3a28c-3f27-4cbf-8184-8e7417aa99db None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.875515 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3a28c-3f27-4cbf-8184-8e7417aa99db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.892159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3a28c-3f27-4cbf-8184-8e7417aa99db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:25.898215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-9cb3a28c-3f27-4cbf-8184-8e7417aa99db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:25.898215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:25.898215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:25.898215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:25.898215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:25.898215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:25.898215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:25.898215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:25.898215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:25.898215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:25.898215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:25.898215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:25.898215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:25.898215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:25.898215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:25.898215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:25.899572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:25.899572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:25.899572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:25.899572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:25.899572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:25.899572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:25.899572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:25.899572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:25.899572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:25.899572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:25.899572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:25.899572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:25.899572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:25.899572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:25.899572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:25.899572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:25.900553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:25.900553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:25.900553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:25.900553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:25.900553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:25.900553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:25.900553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:25.900553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:25.900553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:25.900553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:25.900553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:25.900553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:25.900553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 187/363] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:25.901224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb3815-9232-427f-a693-9ff4a426f810 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.901224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb3815-9232-427f-a693-9ff4a426f810 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.901357 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb3815-9232-427f-a693-9ff4a426f810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.919139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01567be0-a38a-4943-bd96-85c2b5debb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:25.920005 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01567be0-a38a-4943-bd96-85c2b5debb4f None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.920432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01567be0-a38a-4943-bd96-85c2b5debb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.920840 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01567be0-a38a-4943-bd96-85c2b5debb4f None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.921750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01567be0-a38a-4943-bd96-85c2b5debb4f None admin] RBAC: Adding query filter params (name=member) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:25.922822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01567be0-a38a-4943-bd96-85c2b5debb4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:25.924381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01567be0-a38a-4943-bd96-85c2b5debb4f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:25.931524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-eaeb3815-9232-427f-a693-9ff4a426f810 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:25.932202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-eaeb3815-9232-427f-a693-9ff4a426f810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:25.934995 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 177/364] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:25.936013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01567be0-a38a-4943-bd96-85c2b5debb4f None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:25.959767 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:26.050643 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 188/365] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:26.050643 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb3815-9232-427f-a693-9ff4a426f810 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:26.074326 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01567be0-a38a-4943-bd96-85c2b5debb4f None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:26.162595 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb3815-9232-427f-a693-9ff4a426f810 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:26.167363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb54d4-de7a-4a00-9eb7-16654a07e63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:26.168514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb54d4-de7a-4a00-9eb7-16654a07e63f None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:26.168975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb54d4-de7a-4a00-9eb7-16654a07e63f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:26.169446 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb54d4-de7a-4a00-9eb7-16654a07e63f None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:26.170290 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb54d4-de7a-4a00-9eb7-16654a07e63f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:26.170793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb54d4-de7a-4a00-9eb7-16654a07e63f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:26.172349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb54d4-de7a-4a00-9eb7-16654a07e63f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:26.178244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:26.189918 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 178/366] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:26.195274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb54d4-de7a-4a00-9eb7-16654a07e63f None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:26.200824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93989425-1bdd-4452-a6da-792aec8a36cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:26.201745 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93989425-1bdd-4452-a6da-792aec8a36cd None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:26.202021 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93989425-1bdd-4452-a6da-792aec8a36cd None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:26.202290 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93989425-1bdd-4452-a6da-792aec8a36cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:26.333599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:26.359867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93989425-1bdd-4452-a6da-792aec8a36cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:26.361335 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93989425-1bdd-4452-a6da-792aec8a36cd None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:26.363063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb54d4-de7a-4a00-9eb7-16654a07e63f None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:26.403679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9a3c6-a36d-4d98-b8f3-2f0844e6b5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:26.404334 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a3c6-a36d-4d98-b8f3-2f0844e6b5bb None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:26.404614 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a3c6-a36d-4d98-b8f3-2f0844e6b5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:26.404881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a3c6-a36d-4d98-b8f3-2f0844e6b5bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:26.506224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9a3c6-a36d-4d98-b8f3-2f0844e6b5bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:26.507616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9a3c6-a36d-4d98-b8f3-2f0844e6b5bb None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:26.523484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 189/367] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:26.524778 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93989425-1bdd-4452-a6da-792aec8a36cd None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:26.543581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:26.603932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:26.641925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 179/368] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:26.642909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9a3c6-a36d-4d98-b8f3-2f0844e6b5bb None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:26.660376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93989425-1bdd-4452-a6da-792aec8a36cd None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:26.711906 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa553ac-7807-429e-8932-4e011d79d9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:26.712871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa553ac-7807-429e-8932-4e011d79d9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:26.713342 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa553ac-7807-429e-8932-4e011d79d9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:26.713865 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa553ac-7807-429e-8932-4e011d79d9a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:26.729371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa553ac-7807-429e-8932-4e011d79d9a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:26.734774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-5aa553ac-7807-429e-8932-4e011d79d9a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:26.734774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:26.734774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:26.734774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:26.734774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:26.734774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:26.734774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:26.734774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:26.734774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:26.734774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:26.734774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:26.734774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:26.734774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:26.734774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:26.734774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:26.734774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:26.735634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:26.735634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:26.735634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:26.735634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:26.735634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:26.735634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:26.735634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:26.735634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:26.735634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:26.735634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:26.735634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:26.735634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:26.735634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:26.735634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:26.735634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:26.735634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:26.736419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:26.736419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:26.736419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:26.736419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:26.736419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:26.736419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:26.736419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:26.736419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:26.736419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:26.736419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:26.736419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:26.736419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:26.738667 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 190/369] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:19:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:26.739635 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa553ac-7807-429e-8932-4e011d79d9a3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:26.753585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9a3c6-a36d-4d98-b8f3-2f0844e6b5bb None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:26.790036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ef938-a982-417f-9c37-f50bb42b3d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:26.790479 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef938-a982-417f-9c37-f50bb42b3d50 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:26.790782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef938-a982-417f-9c37-f50bb42b3d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:26.791053 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef938-a982-417f-9c37-f50bb42b3d50 None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:26.792702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ef938-a982-417f-9c37-f50bb42b3d50 None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:26.794176 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ef938-a982-417f-9c37-f50bb42b3d50 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:26.795833 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 180/370] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:26 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:26.796591 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ef938-a982-417f-9c37-f50bb42b3d50 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:26.829355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:26.851302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:26.859376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa553ac-7807-429e-8932-4e011d79d9a3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:26.898009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279eabb6-25af-4eff-97e2-b443d776ca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:26.899027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279eabb6-25af-4eff-97e2-b443d776ca8f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:26.899501 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279eabb6-25af-4eff-97e2-b443d776ca8f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:26.900066 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279eabb6-25af-4eff-97e2-b443d776ca8f None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:26.901487 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279eabb6-25af-4eff-97e2-b443d776ca8f None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:26.903204 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279eabb6-25af-4eff-97e2-b443d776ca8f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:26.905257 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 191/371] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:26 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:26.906214 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279eabb6-25af-4eff-97e2-b443d776ca8f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:26.911880 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ef938-a982-417f-9c37-f50bb42b3d50 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:26.949665 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f016b5-ec49-4f62-bf4d-6b78715ddcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:26.950090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f016b5-ec49-4f62-bf4d-6b78715ddcc8 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:26.950371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f016b5-ec49-4f62-bf4d-6b78715ddcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:26.950657 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f016b5-ec49-4f62-bf4d-6b78715ddcc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:26.951333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f016b5-ec49-4f62-bf4d-6b78715ddcc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:26.951629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f016b5-ec49-4f62-bf4d-6b78715ddcc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:26.953285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f016b5-ec49-4f62-bf4d-6b78715ddcc8 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:26.962065 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 181/372] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:26.962899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f016b5-ec49-4f62-bf4d-6b78715ddcc8 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:27.016154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279eabb6-25af-4eff-97e2-b443d776ca8f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:27.055062 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf32e5-57db-47d3-b56d-6b0cc4079d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:27.056436 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf32e5-57db-47d3-b56d-6b0cc4079d00 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:27.056904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf32e5-57db-47d3-b56d-6b0cc4079d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:27.057381 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf32e5-57db-47d3-b56d-6b0cc4079d00 None admin] PATH_INFO: `/v3/groups/53bbfea5cdaf4a388b206eb67798667a` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:27.058810 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf32e5-57db-47d3-b56d-6b0cc4079d00 None admin] RBAC: Authorizing `identity:get_group(group_id=53bbfea5cdaf4a388b206eb67798667a)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:27.060461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf32e5-57db-47d3-b56d-6b0cc4079d00 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:27.062234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 192/373] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:26 2022] GET /identity/v3/groups/53bbfea5cdaf4a388b206eb67798667a => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:27.063200 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf32e5-57db-47d3-b56d-6b0cc4079d00 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:27.075506 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f016b5-ec49-4f62-bf4d-6b78715ddcc8 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:27.076659 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:27.085794 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:27.113515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2044d-87c6-480d-9e8f-b39e4e37e4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:27.114138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2044d-87c6-480d-9e8f-b39e4e37e4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:27.114411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2044d-87c6-480d-9e8f-b39e4e37e4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:27.114707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2044d-87c6-480d-9e8f-b39e4e37e4a6 None admin] PATH_INFO: `/v3/groups/53bbfea5cdaf4a388b206eb67798667a` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:27.115985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2044d-87c6-480d-9e8f-b39e4e37e4a6 None admin] RBAC: Authorizing `identity:get_group(group_id=53bbfea5cdaf4a388b206eb67798667a)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:27.117411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2044d-87c6-480d-9e8f-b39e4e37e4a6 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:27.119377 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 182/374] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:26 2022] GET /identity/v3/groups/53bbfea5cdaf4a388b206eb67798667a => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:27.120164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2044d-87c6-480d-9e8f-b39e4e37e4a6 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:27.174355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf32e5-57db-47d3-b56d-6b0cc4079d00 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:27.210045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610f36e-9fd7-4d63-b351-be7069745b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:27.211028 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610f36e-9fd7-4d63-b351-be7069745b8d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:27.211500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610f36e-9fd7-4d63-b351-be7069745b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:27.211959 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610f36e-9fd7-4d63-b351-be7069745b8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:27.222359 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2044d-87c6-480d-9e8f-b39e4e37e4a6 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:27.257695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb3242-8074-4f98-8919-d2a750733349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:27.258075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb3242-8074-4f98-8919-d2a750733349 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:27.258349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb3242-8074-4f98-8919-d2a750733349 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:27.258635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb3242-8074-4f98-8919-d2a750733349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:27.259417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb3242-8074-4f98-8919-d2a750733349 None admin] RBAC: Adding query filter params (group.id=53bbfea5cdaf4a388b206eb67798667a, role.id=8b655a66d879422db1b56ca98d77e490, scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:27.259730 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb3242-8074-4f98-8919-d2a750733349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:27.261172 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb3242-8074-4f98-8919-d2a750733349 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:27.268042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 183/375] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:27 2022] GET /identity/v3/role_assignments?group.id=53bbfea5cdaf4a388b206eb67798667a&scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127&role.id=8b655a66d879422db1b56ca98d77e490 => generated 260 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:27.268850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb3242-8074-4f98-8919-d2a750733349 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:27.287120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610f36e-9fd7-4d63-b351-be7069745b8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:27.288969 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610f36e-9fd7-4d63-b351-be7069745b8d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:27.302050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:27.316311 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:27.384099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb3242-8074-4f98-8919-d2a750733349 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:27.402920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 193/376] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:27.408953 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610f36e-9fd7-4d63-b351-be7069745b8d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:27.430895 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fa88b-113f-4d86-8202-82210ec5d95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:27.432146 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fa88b-113f-4d86-8202-82210ec5d95d None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:27.433629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fa88b-113f-4d86-8202-82210ec5d95d None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:27.434117 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fa88b-113f-4d86-8202-82210ec5d95d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:27.435120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fa88b-113f-4d86-8202-82210ec5d95d None admin] RBAC: Adding query filter params (group.id=53bbfea5cdaf4a388b206eb67798667a, role.id=0e112f96840a483bb6dfeab1bb8af187, scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:27.435637 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fa88b-113f-4d86-8202-82210ec5d95d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:27.438497 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fa88b-113f-4d86-8202-82210ec5d95d None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:27.445850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 184/377] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:27 2022] GET /identity/v3/role_assignments?group.id=53bbfea5cdaf4a388b206eb67798667a&scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127&role.id=0e112f96840a483bb6dfeab1bb8af187 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:27.529385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610f36e-9fd7-4d63-b351-be7069745b8d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:27.542581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:27.569217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84331634-901d-4117-aaf0-14f8bb197fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:27.569779 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84331634-901d-4117-aaf0-14f8bb197fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:27.570053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84331634-901d-4117-aaf0-14f8bb197fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:27.570324 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84331634-901d-4117-aaf0-14f8bb197fd1 None admin] PATH_INFO: `/v3/projects/4331680a8fba4a9c848da35bab7c3c6a` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:27.571492 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84331634-901d-4117-aaf0-14f8bb197fd1 None admin] RBAC: Authorizing `identity:get_project(project_id=4331680a8fba4a9c848da35bab7c3c6a)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:27.573006 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84331634-901d-4117-aaf0-14f8bb197fd1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:27.575634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 194/378] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:27 2022] GET /identity/v3/projects/4331680a8fba4a9c848da35bab7c3c6a => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:27.580916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fa88b-113f-4d86-8202-82210ec5d95d None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:27.725115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fa88b-113f-4d86-8202-82210ec5d95d None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:27.728035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:27.768775 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ccfa4d-9180-4aca-802a-f09d46d87d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:27.769648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccfa4d-9180-4aca-802a-f09d46d87d5f None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:27.770073 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccfa4d-9180-4aca-802a-f09d46d87d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:27.770490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccfa4d-9180-4aca-802a-f09d46d87d5f None admin] PATH_INFO: `/v3/groups/320ef35ce5344e7893b746c3da7947fd` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:27.777962 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ccfa4d-9180-4aca-802a-f09d46d87d5f None admin] RBAC: Authorizing `identity:get_group(group_id=320ef35ce5344e7893b746c3da7947fd)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:27.779657 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ccfa4d-9180-4aca-802a-f09d46d87d5f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:27.783084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 185/379] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:27 2022] GET /identity/v3/groups/320ef35ce5344e7893b746c3da7947fd => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:27.788979 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84331634-901d-4117-aaf0-14f8bb197fd1 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:27.923177 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84331634-901d-4117-aaf0-14f8bb197fd1 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:27.959513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e62695-2ab4-4678-9d5f-83f96050d66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:27.960446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e62695-2ab4-4678-9d5f-83f96050d66c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:27.960930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e62695-2ab4-4678-9d5f-83f96050d66c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:27.961369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e62695-2ab4-4678-9d5f-83f96050d66c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:27.962295 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e62695-2ab4-4678-9d5f-83f96050d66c None admin] RBAC: Adding query filter params (group.id=320ef35ce5344e7893b746c3da7947fd, role.id=3cd61239237441418529e9028ef801e4, scope.project.id=4331680a8fba4a9c848da35bab7c3c6a) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:27.965565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e62695-2ab4-4678-9d5f-83f96050d66c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:27.966929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e62695-2ab4-4678-9d5f-83f96050d66c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:27.973313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 195/380] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:27 2022] GET /identity/v3/role_assignments?group.id=320ef35ce5344e7893b746c3da7947fd&scope.project.id=4331680a8fba4a9c848da35bab7c3c6a&role.id=3cd61239237441418529e9028ef801e4 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:28.261078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ce3df-1846-471b-bd1f-928c7ad52112 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:28.262012 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ce3df-1846-471b-bd1f-928c7ad52112 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:28.262493 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ce3df-1846-471b-bd1f-928c7ad52112 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:28.264320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 186/381] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:28.269314 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b0ca4-e20b-4ee0-a758-8704c47aa206 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:28.270152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b0ca4-e20b-4ee0-a758-8704c47aa206 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:28.270602 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b0ca4-e20b-4ee0-a758-8704c47aa206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:28.279626 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cebc6-e4a5-4b93-93e7-6d0bce420669 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:28.280144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cebc6-e4a5-4b93-93e7-6d0bce420669 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:28.280618 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cebc6-e4a5-4b93-93e7-6d0bce420669 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:28.282112 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 187/382] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:19:28.291342 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ec256-662e-42c7-b57f-087ce6fab196 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:28.291914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ec256-662e-42c7-b57f-087ce6fab196 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:28.292941 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ec256-662e-42c7-b57f-087ce6fab196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:28.310833 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-583b0ca4-e20b-4ee0-a758-8704c47aa206 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:28.312366 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-583b0ca4-e20b-4ee0-a758-8704c47aa206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:28.326675 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-b64ec256-662e-42c7-b57f-087ce6fab196 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:28.328200 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b64ec256-662e-42c7-b57f-087ce6fab196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:28.382660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:28.426363 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 196/383] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:28.449781 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 188/384] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:28.744867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b0ca4-e20b-4ee0-a758-8704c47aa206 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:28.857950 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b0ca4-e20b-4ee0-a758-8704c47aa206 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:28.896288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed02247-224e-4c9d-982b-d36904bfbf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:28.897240 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed02247-224e-4c9d-982b-d36904bfbf0c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:28.897735 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed02247-224e-4c9d-982b-d36904bfbf0c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:28.898214 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed02247-224e-4c9d-982b-d36904bfbf0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:28.906519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ec256-662e-42c7-b57f-087ce6fab196 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:28.911765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed02247-224e-4c9d-982b-d36904bfbf0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:28.919463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-6ed02247-224e-4c9d-982b-d36904bfbf0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:28.919463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:28.919463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:28.919463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:28.919463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:28.919463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:28.919463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:28.919463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:28.919463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:28.919463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:28.919463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:28.919463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:28.919463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:28.919463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:28.919463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:28.919463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:28.920457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:28.920457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:28.920457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:28.920457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:28.920457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:28.920457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:28.920457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:28.920457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:28.920457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:28.920457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:28.920457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:28.920457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:28.920457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:28.920457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:28.920457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:28.920457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:28.925415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:28.925415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:28.925415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:28.925415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:28.925415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:28.925415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:28.925415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:28.925415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:28.925415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:28.925415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:28.925415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:28.925415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:28.925415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 197/385] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:28.931598 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed02247-224e-4c9d-982b-d36904bfbf0c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:28.973895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:29.066988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:29.074126 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ec256-662e-42c7-b57f-087ce6fab196 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:29.097497 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed02247-224e-4c9d-982b-d36904bfbf0c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:29.138818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388aba5-fe49-4b86-9e64-4cfd0b2dfff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:29.139450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388aba5-fe49-4b86-9e64-4cfd0b2dfff1 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:29.139723 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388aba5-fe49-4b86-9e64-4cfd0b2dfff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:29.139985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388aba5-fe49-4b86-9e64-4cfd0b2dfff1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:29.156432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388aba5-fe49-4b86-9e64-4cfd0b2dfff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:29.161817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-6388aba5-fe49-4b86-9e64-4cfd0b2dfff1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:29.161817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:29.161817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:29.161817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:29.161817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:29.161817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:29.161817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:29.161817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:29.161817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:29.161817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:29.161817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:29.161817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:29.161817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:29.161817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:29.161817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:29.161817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:29.162798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:29.162798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:29.162798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:29.162798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:29.162798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:29.162798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:29.162798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:29.162798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:29.162798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:29.162798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:29.162798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:29.162798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:29.162798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:29.162798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:29.162798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:29.162798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:29.163613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:29.163613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:29.163613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:29.163613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:29.163613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:29.163613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:29.163613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:29.163613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:29.163613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:29.163613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:29.163613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:29.163613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:29.164954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 189/386] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:29.168891 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20a6b0-d7ff-4183-ad69-524b33e09662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:29.169510 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20a6b0-d7ff-4183-ad69-524b33e09662 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:29.169779 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20a6b0-d7ff-4183-ad69-524b33e09662 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:29.170040 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20a6b0-d7ff-4183-ad69-524b33e09662 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:29.170740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20a6b0-d7ff-4183-ad69-524b33e09662 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:29.171037 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20a6b0-d7ff-4183-ad69-524b33e09662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:29.172453 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20a6b0-d7ff-4183-ad69-524b33e09662 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:29.177241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388aba5-fe49-4b86-9e64-4cfd0b2dfff1 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:29.190763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 198/387] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:29.196469 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20a6b0-d7ff-4183-ad69-524b33e09662 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:29.315037 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:29.324327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20a6b0-d7ff-4183-ad69-524b33e09662 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:29.337860 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388aba5-fe49-4b86-9e64-4cfd0b2dfff1 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:29.391274 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e3c4e-2508-4520-9220-ecc7d88efcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:29.393476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e3c4e-2508-4520-9220-ecc7d88efcd0 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:29.393766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e3c4e-2508-4520-9220-ecc7d88efcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:29.394041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e3c4e-2508-4520-9220-ecc7d88efcd0 None admin] PATH_INFO: `/v3/groups/53bbfea5cdaf4a388b206eb67798667a` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:29.396566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e3c4e-2508-4520-9220-ecc7d88efcd0 None admin] RBAC: Authorizing `identity:get_group(group_id=53bbfea5cdaf4a388b206eb67798667a)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:29.398001 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e3c4e-2508-4520-9220-ecc7d88efcd0 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:29.399636 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 199/388] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:29 2022] GET /identity/v3/groups/53bbfea5cdaf4a388b206eb67798667a => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:29.406148 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e3c4e-2508-4520-9220-ecc7d88efcd0 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:29.408406 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55cc15-0c13-4ae8-9c0f-e878f4cc7e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:29.408935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55cc15-0c13-4ae8-9c0f-e878f4cc7e06 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:29.409214 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55cc15-0c13-4ae8-9c0f-e878f4cc7e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:29.409483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55cc15-0c13-4ae8-9c0f-e878f4cc7e06 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:29.410155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55cc15-0c13-4ae8-9c0f-e878f4cc7e06 None admin] RBAC: Adding query filter params (name=member) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:29.410457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55cc15-0c13-4ae8-9c0f-e878f4cc7e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:29.411866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55cc15-0c13-4ae8-9c0f-e878f4cc7e06 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:29.431427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 190/389] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:29.448717 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55cc15-0c13-4ae8-9c0f-e878f4cc7e06 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:29.485513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:29.571365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e3c4e-2508-4520-9220-ecc7d88efcd0 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:29.637885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0664711-480c-4172-bbf1-bff73a17ff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:29.638775 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0664711-480c-4172-bbf1-bff73a17ff18 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:29.639598 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0664711-480c-4172-bbf1-bff73a17ff18 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:29.640000 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0664711-480c-4172-bbf1-bff73a17ff18 None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:29.641537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0664711-480c-4172-bbf1-bff73a17ff18 None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:29.643052 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55cc15-0c13-4ae8-9c0f-e878f4cc7e06 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:29.643174 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0664711-480c-4172-bbf1-bff73a17ff18 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:29.645493 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 200/390] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:29 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:29.656704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0664711-480c-4172-bbf1-bff73a17ff18 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:29.688417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79a3e2-2a04-42c5-a803-8eb1ce9a58bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:29.689315 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79a3e2-2a04-42c5-a803-8eb1ce9a58bd None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:29.689826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79a3e2-2a04-42c5-a803-8eb1ce9a58bd None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:29.690238 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79a3e2-2a04-42c5-a803-8eb1ce9a58bd None admin] PATH_INFO: `/v3/groups/53bbfea5cdaf4a388b206eb67798667a` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:29.691593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79a3e2-2a04-42c5-a803-8eb1ce9a58bd None admin] RBAC: Authorizing `identity:get_group(group_id=53bbfea5cdaf4a388b206eb67798667a)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:29.693283 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79a3e2-2a04-42c5-a803-8eb1ce9a58bd None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:29.695110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 191/391] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:29 2022] GET /identity/v3/groups/53bbfea5cdaf4a388b206eb67798667a => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:29.696665 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc558be-ab03-4705-8058-40312830d26b None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:29.697094 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc558be-ab03-4705-8058-40312830d26b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:29.697511 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc558be-ab03-4705-8058-40312830d26b None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:29.699717 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 192/392] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:29.701911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc558be-ab03-4705-8058-40312830d26b None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:29.721331 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:29.816036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:29.831517 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc558be-ab03-4705-8058-40312830d26b None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:29.838278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0664711-480c-4172-bbf1-bff73a17ff18 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:29.885407 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb46c47-e811-4753-b646-daf8b1e7e08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:29.886603 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb46c47-e811-4753-b646-daf8b1e7e08b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:29.887955 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb46c47-e811-4753-b646-daf8b1e7e08b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:29.888231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb46c47-e811-4753-b646-daf8b1e7e08b None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:29.889763 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb46c47-e811-4753-b646-daf8b1e7e08b None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:29.891231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb46c47-e811-4753-b646-daf8b1e7e08b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:29.892968 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc7335-c5c9-4635-8e17-419ddec2b239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:29.893444 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 193/393] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:29 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:29.893634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc7335-c5c9-4635-8e17-419ddec2b239 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:29.893919 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc7335-c5c9-4635-8e17-419ddec2b239 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:29.894193 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc7335-c5c9-4635-8e17-419ddec2b239 None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f/groups/53bbfea5cdaf4a388b206eb67798667a/roles/0e112f96840a483bb6dfeab1bb8af187` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:29.894755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c9497-7088-430c-a76a-1c29a30f5b94 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:29.894986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c9497-7088-430c-a76a-1c29a30f5b94 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:29.897091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc7335-c5c9-4635-8e17-419ddec2b239 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf4f1224bb02437e83d0ac7973ab2f2f, group_id=53bbfea5cdaf4a388b206eb67798667a, role_id=0e112f96840a483bb6dfeab1bb8af187)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:29.898520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc7335-c5c9-4635-8e17-419ddec2b239 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:29.898766 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c9497-7088-430c-a76a-1c29a30f5b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:29.914659 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 201/394] 10.222.0.71 () {58 vars in 1442 bytes} [Thu Sep 1 16:19:29 2022] PUT /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f/groups/53bbfea5cdaf4a388b206eb67798667a/roles/0e112f96840a483bb6dfeab1bb8af187 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:19:29.915569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc7335-c5c9-4635-8e17-419ddec2b239 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:29.923090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-a31c9497-7088-430c-a76a-1c29a30f5b94 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:29.924349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a31c9497-7088-430c-a76a-1c29a30f5b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:30.009547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 194/395] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:30.029862 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:30.040158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc7335-c5c9-4635-8e17-419ddec2b239 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:30.089788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5cc40-f1d2-46fa-9c47-c7bf6a7156d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:30.090467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5cc40-f1d2-46fa-9c47-c7bf6a7156d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.090781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5cc40-f1d2-46fa-9c47-c7bf6a7156d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.091056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5cc40-f1d2-46fa-9c47-c7bf6a7156d2 None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f/groups/53bbfea5cdaf4a388b206eb67798667a/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.096249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5cc40-f1d2-46fa-9c47-c7bf6a7156d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf4f1224bb02437e83d0ac7973ab2f2f, group_id=53bbfea5cdaf4a388b206eb67798667a, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:30.097742 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5cc40-f1d2-46fa-9c47-c7bf6a7156d2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:30.114766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 202/396] 10.222.0.71 () {58 vars in 1442 bytes} [Thu Sep 1 16:19:29 2022] PUT /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f/groups/53bbfea5cdaf4a388b206eb67798667a/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:30.194373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c3757-6a0a-4bce-9d62-5f4a03596004 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.194735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c3757-6a0a-4bce-9d62-5f4a03596004 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.194978 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c3757-6a0a-4bce-9d62-5f4a03596004 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.196677 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 195/397] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:30.202112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bde8b-abc3-42f8-b1c8-270a398541c8 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.202405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bde8b-abc3-42f8-b1c8-270a398541c8 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.202740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bde8b-abc3-42f8-b1c8-270a398541c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.226462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1b1bde8b-abc3-42f8-b1c8-270a398541c8 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:30.227732 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1b1bde8b-abc3-42f8-b1c8-270a398541c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:30.310724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c3757-6a0a-4bce-9d62-5f4a03596004 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:30.312380 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 203/398] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:30.415642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:30.437491 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c3757-6a0a-4bce-9d62-5f4a03596004 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:30.481210 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019a0b0-a229-4637-bb8b-92710da9392a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:30.481843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019a0b0-a229-4637-bb8b-92710da9392a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.482118 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019a0b0-a229-4637-bb8b-92710da9392a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.482379 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019a0b0-a229-4637-bb8b-92710da9392a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.492805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019a0b0-a229-4637-bb8b-92710da9392a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:30.498174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-c019a0b0-a229-4637-bb8b-92710da9392a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:30.498174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:30.498174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:30.498174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:30.498174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:30.498174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:30.498174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:30.498174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:30.498174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:30.498174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:30.498174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:30.498174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:30.498174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:30.498174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:30.498174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:30.498174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:30.500504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:30.500504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:30.500504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:30.500504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:30.500504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:30.500504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:30.500504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:30.500504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:30.500504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:30.500504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:30.500504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:30.500504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:30.500504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:30.500504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:30.500504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:30.500504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:30.502547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:30.502547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:30.502547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:30.502547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:30.502547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:30.502547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:30.502547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:30.502547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:30.502547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:30.502547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:30.502547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:30.502547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:30.502547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 196/399] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:30.506575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bde8b-abc3-42f8-b1c8-270a398541c8 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:30.611555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019a0b0-a229-4637-bb8b-92710da9392a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:30.612910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:30.653556 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bde8b-abc3-42f8-b1c8-270a398541c8 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:30.699172 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbbe4b-73a2-40c5-8fbc-dd6071b2106c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:30.700130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbbe4b-73a2-40c5-8fbc-dd6071b2106c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.700602 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbbe4b-73a2-40c5-8fbc-dd6071b2106c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.701044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbbe4b-73a2-40c5-8fbc-dd6071b2106c None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.702855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbbe4b-73a2-40c5-8fbc-dd6071b2106c None admin] RBAC: Adding query filter params (name=member) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:30.703348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbbe4b-73a2-40c5-8fbc-dd6071b2106c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:30.704891 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbbe4b-73a2-40c5-8fbc-dd6071b2106c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:30.714898 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 204/400] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:30.716461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd8293-323e-4292-b0c0-b100cf431ecc None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.716948 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd8293-323e-4292-b0c0-b100cf431ecc None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.717391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd8293-323e-4292-b0c0-b100cf431ecc None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.719154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 205/401] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:30.723587 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd8293-323e-4292-b0c0-b100cf431ecc None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:30.759801 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019a0b0-a229-4637-bb8b-92710da9392a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:30.808431 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af894b1-d291-4539-a7ef-b0aac86ee7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:30.809173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af894b1-d291-4539-a7ef-b0aac86ee7bd None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.809453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af894b1-d291-4539-a7ef-b0aac86ee7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.809722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af894b1-d291-4539-a7ef-b0aac86ee7bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.824530 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af894b1-d291-4539-a7ef-b0aac86ee7bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:30.829577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-8af894b1-d291-4539-a7ef-b0aac86ee7bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:30.829577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:30.829577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:30.829577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:30.829577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:30.829577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:30.829577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:30.829577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:30.829577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:30.829577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:30.829577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:30.829577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:30.829577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:30.829577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:30.829577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:30.829577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:30.830459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:30.830459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:30.830459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:30.830459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:30.830459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:30.830459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:30.830459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:30.830459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:30.830459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:30.830459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:30.830459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:30.830459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:30.830459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:30.830459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:30.830459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:30.830459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:30.831306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:30.831306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:30.831306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:30.831306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:30.831306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:30.831306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:30.831306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:30.831306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:30.831306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:30.831306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:30.831306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:30.831306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:30.831306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 197/402] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:30.832435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd675d69-211f-45df-b8de-128477230507 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.832529 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd675d69-211f-45df-b8de-128477230507 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.832772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd675d69-211f-45df-b8de-128477230507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.852014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd8293-323e-4292-b0c0-b100cf431ecc None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:30.853175 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:30.858561 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-dd675d69-211f-45df-b8de-128477230507 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:30.859797 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-dd675d69-211f-45df-b8de-128477230507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:30.896043 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056235c-d84a-4194-b346-ef4fc0bac432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:30.897441 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056235c-d84a-4194-b346-ef4fc0bac432 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.897922 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056235c-d84a-4194-b346-ef4fc0bac432 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.898638 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056235c-d84a-4194-b346-ef4fc0bac432 None admin] PATH_INFO: `/v3/groups/53bbfea5cdaf4a388b206eb67798667a` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.900346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056235c-d84a-4194-b346-ef4fc0bac432 None admin] RBAC: Authorizing `identity:get_group(group_id=53bbfea5cdaf4a388b206eb67798667a)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:30.903067 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056235c-d84a-4194-b346-ef4fc0bac432 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:30.905321 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 206/403] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:30 2022] GET /identity/v3/groups/53bbfea5cdaf4a388b206eb67798667a => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:30.907223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056235c-d84a-4194-b346-ef4fc0bac432 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:30.921833 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:30.942022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 198/404] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:30.943775 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd675d69-211f-45df-b8de-128477230507 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:31.086896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056235c-d84a-4194-b346-ef4fc0bac432 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:31.096178 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd675d69-211f-45df-b8de-128477230507 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:31.145626 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae7f7a-1aa6-4227-ae65-4ffc2465e570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:31.146283 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae7f7a-1aa6-4227-ae65-4ffc2465e570 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:31.146503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae7f7a-1aa6-4227-ae65-4ffc2465e570 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:31.146797 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae7f7a-1aa6-4227-ae65-4ffc2465e570 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:31.147452 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae7f7a-1aa6-4227-ae65-4ffc2465e570 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:31.147754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae7f7a-1aa6-4227-ae65-4ffc2465e570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:31.149098 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae7f7a-1aa6-4227-ae65-4ffc2465e570 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:31.153337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16997c68-1422-4782-8e31-cc253ee1ec1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:31.153962 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16997c68-1422-4782-8e31-cc253ee1ec1f None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:31.154240 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16997c68-1422-4782-8e31-cc253ee1ec1f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:31.154505 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16997c68-1422-4782-8e31-cc253ee1ec1f None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:31.158159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16997c68-1422-4782-8e31-cc253ee1ec1f None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:31.159586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16997c68-1422-4782-8e31-cc253ee1ec1f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:31.161557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 199/405] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:30 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:31.164559 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 207/406] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:31.166820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16997c68-1422-4782-8e31-cc253ee1ec1f None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:31.172166 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae7f7a-1aa6-4227-ae65-4ffc2465e570 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:31.180888 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:31.297910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16997c68-1422-4782-8e31-cc253ee1ec1f None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:31.301507 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:31.332926 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa33523-1f0e-40fd-b010-1bd34af715bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:31.333582 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa33523-1f0e-40fd-b010-1bd34af715bf None admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:31.333859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa33523-1f0e-40fd-b010-1bd34af715bf None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:31.334130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa33523-1f0e-40fd-b010-1bd34af715bf None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127/groups/53bbfea5cdaf4a388b206eb67798667a/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:31.336218 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa33523-1f0e-40fd-b010-1bd34af715bf None admin] RBAC: Authorizing `identity:create_grant(project_id=63e679fbf8c3498a8cc0860b3a0f5127, group_id=53bbfea5cdaf4a388b206eb67798667a, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:31.337659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa33523-1f0e-40fd-b010-1bd34af715bf None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:31.343848 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae7f7a-1aa6-4227-ae65-4ffc2465e570 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:31.353975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 200/407] 10.222.0.71 () {58 vars in 1442 bytes} [Thu Sep 1 16:19:31 2022] PUT /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127/groups/53bbfea5cdaf4a388b206eb67798667a/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:19:31.355557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa33523-1f0e-40fd-b010-1bd34af715bf None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:31.407007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5380ae-fcae-49c6-bb65-0aaeac296e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:31.408068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5380ae-fcae-49c6-bb65-0aaeac296e7b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:31.408557 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5380ae-fcae-49c6-bb65-0aaeac296e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:31.409062 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5380ae-fcae-49c6-bb65-0aaeac296e7b None admin] PATH_INFO: `/v3/groups/53bbfea5cdaf4a388b206eb67798667a` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:31.410570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5380ae-fcae-49c6-bb65-0aaeac296e7b None admin] RBAC: Authorizing `identity:get_group(group_id=53bbfea5cdaf4a388b206eb67798667a)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:31.412340 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5380ae-fcae-49c6-bb65-0aaeac296e7b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:31.414313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 208/408] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:31 2022] GET /identity/v3/groups/53bbfea5cdaf4a388b206eb67798667a => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:31.423700 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5380ae-fcae-49c6-bb65-0aaeac296e7b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:31.453431 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:31.496486 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa33523-1f0e-40fd-b010-1bd34af715bf None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:31.541639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebe00e-1f6d-48ea-ae70-cfdc7c3eb114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:31.543373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe00e-1f6d-48ea-ae70-cfdc7c3eb114 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:31.543851 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe00e-1f6d-48ea-ae70-cfdc7c3eb114 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:31.545683 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe00e-1f6d-48ea-ae70-cfdc7c3eb114 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:31.560310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebe00e-1f6d-48ea-ae70-cfdc7c3eb114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:31.567883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-90ebe00e-1f6d-48ea-ae70-cfdc7c3eb114 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:31.567883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:31.567883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:31.567883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:31.567883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:31.567883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:31.567883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:31.567883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:31.567883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:31.567883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:31.567883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:31.567883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:31.567883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:31.567883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:31.567883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:31.567883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:31.568818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:31.568818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:31.568818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:31.568818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:31.568818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:31.568818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:31.568818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:31.568818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:31.568818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:31.568818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:31.568818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:31.568818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:31.568818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:31.568818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:31.568818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:31.568818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:31.569648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:31.569648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:31.569648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:31.569648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:31.569648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:31.569648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:31.569648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:31.569648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:31.569648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:31.569648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:31.569648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:31.569648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:31.572703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 201/409] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:19:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:31.579973 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebe00e-1f6d-48ea-ae70-cfdc7c3eb114 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:31.608512 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5380ae-fcae-49c6-bb65-0aaeac296e7b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:31.647837 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc18a0-0fdf-4e0b-893c-9ac80849fe61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:31.648492 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc18a0-0fdf-4e0b-893c-9ac80849fe61 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:31.648766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc18a0-0fdf-4e0b-893c-9ac80849fe61 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:31.649035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc18a0-0fdf-4e0b-893c-9ac80849fe61 None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:31.650144 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc18a0-0fdf-4e0b-893c-9ac80849fe61 None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:31.652215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc18a0-0fdf-4e0b-893c-9ac80849fe61 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:31.654145 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 209/410] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:31 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:31.659567 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc18a0-0fdf-4e0b-893c-9ac80849fe61 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:31.673122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:31.700941 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebe00e-1f6d-48ea-ae70-cfdc7c3eb114 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:31.771938 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:31.788360 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc18a0-0fdf-4e0b-893c-9ac80849fe61 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:31.826075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161159e-b8f3-45b5-a5ae-2a3e8f58e1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:31.827079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161159e-b8f3-45b5-a5ae-2a3e8f58e1b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:31.827603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161159e-b8f3-45b5-a5ae-2a3e8f58e1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:31.828013 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161159e-b8f3-45b5-a5ae-2a3e8f58e1b5 None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127/groups/53bbfea5cdaf4a388b206eb67798667a/roles/0e112f96840a483bb6dfeab1bb8af187` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:31.830324 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161159e-b8f3-45b5-a5ae-2a3e8f58e1b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=63e679fbf8c3498a8cc0860b3a0f5127, group_id=53bbfea5cdaf4a388b206eb67798667a, role_id=0e112f96840a483bb6dfeab1bb8af187)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:31.831316 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c83cf6-f3d1-40b2-80dc-f18dbcc49b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:31.832038 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c83cf6-f3d1-40b2-80dc-f18dbcc49b51 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:31.832404 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c83cf6-f3d1-40b2-80dc-f18dbcc49b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:31.832768 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c83cf6-f3d1-40b2-80dc-f18dbcc49b51 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:31.833451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161159e-b8f3-45b5-a5ae-2a3e8f58e1b5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:31.833605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c83cf6-f3d1-40b2-80dc-f18dbcc49b51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:31.834022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c83cf6-f3d1-40b2-80dc-f18dbcc49b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:31.835479 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c83cf6-f3d1-40b2-80dc-f18dbcc49b51 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:31.855553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 210/411] 10.222.0.71 () {58 vars in 1442 bytes} [Thu Sep 1 16:19:31 2022] PUT /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127/groups/53bbfea5cdaf4a388b206eb67798667a/roles/0e112f96840a483bb6dfeab1bb8af187 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:19:31.857797 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 202/412] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:31.863798 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161159e-b8f3-45b5-a5ae-2a3e8f58e1b5 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:31.938117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:31.975943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161159e-b8f3-45b5-a5ae-2a3e8f58e1b5 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:32.012846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa04e-5e6c-4fbe-827d-8680dc4d912f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:32.013868 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa04e-5e6c-4fbe-827d-8680dc4d912f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:32.014290 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa04e-5e6c-4fbe-827d-8680dc4d912f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:32.014722 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa04e-5e6c-4fbe-827d-8680dc4d912f None admin] PATH_INFO: `/v3/groups/320ef35ce5344e7893b746c3da7947fd` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:32.016261 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aa04e-5e6c-4fbe-827d-8680dc4d912f None admin] RBAC: Authorizing `identity:get_group(group_id=320ef35ce5344e7893b746c3da7947fd)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:32.017917 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aa04e-5e6c-4fbe-827d-8680dc4d912f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:32.019963 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 211/413] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:31 2022] GET /identity/v3/groups/320ef35ce5344e7893b746c3da7947fd => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:32.025566 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c83cf6-f3d1-40b2-80dc-f18dbcc49b51 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:32.147326 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c83cf6-f3d1-40b2-80dc-f18dbcc49b51 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:32.185747 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27059b1c-dd5e-4d4d-ac04-7991cb8c7327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:32.186790 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27059b1c-dd5e-4d4d-ac04-7991cb8c7327 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:32.187311 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27059b1c-dd5e-4d4d-ac04-7991cb8c7327 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:32.187827 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27059b1c-dd5e-4d4d-ac04-7991cb8c7327 None admin] PATH_INFO: `/v3/projects/4331680a8fba4a9c848da35bab7c3c6a` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:32.189186 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27059b1c-dd5e-4d4d-ac04-7991cb8c7327 None admin] RBAC: Authorizing `identity:get_project(project_id=4331680a8fba4a9c848da35bab7c3c6a)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:32.190916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27059b1c-dd5e-4d4d-ac04-7991cb8c7327 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:32.193075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 203/414] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:32 2022] GET /identity/v3/projects/4331680a8fba4a9c848da35bab7c3c6a => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:32.199616 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa04e-5e6c-4fbe-827d-8680dc4d912f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:32.334396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa04e-5e6c-4fbe-827d-8680dc4d912f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:32.379412 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7646cf-515b-4b5d-9bf5-e877def245e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:32.380523 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7646cf-515b-4b5d-9bf5-e877def245e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:32.380998 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7646cf-515b-4b5d-9bf5-e877def245e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:32.381505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7646cf-515b-4b5d-9bf5-e877def245e0 None admin] PATH_INFO: `/v3/projects/4331680a8fba4a9c848da35bab7c3c6a/groups/320ef35ce5344e7893b746c3da7947fd/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:32.383707 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7646cf-515b-4b5d-9bf5-e877def245e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4331680a8fba4a9c848da35bab7c3c6a, group_id=320ef35ce5344e7893b746c3da7947fd, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:32.385361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7646cf-515b-4b5d-9bf5-e877def245e0 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:32.390285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:32.402983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 212/415] 10.222.0.71 () {58 vars in 1442 bytes} [Thu Sep 1 16:19:32 2022] PUT /identity/v3/projects/4331680a8fba4a9c848da35bab7c3c6a/groups/320ef35ce5344e7893b746c3da7947fd/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:19:32.534661 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4983536-c29f-466e-88ba-f9984dfcd2fc None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:32.535709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4983536-c29f-466e-88ba-f9984dfcd2fc None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:32.536183 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4983536-c29f-466e-88ba-f9984dfcd2fc None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:32.538115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 204/416] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:32.543751 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f4204-1a18-43f2-8435-932077c0c4fc None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:32.544051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f4204-1a18-43f2-8435-932077c0c4fc None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:32.544310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f4204-1a18-43f2-8435-932077c0c4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:32.578722 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-322f4204-1a18-43f2-8435-932077c0c4fc None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:32.581634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-322f4204-1a18-43f2-8435-932077c0c4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:32.631858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057d2a1-119f-4a98-aec3-f30a0273d01c None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:32.632249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057d2a1-119f-4a98-aec3-f30a0273d01c None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:32.632730 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057d2a1-119f-4a98-aec3-f30a0273d01c None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:32.634408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 205/417] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:32.640769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dc004-100f-4e8c-b8fd-5b481e65bbd4 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:32.641052 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dc004-100f-4e8c-b8fd-5b481e65bbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:32.641324 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dc004-100f-4e8c-b8fd-5b481e65bbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:32.663170 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-ef1dc004-100f-4e8c-b8fd-5b481e65bbd4 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:32.664624 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ef1dc004-100f-4e8c-b8fd-5b481e65bbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:32.673674 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 213/418] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:32.731987 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:32.751006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 206/419] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:32.963462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f4204-1a18-43f2-8435-932077c0c4fc None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:33.095269 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f4204-1a18-43f2-8435-932077c0c4fc None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:33.136757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:33.146256 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1054cec-cf17-4611-b520-c600164a789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:33.147367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1054cec-cf17-4611-b520-c600164a789c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:33.148074 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1054cec-cf17-4611-b520-c600164a789c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:33.148348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1054cec-cf17-4611-b520-c600164a789c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:33.149950 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dc004-100f-4e8c-b8fd-5b481e65bbd4 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:33.167530 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1054cec-cf17-4611-b520-c600164a789c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:33.172462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-a1054cec-cf17-4611-b520-c600164a789c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:33.172462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:33.172462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:33.172462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:33.172462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:33.172462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:33.172462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:33.172462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:33.172462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:33.172462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:33.172462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:33.172462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:33.172462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:33.172462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:33.172462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:33.172462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:33.173422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:33.173422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:33.173422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:33.173422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:33.173422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:33.173422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:33.173422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:33.173422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:33.173422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:33.173422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:33.173422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:33.173422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:33.173422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:33.173422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:33.173422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:33.173422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:33.174642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:33.174642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:33.174642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:33.174642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:33.174642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:33.174642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:33.174642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:33.174642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:33.174642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:33.174642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:33.174642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:33.174642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:33.174642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 214/420] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:33.179410 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1054cec-cf17-4611-b520-c600164a789c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:33.253833 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dc004-100f-4e8c-b8fd-5b481e65bbd4 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:33.290943 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599163b4-7266-4334-8f85-d2402f1439d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:33.291573 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599163b4-7266-4334-8f85-d2402f1439d5 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:33.291876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599163b4-7266-4334-8f85-d2402f1439d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:33.292667 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599163b4-7266-4334-8f85-d2402f1439d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:33.316224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599163b4-7266-4334-8f85-d2402f1439d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:33.321099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-599163b4-7266-4334-8f85-d2402f1439d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:33.321099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:33.321099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:33.321099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:33.321099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:33.321099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:33.321099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:33.321099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:33.321099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:33.321099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:33.321099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:33.321099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:33.321099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:33.321099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:33.321099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:33.321099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:33.321982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:33.321982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:33.321982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:33.321982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:33.321982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:33.321982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:33.321982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:33.321982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:33.321982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:33.321982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:33.321982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:33.321982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:33.321982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:33.321982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:33.321982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:33.321982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:33.322835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:33.322835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:33.322835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:33.322835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:33.322835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:33.322835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:33.322835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:33.322835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:33.322835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:33.322835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:33.322835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:33.322835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:33.330954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 207/421] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:33.334020 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599163b4-7266-4334-8f85-d2402f1439d5 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:33.375159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1054cec-cf17-4611-b520-c600164a789c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:33.416496 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:33.463081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f94463-f733-4b78-8315-5ca185c828ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:33.464215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f94463-f733-4b78-8315-5ca185c828ae None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:33.464494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f94463-f733-4b78-8315-5ca185c828ae None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:33.464763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f94463-f733-4b78-8315-5ca185c828ae None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:33.465430 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f94463-f733-4b78-8315-5ca185c828ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:33.465727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f94463-f733-4b78-8315-5ca185c828ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:33.467114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f94463-f733-4b78-8315-5ca185c828ae None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:33.473870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599163b4-7266-4334-8f85-d2402f1439d5 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:33.485907 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 215/422] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:33.491251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f94463-f733-4b78-8315-5ca185c828ae None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:33.508999 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c125c-f003-4f4f-bb58-b635d7e14c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:33.509531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c125c-f003-4f4f-bb58-b635d7e14c9a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:33.509802 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c125c-f003-4f4f-bb58-b635d7e14c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:33.510065 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c125c-f003-4f4f-bb58-b635d7e14c9a None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:33.510773 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c125c-f003-4f4f-bb58-b635d7e14c9a None admin] RBAC: Adding query filter params (name=member) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:33.511075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c125c-f003-4f4f-bb58-b635d7e14c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:33.512439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c125c-f003-4f4f-bb58-b635d7e14c9a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:33.521230 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 208/423] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:33.527118 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c125c-f003-4f4f-bb58-b635d7e14c9a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:33.597903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:33.630331 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c125c-f003-4f4f-bb58-b635d7e14c9a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:33.638232 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:33.670268 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84eaca-fb66-4d69-9452-850d5b5749bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:33.671176 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84eaca-fb66-4d69-9452-850d5b5749bf None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:33.671593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84eaca-fb66-4d69-9452-850d5b5749bf None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:33.672783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84eaca-fb66-4d69-9452-850d5b5749bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:33.703927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f94463-f733-4b78-8315-5ca185c828ae None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:33.779882 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b332eda-34ef-4a1d-be25-8a10adb0a0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:33.780786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b332eda-34ef-4a1d-be25-8a10adb0a0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:33.781205 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b332eda-34ef-4a1d-be25-8a10adb0a0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:33.781654 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b332eda-34ef-4a1d-be25-8a10adb0a0f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:33.805534 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84eaca-fb66-4d69-9452-850d5b5749bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:33.807913 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84eaca-fb66-4d69-9452-850d5b5749bf None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:33.918970 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b332eda-34ef-4a1d-be25-8a10adb0a0f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:33.920718 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b332eda-34ef-4a1d-be25-8a10adb0a0f0 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:33.978703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 209/424] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:19:33.978703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45366f2-758f-4972-98e3-a1c8895a8a8d None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:33.978703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45366f2-758f-4972-98e3-a1c8895a8a8d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:33.978703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45366f2-758f-4972-98e3-a1c8895a8a8d None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:33.979142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:33.982686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 210/425] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:33.985589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45366f2-758f-4972-98e3-a1c8895a8a8d None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:33.998932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:34.030243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 216/426] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:19:34.031706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520064bb-53fd-4542-ba32-5717cc7bbaac None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.032151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520064bb-53fd-4542-ba32-5717cc7bbaac None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.032570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520064bb-53fd-4542-ba32-5717cc7bbaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.054369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-520064bb-53fd-4542-ba32-5717cc7bbaac None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:34.055861 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-520064bb-53fd-4542-ba32-5717cc7bbaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:34.112267 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45366f2-758f-4972-98e3-a1c8895a8a8d None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:34.141618 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 217/427] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:34.142471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520064bb-53fd-4542-ba32-5717cc7bbaac None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:34.158326 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5711d-2d24-4185-b850-1813950ac9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:34.159038 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5711d-2d24-4185-b850-1813950ac9aa None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.159318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5711d-2d24-4185-b850-1813950ac9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.159604 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5711d-2d24-4185-b850-1813950ac9aa None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.160792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5711d-2d24-4185-b850-1813950ac9aa None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:34.162273 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5711d-2d24-4185-b850-1813950ac9aa None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:34.164008 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 211/428] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:33 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:34.169394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5711d-2d24-4185-b850-1813950ac9aa None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:34.259002 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:34.270427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:34.275946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520064bb-53fd-4542-ba32-5717cc7bbaac None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:34.302455 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5711d-2d24-4185-b850-1813950ac9aa None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:34.320799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d71da4-1edf-4967-a604-30986d9d40e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:34.321782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d71da4-1edf-4967-a604-30986d9d40e2 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.322456 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d71da4-1edf-4967-a604-30986d9d40e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.322904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d71da4-1edf-4967-a604-30986d9d40e2 None admin] PATH_INFO: `/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.324569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d71da4-1edf-4967-a604-30986d9d40e2 None admin] RBAC: Authorizing `identity:get_project(project_id=cf4f1224bb02437e83d0ac7973ab2f2f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:34.326801 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d71da4-1edf-4967-a604-30986d9d40e2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:34.329816 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 218/429] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:34 2022] GET /identity/v3/projects/cf4f1224bb02437e83d0ac7973ab2f2f => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:34.331130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c4e8e-86a5-470b-bd39-4cab1d786478 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.331563 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c4e8e-86a5-470b-bd39-4cab1d786478 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.331967 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c4e8e-86a5-470b-bd39-4cab1d786478 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.337576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 219/430] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:34.337576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c4e8e-86a5-470b-bd39-4cab1d786478 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:34.355731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c881e0-a165-45c4-9b71-057129a2ccad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:34.356771 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c881e0-a165-45c4-9b71-057129a2ccad None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.357248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c881e0-a165-45c4-9b71-057129a2ccad None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.357797 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c881e0-a165-45c4-9b71-057129a2ccad None admin] PATH_INFO: `/v3/groups/53bbfea5cdaf4a388b206eb67798667a` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.359149 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c881e0-a165-45c4-9b71-057129a2ccad None admin] RBAC: Authorizing `identity:get_group(group_id=53bbfea5cdaf4a388b206eb67798667a)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:34.360894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c881e0-a165-45c4-9b71-057129a2ccad None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:34.362696 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 212/431] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:34 2022] GET /identity/v3/groups/53bbfea5cdaf4a388b206eb67798667a => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:34.364150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69881d5-cc5a-4dd0-8d7b-ce059e3f52b6 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.364645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69881d5-cc5a-4dd0-8d7b-ce059e3f52b6 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.365104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69881d5-cc5a-4dd0-8d7b-ce059e3f52b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.384978 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-b69881d5-cc5a-4dd0-8d7b-ce059e3f52b6 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:34.387182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b69881d5-cc5a-4dd0-8d7b-ce059e3f52b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:34.446961 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c4e8e-86a5-470b-bd39-4cab1d786478 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:34.462691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 213/432] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:34.462691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69881d5-cc5a-4dd0-8d7b-ce059e3f52b6 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:34.482709 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2ec8e-7185-4460-a434-06769367d34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:34.483395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2ec8e-7185-4460-a434-06769367d34f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.483678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2ec8e-7185-4460-a434-06769367d34f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.483948 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2ec8e-7185-4460-a434-06769367d34f None admin] PATH_INFO: `/v3/groups/53bbfea5cdaf4a388b206eb67798667a` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.485063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2ec8e-7185-4460-a434-06769367d34f None admin] RBAC: Authorizing `identity:get_group(group_id=53bbfea5cdaf4a388b206eb67798667a)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:34.486477 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2ec8e-7185-4460-a434-06769367d34f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:34.493026 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 220/433] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:34 2022] GET /identity/v3/groups/53bbfea5cdaf4a388b206eb67798667a => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:34.493828 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2ec8e-7185-4460-a434-06769367d34f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:34.509129 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:34.541742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:34.577203 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69881d5-cc5a-4dd0-8d7b-ce059e3f52b6 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:34.596392 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2ec8e-7185-4460-a434-06769367d34f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:34.614594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13f5e2-a872-40d5-838c-36f0dbe31406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:34.615505 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13f5e2-a872-40d5-838c-36f0dbe31406 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.615965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13f5e2-a872-40d5-838c-36f0dbe31406 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.616389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13f5e2-a872-40d5-838c-36f0dbe31406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.617360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13f5e2-a872-40d5-838c-36f0dbe31406 None admin] RBAC: Adding query filter params (group.id=53bbfea5cdaf4a388b206eb67798667a, role.id=8b655a66d879422db1b56ca98d77e490, scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:34.617913 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13f5e2-a872-40d5-838c-36f0dbe31406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:34.619517 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13f5e2-a872-40d5-838c-36f0dbe31406 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:34.627841 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 214/434] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:34 2022] GET /identity/v3/role_assignments?group.id=53bbfea5cdaf4a388b206eb67798667a&scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f&role.id=8b655a66d879422db1b56ca98d77e490 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:34.628920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13f5e2-a872-40d5-838c-36f0dbe31406 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:34.657459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171080b-f410-4ada-9c83-4d6906a5321c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:34.658103 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171080b-f410-4ada-9c83-4d6906a5321c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.658395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171080b-f410-4ada-9c83-4d6906a5321c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.658671 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171080b-f410-4ada-9c83-4d6906a5321c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.680470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171080b-f410-4ada-9c83-4d6906a5321c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:34.691760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-2171080b-f410-4ada-9c83-4d6906a5321c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:34.691760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:34.691760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:34.691760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:34.691760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:34.691760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:34.691760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:34.691760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:34.691760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:34.691760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:34.691760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:34.691760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:34.691760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:34.691760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:34.691760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:34.691760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:34.692983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:34.692983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:34.692983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:34.692983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:34.692983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:34.692983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:34.692983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:34.692983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:34.692983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:34.692983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:34.692983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:34.692983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:34.692983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:34.692983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:34.692983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:34.692983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:34.693949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:34.693949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:34.693949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:34.693949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:34.693949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:34.693949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:34.693949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:34.693949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:34.693949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:34.693949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:34.693949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:34.693949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:34.693949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 221/435] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:34.700392 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171080b-f410-4ada-9c83-4d6906a5321c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:34.749665 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13f5e2-a872-40d5-838c-36f0dbe31406 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:34.789587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c840dca-5c3d-4db6-a2f2-84a33f0a6617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:34.790303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c840dca-5c3d-4db6-a2f2-84a33f0a6617 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.790577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c840dca-5c3d-4db6-a2f2-84a33f0a6617 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.790958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c840dca-5c3d-4db6-a2f2-84a33f0a6617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.791702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c840dca-5c3d-4db6-a2f2-84a33f0a6617 None admin] RBAC: Adding query filter params (group.id=53bbfea5cdaf4a388b206eb67798667a, role.id=0e112f96840a483bb6dfeab1bb8af187, scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:34.792066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c840dca-5c3d-4db6-a2f2-84a33f0a6617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:34.793574 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c840dca-5c3d-4db6-a2f2-84a33f0a6617 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:34.797025 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:34.801970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 215/436] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:34 2022] GET /identity/v3/role_assignments?group.id=53bbfea5cdaf4a388b206eb67798667a&scope.project.id=cf4f1224bb02437e83d0ac7973ab2f2f&role.id=0e112f96840a483bb6dfeab1bb8af187 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:34.802950 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c840dca-5c3d-4db6-a2f2-84a33f0a6617 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:34.811628 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:34.852310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171080b-f410-4ada-9c83-4d6906a5321c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:34.899530 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f18a47-55bc-4778-b2bf-e4e5be2d307d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:34.900158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f18a47-55bc-4778-b2bf-e4e5be2d307d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.900435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f18a47-55bc-4778-b2bf-e4e5be2d307d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.900707 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f18a47-55bc-4778-b2bf-e4e5be2d307d None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.901420 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f18a47-55bc-4778-b2bf-e4e5be2d307d None admin] RBAC: Adding query filter params (name=member) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:34.901726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f18a47-55bc-4778-b2bf-e4e5be2d307d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:34.903266 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f18a47-55bc-4778-b2bf-e4e5be2d307d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:34.912193 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 222/437] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:34.913629 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18b035-fe9b-45c9-9a4b-d90d3f9348fc None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.913920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18b035-fe9b-45c9-9a4b-d90d3f9348fc None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.914192 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18b035-fe9b-45c9-9a4b-d90d3f9348fc None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.915779 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 223/438] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:34.922411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee428f-e91d-4ca4-ab99-f2b88326a1e9 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.922714 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee428f-e91d-4ca4-ab99-f2b88326a1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.922987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee428f-e91d-4ca4-ab99-f2b88326a1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.931713 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c840dca-5c3d-4db6-a2f2-84a33f0a6617 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:34.946836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1cee428f-e91d-4ca4-ab99-f2b88326a1e9 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:34.946836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1cee428f-e91d-4ca4-ab99-f2b88326a1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:34.977219 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1168ca1-b942-40cf-b057-531f7275d301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:34.977959 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1168ca1-b942-40cf-b057-531f7275d301 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.978133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1168ca1-b942-40cf-b057-531f7275d301 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.978406 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1168ca1-b942-40cf-b057-531f7275d301 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.989760 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1168ca1-b942-40cf-b057-531f7275d301 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:34.995762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-d1168ca1-b942-40cf-b057-531f7275d301 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:34.995762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:34.995762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:34.995762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:34.995762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:34.995762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:34.995762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:34.995762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:34.995762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:34.995762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:34.995762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:34.995762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:34.995762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:34.995762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:34.995762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:34.995762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:34.996663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:34.996663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:34.996663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:34.996663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:34.996663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:34.996663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:34.996663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:34.996663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:34.996663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:34.996663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:34.996663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:34.996663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:34.996663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:34.996663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:34.996663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:34.996663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:34.997480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:34.997480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:34.997480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:34.997480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:34.997480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:34.997480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:34.997480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:34.997480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:34.997480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:34.997480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:34.997480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:34.997480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:34.997480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 216/439] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:34.999674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1168ca1-b942-40cf-b057-531f7275d301 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:35.036022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 224/440] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:35.037353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee428f-e91d-4ca4-ab99-f2b88326a1e9 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:35.068001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:35.120625 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1168ca1-b942-40cf-b057-531f7275d301 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:35.121374 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:35.163400 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed006220-8e9f-4290-a6c4-8a78499bdfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:35.164047 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006220-8e9f-4290-a6c4-8a78499bdfb9 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:35.164417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006220-8e9f-4290-a6c4-8a78499bdfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:35.164696 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006220-8e9f-4290-a6c4-8a78499bdfb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:35.169430 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee428f-e91d-4ca4-ab99-f2b88326a1e9 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:35.209758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06faeb-3dbd-49ca-8602-5c42bc8cad6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:35.210531 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06faeb-3dbd-49ca-8602-5c42bc8cad6a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:35.210914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06faeb-3dbd-49ca-8602-5c42bc8cad6a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:35.211179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06faeb-3dbd-49ca-8602-5c42bc8cad6a None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:35.211838 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06faeb-3dbd-49ca-8602-5c42bc8cad6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:35.212871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06faeb-3dbd-49ca-8602-5c42bc8cad6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:35.213475 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06faeb-3dbd-49ca-8602-5c42bc8cad6a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:35.222919 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 225/441] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:35.228243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06faeb-3dbd-49ca-8602-5c42bc8cad6a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:35.255114 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed006220-8e9f-4290-a6c4-8a78499bdfb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:35.256935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed006220-8e9f-4290-a6c4-8a78499bdfb9 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:35.333090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:35.347961 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06faeb-3dbd-49ca-8602-5c42bc8cad6a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:35.378985 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:35.382703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 217/442] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:35.382871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed006220-8e9f-4290-a6c4-8a78499bdfb9 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:35.390767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8c79c-9227-43bc-9ce0-8e3a3d81596c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:35.391535 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8c79c-9227-43bc-9ce0-8e3a3d81596c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:35.391650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8c79c-9227-43bc-9ce0-8e3a3d81596c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:35.391907 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8c79c-9227-43bc-9ce0-8e3a3d81596c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:35.468753 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8c79c-9227-43bc-9ce0-8e3a3d81596c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:35.470182 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8c79c-9227-43bc-9ce0-8e3a3d81596c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:35.488045 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed006220-8e9f-4290-a6c4-8a78499bdfb9 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:35.520532 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac197b05-e4b0-4f7e-aa6b-ab8f20506a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:35.521144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac197b05-e4b0-4f7e-aa6b-ab8f20506a7e None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:35.521422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac197b05-e4b0-4f7e-aa6b-ab8f20506a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:35.521690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac197b05-e4b0-4f7e-aa6b-ab8f20506a7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:35.532250 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac197b05-e4b0-4f7e-aa6b-ab8f20506a7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:35.537035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-ac197b05-e4b0-4f7e-aa6b-ab8f20506a7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:35.537035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:35.537035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:35.537035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:35.537035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:35.537035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:35.537035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:35.537035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:35.537035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:35.537035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:35.537035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:35.537035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:35.537035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:35.537035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:35.537035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:35.537035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:35.538110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:35.538110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:35.538110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:35.538110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:35.538110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:35.538110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:35.538110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:35.538110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:35.538110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:35.538110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:35.538110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:35.538110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:35.538110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:35.538110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:35.538110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:35.538110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:35.539319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:35.539319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:35.539319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:35.539319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:35.539319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:35.539319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:35.539319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:35.539319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:35.539319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:35.539319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:35.539319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:35.539319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:35.539319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 218/443] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:19:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:35.539319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac197b05-e4b0-4f7e-aa6b-ab8f20506a7e None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:35.560440 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:35.570650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 226/444] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:19:35.571476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8c79c-9227-43bc-9ce0-8e3a3d81596c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:35.598464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:35.641172 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac197b05-e4b0-4f7e-aa6b-ab8f20506a7e None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:35.670581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8c79c-9227-43bc-9ce0-8e3a3d81596c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:35.674893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990bb9e-32c2-445d-b7ee-808ad34191c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:35.675509 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990bb9e-32c2-445d-b7ee-808ad34191c8 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:35.675782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990bb9e-32c2-445d-b7ee-808ad34191c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:35.676047 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990bb9e-32c2-445d-b7ee-808ad34191c8 None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:35.677149 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990bb9e-32c2-445d-b7ee-808ad34191c8 None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:35.678554 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990bb9e-32c2-445d-b7ee-808ad34191c8 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:35.680179 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 219/445] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:35 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:35.680925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990bb9e-32c2-445d-b7ee-808ad34191c8 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:35.703395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c01319-177f-472d-b2e1-bc1e3798cd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:35.703989 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c01319-177f-472d-b2e1-bc1e3798cd39 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:35.704260 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c01319-177f-472d-b2e1-bc1e3798cd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:35.704522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c01319-177f-472d-b2e1-bc1e3798cd39 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:35.705169 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c01319-177f-472d-b2e1-bc1e3798cd39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:35.705464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c01319-177f-472d-b2e1-bc1e3798cd39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:35.706827 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c01319-177f-472d-b2e1-bc1e3798cd39 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:35.715265 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 227/446] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:35.716016 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c01319-177f-472d-b2e1-bc1e3798cd39 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:35.769752 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:35.783070 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990bb9e-32c2-445d-b7ee-808ad34191c8 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:35.808790 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:35.816685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dcaed-8116-4e98-8df6-e6b4e48ce572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:35.817306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dcaed-8116-4e98-8df6-e6b4e48ce572 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:35.817579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dcaed-8116-4e98-8df6-e6b4e48ce572 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:35.817844 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dcaed-8116-4e98-8df6-e6b4e48ce572 None admin] PATH_INFO: `/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:35.818981 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131dcaed-8116-4e98-8df6-e6b4e48ce572 None admin] RBAC: Authorizing `identity:get_project(project_id=63e679fbf8c3498a8cc0860b3a0f5127)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:35.819096 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c01319-177f-472d-b2e1-bc1e3798cd39 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:35.820385 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131dcaed-8116-4e98-8df6-e6b4e48ce572 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:35.821971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 220/447] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:35 2022] GET /identity/v3/projects/63e679fbf8c3498a8cc0860b3a0f5127 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:35.822746 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dcaed-8116-4e98-8df6-e6b4e48ce572 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:35.852315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299ebed-e383-45e6-8c7b-8dee69f67470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:35.852936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299ebed-e383-45e6-8c7b-8dee69f67470 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:35.853212 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299ebed-e383-45e6-8c7b-8dee69f67470 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:35.853491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299ebed-e383-45e6-8c7b-8dee69f67470 None admin] PATH_INFO: `/v3/groups/53bbfea5cdaf4a388b206eb67798667a` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:35.855217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299ebed-e383-45e6-8c7b-8dee69f67470 None admin] RBAC: Authorizing `identity:get_group(group_id=53bbfea5cdaf4a388b206eb67798667a)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:35.856643 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299ebed-e383-45e6-8c7b-8dee69f67470 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:35.858334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 228/448] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:35 2022] GET /identity/v3/groups/53bbfea5cdaf4a388b206eb67798667a => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:35.858962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299ebed-e383-45e6-8c7b-8dee69f67470 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:35.928811 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dcaed-8116-4e98-8df6-e6b4e48ce572 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:35.956777 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299ebed-e383-45e6-8c7b-8dee69f67470 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:35.962388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6096e-cc3d-44bb-b830-18d6d1f55d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:35.963044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6096e-cc3d-44bb-b830-18d6d1f55d3e None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:35.963332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6096e-cc3d-44bb-b830-18d6d1f55d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:35.963595 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6096e-cc3d-44bb-b830-18d6d1f55d3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:35.988636 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:35.990261 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b211a-e2fd-4758-b681-435f8121df5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:35.991041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b211a-e2fd-4758-b681-435f8121df5a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:35.991322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b211a-e2fd-4758-b681-435f8121df5a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:35.991620 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b211a-e2fd-4758-b681-435f8121df5a None admin] PATH_INFO: `/v3/groups/53bbfea5cdaf4a388b206eb67798667a` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:35.992770 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b211a-e2fd-4758-b681-435f8121df5a None admin] RBAC: Authorizing `identity:get_group(group_id=53bbfea5cdaf4a388b206eb67798667a)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:35.994178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b211a-e2fd-4758-b681-435f8121df5a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:35.996322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 229/449] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:35 2022] GET /identity/v3/groups/53bbfea5cdaf4a388b206eb67798667a => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:35.997077 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b211a-e2fd-4758-b681-435f8121df5a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:36.025271 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:36.032324 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6096e-cc3d-44bb-b830-18d6d1f55d3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:36.033777 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6096e-cc3d-44bb-b830-18d6d1f55d3e None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:36.096221 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b211a-e2fd-4758-b681-435f8121df5a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:36.127854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9107c-eba3-4c42-b45d-1f75cd22749a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:36.128436 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9107c-eba3-4c42-b45d-1f75cd22749a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:36.128710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9107c-eba3-4c42-b45d-1f75cd22749a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:36.128972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9107c-eba3-4c42-b45d-1f75cd22749a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:36.129680 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9107c-eba3-4c42-b45d-1f75cd22749a None admin] RBAC: Adding query filter params (group.id=53bbfea5cdaf4a388b206eb67798667a, role.id=8b655a66d879422db1b56ca98d77e490, scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:36.129849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 221/450] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:36.130022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9107c-eba3-4c42-b45d-1f75cd22749a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:36.130648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6096e-cc3d-44bb-b830-18d6d1f55d3e None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:36.131547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9107c-eba3-4c42-b45d-1f75cd22749a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:36.139859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 230/451] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:35 2022] GET /identity/v3/role_assignments?group.id=53bbfea5cdaf4a388b206eb67798667a&scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127&role.id=8b655a66d879422db1b56ca98d77e490 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:36.140988 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9107c-eba3-4c42-b45d-1f75cd22749a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:36.194360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:36.242034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6096e-cc3d-44bb-b830-18d6d1f55d3e None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:36.251611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:36.264134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9107c-eba3-4c42-b45d-1f75cd22749a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:36.293975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464f1e5-c562-4f9f-8563-cef058232a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:36.294576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464f1e5-c562-4f9f-8563-cef058232a5a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:36.294885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464f1e5-c562-4f9f-8563-cef058232a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:36.295150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464f1e5-c562-4f9f-8563-cef058232a5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:36.295872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464f1e5-c562-4f9f-8563-cef058232a5a None admin] RBAC: Adding query filter params (group.id=53bbfea5cdaf4a388b206eb67798667a, role.id=0e112f96840a483bb6dfeab1bb8af187, scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:36.296866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464f1e5-c562-4f9f-8563-cef058232a5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:36.297627 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464f1e5-c562-4f9f-8563-cef058232a5a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:36.300243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ee755-7319-432f-beb5-cb22fe863288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:36.300865 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ee755-7319-432f-beb5-cb22fe863288 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:36.301139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ee755-7319-432f-beb5-cb22fe863288 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:36.301406 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ee755-7319-432f-beb5-cb22fe863288 None admin] PATH_INFO: `/v3/projects/4331680a8fba4a9c848da35bab7c3c6a` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:36.304686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 222/452] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:36 2022] GET /identity/v3/role_assignments?group.id=53bbfea5cdaf4a388b206eb67798667a&scope.project.id=63e679fbf8c3498a8cc0860b3a0f5127&role.id=0e112f96840a483bb6dfeab1bb8af187 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:36.305068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ee755-7319-432f-beb5-cb22fe863288 None admin] RBAC: Authorizing `identity:get_project(project_id=4331680a8fba4a9c848da35bab7c3c6a)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:36.306479 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ee755-7319-432f-beb5-cb22fe863288 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:36.308693 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 231/453] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:36 2022] GET /identity/v3/projects/4331680a8fba4a9c848da35bab7c3c6a => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:36.314734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464f1e5-c562-4f9f-8563-cef058232a5a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:36.433578 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464f1e5-c562-4f9f-8563-cef058232a5a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:36.455757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:36.471389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24683d6e-39f9-472b-a4d4-1eea105a0fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:36.472027 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24683d6e-39f9-472b-a4d4-1eea105a0fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:36.472309 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24683d6e-39f9-472b-a4d4-1eea105a0fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:36.472586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24683d6e-39f9-472b-a4d4-1eea105a0fc4 None admin] PATH_INFO: `/v3/groups/320ef35ce5344e7893b746c3da7947fd` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:36.473759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24683d6e-39f9-472b-a4d4-1eea105a0fc4 None admin] RBAC: Authorizing `identity:get_group(group_id=320ef35ce5344e7893b746c3da7947fd)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:36.475296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24683d6e-39f9-472b-a4d4-1eea105a0fc4 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:36.477158 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 223/454] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:36 2022] GET /identity/v3/groups/320ef35ce5344e7893b746c3da7947fd => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:36.482981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ee755-7319-432f-beb5-cb22fe863288 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:36.587322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ee755-7319-432f-beb5-cb22fe863288 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:36.624768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc94a3-8b90-4757-962c-e84a40f7eda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:36.625384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc94a3-8b90-4757-962c-e84a40f7eda0 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:36.625665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc94a3-8b90-4757-962c-e84a40f7eda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:36.625939 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc94a3-8b90-4757-962c-e84a40f7eda0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:36.626706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc94a3-8b90-4757-962c-e84a40f7eda0 None admin] RBAC: Adding query filter params (group.id=320ef35ce5344e7893b746c3da7947fd, role.id=3cd61239237441418529e9028ef801e4, scope.project.id=4331680a8fba4a9c848da35bab7c3c6a) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:36.627019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc94a3-8b90-4757-962c-e84a40f7eda0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:36.628464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc94a3-8b90-4757-962c-e84a40f7eda0 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:36.635204 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 232/455] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:36 2022] GET /identity/v3/role_assignments?group.id=320ef35ce5344e7893b746c3da7947fd&scope.project.id=4331680a8fba4a9c848da35bab7c3c6a&role.id=3cd61239237441418529e9028ef801e4 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:38.859650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323d4b2-87c0-497b-b32b-7742081369ec None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:38.860155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323d4b2-87c0-497b-b32b-7742081369ec None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:38.860261 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323d4b2-87c0-497b-b32b-7742081369ec None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:38.861787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 224/456] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:38.866917 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c0eb8-138c-4521-8028-e6e2be147644 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:38.867316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c0eb8-138c-4521-8028-e6e2be147644 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:38.867481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c0eb8-138c-4521-8028-e6e2be147644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:38.892091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-229c0eb8-138c-4521-8028-e6e2be147644 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:38.893197 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-229c0eb8-138c-4521-8028-e6e2be147644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:38.920702 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:38.984827 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 233/457] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:39.374786 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323d4b2-87c0-497b-b32b-7742081369ec None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:39.444514 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a73cb-8d76-4488-a306-173c560f80b3 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:39.444861 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a73cb-8d76-4488-a306-173c560f80b3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:39.445119 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a73cb-8d76-4488-a306-173c560f80b3 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:39.446913 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 234/458] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:39.453507 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a42b58-817d-47c0-991c-5fa74483aa66 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:39.453798 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a42b58-817d-47c0-991c-5fa74483aa66 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:39.454051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a42b58-817d-47c0-991c-5fa74483aa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:39.477889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-37a42b58-817d-47c0-991c-5fa74483aa66 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:39.479101 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-37a42b58-817d-47c0-991c-5fa74483aa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:39.507096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323d4b2-87c0-497b-b32b-7742081369ec None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:39.549087 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3463e-53ea-43ff-990e-ca3dd97d0ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:39.550003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3463e-53ea-43ff-990e-ca3dd97d0ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:39.550287 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3463e-53ea-43ff-990e-ca3dd97d0ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:39.550562 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3463e-53ea-43ff-990e-ca3dd97d0ae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:39.560132 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 235/459] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:39.561457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a70a8-8bc4-48a8-ac7c-d22300f07a72 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:39.561741 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a70a8-8bc4-48a8-ac7c-d22300f07a72 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:39.562011 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a70a8-8bc4-48a8-ac7c-d22300f07a72 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:39.563512 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 236/460] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:39.564276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3463e-53ea-43ff-990e-ca3dd97d0ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:39.565803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3463e-53ea-43ff-990e-ca3dd97d0ae6 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:39.568694 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41e388-6fa7-43fa-aeb3-642c5cd381a8 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:39.568981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41e388-6fa7-43fa-aeb3-642c5cd381a8 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:39.569250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41e388-6fa7-43fa-aeb3-642c5cd381a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:39.584075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-49c3463e-53ea-43ff-990e-ca3dd97d0ae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:39.584075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:39.584075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:39.584075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:39.584075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:39.584075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:39.584075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:39.584075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:39.584075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:39.584075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:39.584075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:39.584075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:39.584075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:39.584075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:39.584075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:39.584075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:39.585001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:39.585001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:39.585001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:39.585001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:39.585001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:39.585001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:39.585001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:39.585001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:39.585001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:39.585001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:39.585001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:39.585001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:39.585001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:39.585001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:39.585001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:39.585001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:39.585001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:39.585851 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:39.585851 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:39.585851 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:39.585851 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 225/461] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:39.591723 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ca41e388-6fa7-43fa-aeb3-642c5cd381a8 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:39.591938 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3463e-53ea-43ff-990e-ca3dd97d0ae6 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:39.593266 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ca41e388-6fa7-43fa-aeb3-642c5cd381a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:39.640431 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:39.704803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3463e-53ea-43ff-990e-ca3dd97d0ae6 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:39.716420 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 237/462] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:39.735342 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94566779-f6a4-4afe-bfcb-5a7e9c3f7ea3 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:39.735631 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94566779-f6a4-4afe-bfcb-5a7e9c3f7ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:39.735890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94566779-f6a4-4afe-bfcb-5a7e9c3f7ea3 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:39.737458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 238/463] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:39.742683 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86828da5-49ee-46a8-8ae4-149474a5810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:39.743106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68259726-c745-4e88-8419-537204c9b92b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:39.743279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86828da5-49ee-46a8-8ae4-149474a5810d None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:39.743390 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68259726-c745-4e88-8419-537204c9b92b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:39.743561 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86828da5-49ee-46a8-8ae4-149474a5810d None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:39.743650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68259726-c745-4e88-8419-537204c9b92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:39.743822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86828da5-49ee-46a8-8ae4-149474a5810d None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:39.744469 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86828da5-49ee-46a8-8ae4-149474a5810d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:39.744831 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86828da5-49ee-46a8-8ae4-149474a5810d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:39.746893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86828da5-49ee-46a8-8ae4-149474a5810d None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:39.764782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 226/464] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:39.766042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86828da5-49ee-46a8-8ae4-149474a5810d None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:39.777622 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-68259726-c745-4e88-8419-537204c9b92b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:39.778824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-68259726-c745-4e88-8419-537204c9b92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:39.786679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:39.874923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:39.878420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86828da5-49ee-46a8-8ae4-149474a5810d None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:39.892261 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 239/465] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:39.915639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390ac2d-601f-42de-8948-20fa01be5979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:39.916480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390ac2d-601f-42de-8948-20fa01be5979 None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:39.917419 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390ac2d-601f-42de-8948-20fa01be5979 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:39.917843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390ac2d-601f-42de-8948-20fa01be5979 None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:39.918653 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390ac2d-601f-42de-8948-20fa01be5979 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:39.920276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390ac2d-601f-42de-8948-20fa01be5979 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:39.944455 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 227/466] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:19:39 2022] POST /identity/v3/users => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:19:40.048724 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68259726-c745-4e88-8419-537204c9b92b None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:40.056463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390ac2d-601f-42de-8948-20fa01be5979 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:40.196461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68259726-c745-4e88-8419-537204c9b92b None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:40.202407 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390ac2d-601f-42de-8948-20fa01be5979 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:40.233128 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e8de5-ae3e-4c78-8814-5a067caf6ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:40.233766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e8de5-ae3e-4c78-8814-5a067caf6ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:40.234047 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e8de5-ae3e-4c78-8814-5a067caf6ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:40.234311 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e8de5-ae3e-4c78-8814-5a067caf6ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:40.240683 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c8c44-a56f-4d00-95c7-874f8011d4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:40.241306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c8c44-a56f-4d00-95c7-874f8011d4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:40.241587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c8c44-a56f-4d00-95c7-874f8011d4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:40.241861 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c8c44-a56f-4d00-95c7-874f8011d4c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:40.245286 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e8de5-ae3e-4c78-8814-5a067caf6ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:40.247481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e8de5-ae3e-4c78-8814-5a067caf6ed0 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:40.250959 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:40.254368 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c8c44-a56f-4d00-95c7-874f8011d4c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:40.256665 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c8c44-a56f-4d00-95c7-874f8011d4c5 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:40.273035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-f27e8de5-ae3e-4c78-8814-5a067caf6ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:40.273035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:40.273035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:40.273035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:40.273035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:40.273035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:40.273035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:40.273035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:40.273035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:40.273035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:40.273035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:40.273035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:40.273035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:40.273035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:40.273035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:40.273035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:40.274014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:40.274014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:40.274014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:40.274014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:40.274014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:40.274014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:40.274014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:40.274014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:40.274014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:40.274014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:40.274014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:40.274014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:40.274014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:40.274014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:40.274014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:40.274014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:40.274014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:40.274872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:40.274872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:40.274872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:40.276557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-f84c8c44-a56f-4d00-95c7-874f8011d4c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:40.276557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:40.276557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:40.276557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:40.276557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:40.276557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:40.276557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:40.276557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:40.276557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:40.276557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:40.276557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:40.276557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:40.276557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:40.276557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:40.276557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:40.276557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:40.277405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:40.277405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:40.277405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:40.277405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:40.277405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:40.277405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:40.277405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:40.277405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:40.277405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:40.277405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:40.277405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:40.277405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:40.277405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:40.277405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:40.277405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:40.277405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:40.277405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:40.278277 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:40.278277 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:40.278277 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:40.278277 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 228/468] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:40.278486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 240/468] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:40.279117 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c8c44-a56f-4d00-95c7-874f8011d4c5 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:40.280491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e8de5-ae3e-4c78-8814-5a067caf6ed0 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:40.294800 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:40.391819 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c8c44-a56f-4d00-95c7-874f8011d4c5 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:40.423934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e8de5-ae3e-4c78-8814-5a067caf6ed0 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:40.428332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7416d0-5083-4e8c-a415-282a28e454b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:40.428955 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7416d0-5083-4e8c-a415-282a28e454b6 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:40.429231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7416d0-5083-4e8c-a415-282a28e454b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:40.429501 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7416d0-5083-4e8c-a415-282a28e454b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:40.440160 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7416d0-5083-4e8c-a415-282a28e454b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:40.441665 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7416d0-5083-4e8c-a415-282a28e454b6 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:40.456612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-4f7416d0-5083-4e8c-a415-282a28e454b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:40.456612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:40.456612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:40.456612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:40.456612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:40.456612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:40.456612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:40.456612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:40.456612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:40.456612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:40.456612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:40.456612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:40.456612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:40.456612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:40.456612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:40.456612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:40.457539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:40.457539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:40.457539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:40.457539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:40.457539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:40.457539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:40.457539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:40.457539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:40.457539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:40.457539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:40.457539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:40.457539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:40.457539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:40.457539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:40.457539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:40.457539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:40.457539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:40.458391 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:40.458391 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:40.458391 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:40.458391 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 229/469] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:40.458391 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7416d0-5083-4e8c-a415-282a28e454b6 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:40.466277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f99deb-92fd-4bc4-bacb-e728af5a0f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:40.466923 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f99deb-92fd-4bc4-bacb-e728af5a0f2a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:40.467205 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f99deb-92fd-4bc4-bacb-e728af5a0f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:40.467730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f99deb-92fd-4bc4-bacb-e728af5a0f2a None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:40.468383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f99deb-92fd-4bc4-bacb-e728af5a0f2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:40.468688 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f99deb-92fd-4bc4-bacb-e728af5a0f2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:40.470048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f99deb-92fd-4bc4-bacb-e728af5a0f2a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:40.487961 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 241/470] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:40.489534 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba677e77-d616-4190-a975-634589ec615a None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:40.490012 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba677e77-d616-4190-a975-634589ec615a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:40.490492 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba677e77-d616-4190-a975-634589ec615a None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:40.491922 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 242/471] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:40.492798 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba677e77-d616-4190-a975-634589ec615a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:40.529040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:40.553252 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:40.576184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7416d0-5083-4e8c-a415-282a28e454b6 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:40.608311 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba677e77-d616-4190-a975-634589ec615a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:40.613844 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d40b5c-6f6a-4fb5-836a-65adcd187ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:40.614449 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d40b5c-6f6a-4fb5-836a-65adcd187ead None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:40.614759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d40b5c-6f6a-4fb5-836a-65adcd187ead None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:40.615032 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d40b5c-6f6a-4fb5-836a-65adcd187ead None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:40.615677 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d40b5c-6f6a-4fb5-836a-65adcd187ead None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:40.615978 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d40b5c-6f6a-4fb5-836a-65adcd187ead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:40.617342 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d40b5c-6f6a-4fb5-836a-65adcd187ead None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:40.636969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 230/472] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:40.636969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d40b5c-6f6a-4fb5-836a-65adcd187ead None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:40.654077 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85411bdb-4f2d-4076-a92b-79136f7e616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:40.654722 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85411bdb-4f2d-4076-a92b-79136f7e616e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:40.655003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85411bdb-4f2d-4076-a92b-79136f7e616e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:40.655275 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85411bdb-4f2d-4076-a92b-79136f7e616e None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:40.655926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85411bdb-4f2d-4076-a92b-79136f7e616e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:40.656224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85411bdb-4f2d-4076-a92b-79136f7e616e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:40.657667 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85411bdb-4f2d-4076-a92b-79136f7e616e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:40.669770 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 243/473] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:40.671232 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a4b21-11a4-4260-9162-1ba9c07b482f None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:40.671715 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a4b21-11a4-4260-9162-1ba9c07b482f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:40.672289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a4b21-11a4-4260-9162-1ba9c07b482f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:40.690870 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-816a4b21-11a4-4260-9162-1ba9c07b482f None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:40.692427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-816a4b21-11a4-4260-9162-1ba9c07b482f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:40.749701 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d40b5c-6f6a-4fb5-836a-65adcd187ead None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:40.764341 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 244/474] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:40.765425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a4b21-11a4-4260-9162-1ba9c07b482f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:40.778137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:40.796116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b497ca6-e6c3-47b1-b41c-fc6dedef6843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:40.796726 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b497ca6-e6c3-47b1-b41c-fc6dedef6843 None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:40.797005 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b497ca6-e6c3-47b1-b41c-fc6dedef6843 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:40.797275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b497ca6-e6c3-47b1-b41c-fc6dedef6843 None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:40.798017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b497ca6-e6c3-47b1-b41c-fc6dedef6843 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:40.799630 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b497ca6-e6c3-47b1-b41c-fc6dedef6843 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:40.827875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:40.828173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 231/475] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:19:40 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:19:40.829725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b497ca6-e6c3-47b1-b41c-fc6dedef6843 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:40.906024 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a4b21-11a4-4260-9162-1ba9c07b482f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:40.977431 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b497ca6-e6c3-47b1-b41c-fc6dedef6843 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:40.992863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6f810-4583-4477-a2d3-f266c589962f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:40.993542 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6f810-4583-4477-a2d3-f266c589962f None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:40.993822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6f810-4583-4477-a2d3-f266c589962f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:40.994780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6f810-4583-4477-a2d3-f266c589962f None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:40.995972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6f810-4583-4477-a2d3-f266c589962f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:40.997447 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6f810-4583-4477-a2d3-f266c589962f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:41.036589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e7936-1f1c-4f93-95a5-c172ea9b6d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:41.037315 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e7936-1f1c-4f93-95a5-c172ea9b6d75 None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:41.037598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e7936-1f1c-4f93-95a5-c172ea9b6d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:41.037872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e7936-1f1c-4f93-95a5-c172ea9b6d75 None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:41.038723 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e7936-1f1c-4f93-95a5-c172ea9b6d75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:41.045200 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e7936-1f1c-4f93-95a5-c172ea9b6d75 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:41.045379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 245/476] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:19:40 2022] POST /identity/v3/users => generated 248 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:19:41.070908 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 232/477] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:19:40 2022] POST /identity/v3/users => generated 249 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:19:41.174442 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6f810-4583-4477-a2d3-f266c589962f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:41.303474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:41.306257 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6f810-4583-4477-a2d3-f266c589962f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:41.349833 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39666ba2-03b7-4370-965d-30c633601528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:41.350534 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39666ba2-03b7-4370-965d-30c633601528 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:41.350814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39666ba2-03b7-4370-965d-30c633601528 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:41.351133 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39666ba2-03b7-4370-965d-30c633601528 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:41.351834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39666ba2-03b7-4370-965d-30c633601528 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:41.353276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39666ba2-03b7-4370-965d-30c633601528 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:41.362440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.sql.core [None req-39666ba2-03b7-4370-965d-30c633601528 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 16:19:41.362440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 16:19:41.362440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [parameters: {'id': '280a3293416c48799e5722ea1ea53668', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 16:19:41.362440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81497) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 16:19:41.379285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-39666ba2-03b7-4370-965d-30c633601528 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 16:19:41.379285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:41.379285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:19:41.379285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:19:41.379285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:19:41.379285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:19:41.379285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:19:41.379285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:19:41.379285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:19:41.379285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:19:41.379285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:19:41.379285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:19:41.379285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:19:41.379285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application result.read() Sep 01 16:19:41.379285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return ref.to_dict() Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:19:41.380416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:19:41.381617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 16:19:41.381617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application yield resource Sep 01 16:19:41.381617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:19:41.381617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:19:41.381617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 16:19:41.381617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 16:19:41.381617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 16:19:41.381617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 16:19:41.381617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 16:19:41.381617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise self.value Sep 01 16:19:41.381617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 16:19:41.381617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 16:19:41.381617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 16:19:41.381617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application session.commit() Sep 01 16:19:41.381617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 16:19:41.381617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 16:19:41.381617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 16:19:41.382804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 16:19:41.382804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 16:19:41.382804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.session.flush() Sep 01 16:19:41.382804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 16:19:41.382804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 16:19:41.382804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 16:19:41.382804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 16:19:41.382804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 16:19:41.382804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application compat.raise_( Sep 01 16:19:41.382804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:19:41.382804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception Sep 01 16:19:41.382804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 16:19:41.382804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 16:19:41.382804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 16:19:41.382804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 16:19:41.382804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 16:19:41.382804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 16:19:41.383890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 16:19:41.383890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 16:19:41.383890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 16:19:41.383890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 16:19:41.383890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 16:19:41.383890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 16:19:41.383890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 16:19:41.383890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 16:19:41.383890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 16:19:41.383890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 16:19:41.383890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 16:19:41.383890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 16:19:41.383890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 16:19:41.383890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 16:19:41.383890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:19:41.383890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception Sep 01 16:19:41.384895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:19:41.384895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:19:41.384895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:19:41.384895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:19:41.384895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:19:41.384895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:19:41.384895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:19:41.384895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:19:41.384895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:19:41.384895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:19:41.384895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:19:41.384895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application result.read() Sep 01 16:19:41.384895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:19:41.384895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:19:41.384895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:19:41.384895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:19:41.386083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:19:41.386083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:19:41.386083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:19:41.386083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:19:41.386083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 16:19:41.386083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 16:19:41.386083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [parameters: {'id': '280a3293416c48799e5722ea1ea53668', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 16:19:41.386083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 16:19:41.386083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:41.386083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:19:41.386083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:41.386083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:41.386083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:41.386083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:41.386083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:41.386083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:41.392326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:41.392326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:41.392326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:41.392326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:41.392326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:41.392326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:41.392326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 01 16:19:41.392326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 01 16:19:41.392326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:41.392326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:41.392326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 01 16:19:41.392326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 01 16:19:41.392326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 16:19:41.392326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 16:19:41.392326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 16:19:41.392326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:41.394466 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 246/478] 10.222.0.71 () {60 vars in 1131 bytes} [Thu Sep 1 16:19:41 2022] POST /identity/v3/roles => generated 144 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:41.394605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e7936-1f1c-4f93-95a5-c172ea9b6d75 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:41.433042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:41.509611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e7936-1f1c-4f93-95a5-c172ea9b6d75 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:41.546602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1692d4-9d35-42d6-85d0-bee22531405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:41.547257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1692d4-9d35-42d6-85d0-bee22531405c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:41.547538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1692d4-9d35-42d6-85d0-bee22531405c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:41.547812 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1692d4-9d35-42d6-85d0-bee22531405c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:41.558945 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1692d4-9d35-42d6-85d0-bee22531405c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:41.564000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-8d1692d4-9d35-42d6-85d0-bee22531405c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:41.564000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:41.564000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:41.564000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:41.564000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:41.564000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:41.564000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:41.564000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:41.564000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:41.564000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:41.564000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:41.564000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:41.564000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:41.564000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:41.564000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:41.564000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:41.566076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:41.566076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:41.566076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:41.566076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:41.566076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:41.566076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:41.566076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:41.566076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:41.566076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:41.566076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:41.566076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:41.566076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:41.566076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:41.566076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:41.566076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:41.566076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:41.568040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:41.568040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:41.568040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:41.568040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:41.568040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:41.568040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:41.568040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:41.568040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:41.568040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:41.568040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:41.568040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:41.568040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:41.568040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 233/479] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:41.575509 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39666ba2-03b7-4370-965d-30c633601528 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:41.729886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39666ba2-03b7-4370-965d-30c633601528 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:41.775221 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5a508-5375-4080-9fe3-9f23d7b460bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:41.775826 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5a508-5375-4080-9fe3-9f23d7b460bb None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:41.776715 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5a508-5375-4080-9fe3-9f23d7b460bb None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:41.776982 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5a508-5375-4080-9fe3-9f23d7b460bb None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:41.777644 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5a508-5375-4080-9fe3-9f23d7b460bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:41.777939 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5a508-5375-4080-9fe3-9f23d7b460bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:41.779327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5a508-5375-4080-9fe3-9f23d7b460bb None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:41.788199 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 247/480] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:42.339417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfa6e0-4706-482a-a03f-74638aeca2b3 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:42.339934 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfa6e0-4706-482a-a03f-74638aeca2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:42.340202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfa6e0-4706-482a-a03f-74638aeca2b3 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:42.341923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 234/481] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:42.347105 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f123f-d163-46e4-8f0c-2745be049be7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:42.347618 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f123f-d163-46e4-8f0c-2745be049be7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:42.347618 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f123f-d163-46e4-8f0c-2745be049be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:42.368309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ae6f123f-d163-46e4-8f0c-2745be049be7 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:42.369364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ae6f123f-d163-46e4-8f0c-2745be049be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:42.402443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:42.463023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 248/482] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:42.839621 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfa6e0-4706-482a-a03f-74638aeca2b3 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:42.938033 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:42.948293 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfa6e0-4706-482a-a03f-74638aeca2b3 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:42.997159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38941ee6-7d26-4e5a-a747-cd78fc0bc373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:42.997782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38941ee6-7d26-4e5a-a747-cd78fc0bc373 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:42.998054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38941ee6-7d26-4e5a-a747-cd78fc0bc373 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:42.998321 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38941ee6-7d26-4e5a-a747-cd78fc0bc373 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:43.009104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38941ee6-7d26-4e5a-a747-cd78fc0bc373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:43.014120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-38941ee6-7d26-4e5a-a747-cd78fc0bc373 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:43.014120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:43.014120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:43.014120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:43.014120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:43.014120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:43.014120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:43.014120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:43.014120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:43.014120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:43.014120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:43.014120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:43.014120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:43.014120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:43.014120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:43.014120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:43.015013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:43.015013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:43.015013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:43.015013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:43.015013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:43.015013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:43.015013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:43.015013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:43.015013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:43.015013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:43.015013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:43.015013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:43.015013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:43.015013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:43.015013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:43.015013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:43.015826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:43.015826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:43.015826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:43.015826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:43.015826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:43.015826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:43.015826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:43.015826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:43.015826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:43.015826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:43.015826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:43.015826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:43.015826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 235/483] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:43.023695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f123f-d163-46e4-8f0c-2745be049be7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:43.177567 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f123f-d163-46e4-8f0c-2745be049be7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:43.223758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a5a64-7e22-43ea-b758-27cfbb9fca7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:43.224690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a5a64-7e22-43ea-b758-27cfbb9fca7e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:43.225163 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a5a64-7e22-43ea-b758-27cfbb9fca7e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:43.225627 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a5a64-7e22-43ea-b758-27cfbb9fca7e None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:43.226507 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a5a64-7e22-43ea-b758-27cfbb9fca7e None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:43.227025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a5a64-7e22-43ea-b758-27cfbb9fca7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:43.228578 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a5a64-7e22-43ea-b758-27cfbb9fca7e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:43.241783 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 249/484] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:43.247452 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38941ee6-7d26-4e5a-a747-cd78fc0bc373 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:43.376579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900a3a3-00c8-4a0f-9ef3-6b314a76345c None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:43.377594 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900a3a3-00c8-4a0f-9ef3-6b314a76345c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:43.378075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900a3a3-00c8-4a0f-9ef3-6b314a76345c None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:43.380049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 250/485] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:43.385789 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a013e8d-1dd6-4956-b4bb-0bc52e6cbd49 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:43.386416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a013e8d-1dd6-4956-b4bb-0bc52e6cbd49 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:43.386924 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a013e8d-1dd6-4956-b4bb-0bc52e6cbd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:43.403157 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38941ee6-7d26-4e5a-a747-cd78fc0bc373 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:43.409569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-0a013e8d-1dd6-4956-b4bb-0bc52e6cbd49 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:43.411559 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0a013e8d-1dd6-4956-b4bb-0bc52e6cbd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:43.427544 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:43.462100 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233cf72-44ed-4bf3-8ef0-68c305553b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:43.463098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233cf72-44ed-4bf3-8ef0-68c305553b8c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:43.463632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233cf72-44ed-4bf3-8ef0-68c305553b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:43.464094 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233cf72-44ed-4bf3-8ef0-68c305553b8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:43.484224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233cf72-44ed-4bf3-8ef0-68c305553b8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:43.486745 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233cf72-44ed-4bf3-8ef0-68c305553b8c None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:43.515036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-b233cf72-44ed-4bf3-8ef0-68c305553b8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:43.515036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:43.515036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:43.515036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:43.515036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:43.515036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:43.515036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:43.515036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:43.515036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:43.515036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:43.515036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:43.515036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:43.515036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:43.515036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:43.515036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:43.515036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:43.515993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:43.515993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:43.515993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:43.515993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:43.515993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:43.515993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:43.515993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:43.515993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:43.515993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:43.515993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:43.515993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:43.515993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:43.515993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:43.515993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:43.515993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:43.515993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:43.515993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:43.516831 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:43.516831 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:43.516831 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:43.518857 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 236/487] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:43.520368 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571b2dc-cc62-44a9-92c6-fb0b02077c95 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:43.520843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571b2dc-cc62-44a9-92c6-fb0b02077c95 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:43.521309 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571b2dc-cc62-44a9-92c6-fb0b02077c95 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:43.522816 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 251/487] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:43.523383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 237/488] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:43.525179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a013e8d-1dd6-4956-b4bb-0bc52e6cbd49 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:43.529710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4210d-efb8-4678-a935-ed7bedc9e41b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:43.530249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4210d-efb8-4678-a935-ed7bedc9e41b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:43.530748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4210d-efb8-4678-a935-ed7bedc9e41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:43.547693 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:43.566468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-4cb4210d-efb8-4678-a935-ed7bedc9e41b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:43.570598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4cb4210d-efb8-4678-a935-ed7bedc9e41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:43.699770 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 238/489] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:43.701711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6b8a6-815f-4128-aa88-8b65fdc4bcc8 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:43.702365 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6b8a6-815f-4128-aa88-8b65fdc4bcc8 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:43.703279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6b8a6-815f-4128-aa88-8b65fdc4bcc8 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:43.705295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 239/490] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:43.710508 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5544303-7425-48b1-8bdd-06b009fec810 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:43.710883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5544303-7425-48b1-8bdd-06b009fec810 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:43.711227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5544303-7425-48b1-8bdd-06b009fec810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:43.713867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a013e8d-1dd6-4956-b4bb-0bc52e6cbd49 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:43.729647 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-d5544303-7425-48b1-8bdd-06b009fec810 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:43.730945 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d5544303-7425-48b1-8bdd-06b009fec810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:43.752285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cfadc-cdcd-4153-9092-24f786b28bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:43.753175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cfadc-cdcd-4153-9092-24f786b28bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:43.753646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cfadc-cdcd-4153-9092-24f786b28bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:43.754207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cfadc-cdcd-4153-9092-24f786b28bf7 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:43.755075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cfadc-cdcd-4153-9092-24f786b28bf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:43.755553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cfadc-cdcd-4153-9092-24f786b28bf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:43.757264 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cfadc-cdcd-4153-9092-24f786b28bf7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:43.770586 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 252/491] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:43.775582 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cfadc-cdcd-4153-9092-24f786b28bf7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:43.788253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:43.802649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 240/492] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:43.890723 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cfadc-cdcd-4153-9092-24f786b28bf7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:43.900731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5544303-7425-48b1-8bdd-06b009fec810 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:43.927429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68da95-5a95-41a5-9b92-19da9aab9132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:43.928115 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68da95-5a95-41a5-9b92-19da9aab9132 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:43.928398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68da95-5a95-41a5-9b92-19da9aab9132 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:43.928670 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68da95-5a95-41a5-9b92-19da9aab9132 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:43.944987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68da95-5a95-41a5-9b92-19da9aab9132 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:43.950648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68da95-5a95-41a5-9b92-19da9aab9132 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:43.971187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-4d68da95-5a95-41a5-9b92-19da9aab9132 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:19:43.971187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:43.971187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:43.971187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:43.971187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:43.971187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:43.971187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:43.971187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:43.971187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:43.971187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:43.971187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:43.971187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:43.971187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:43.971187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:43.971187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:43.971187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:43.972330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:43.973521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:43.973521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:43.973521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:43.973521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:43.973521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:43.973521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:43.973521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:43.973521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:43.973521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:19:43.973521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:43.976121 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 253/493] 10.222.0.71 () {56 vars in 1093 bytes} [Thu Sep 1 16:19:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:19:43.982774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68da95-5a95-41a5-9b92-19da9aab9132 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:43.999823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:44.071165 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5544303-7425-48b1-8bdd-06b009fec810 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:44.091607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:44.129650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68da95-5a95-41a5-9b92-19da9aab9132 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:44.131938 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99115f2e-72bb-4408-a903-f53a9bf12587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:44.132583 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99115f2e-72bb-4408-a903-f53a9bf12587 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.133557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99115f2e-72bb-4408-a903-f53a9bf12587 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.133557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99115f2e-72bb-4408-a903-f53a9bf12587 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.144037 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99115f2e-72bb-4408-a903-f53a9bf12587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:44.149394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-99115f2e-72bb-4408-a903-f53a9bf12587 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:44.149394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:44.149394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:44.149394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:44.149394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:44.149394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:44.149394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:44.149394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:44.149394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:44.149394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:44.149394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:44.149394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:44.149394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:44.149394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:44.149394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:44.149394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:44.150276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:44.150276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:44.150276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:44.150276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:44.150276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:44.150276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:44.150276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:44.150276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:44.150276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:44.150276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:44.150276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:44.150276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:44.150276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:44.150276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:44.150276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:44.150276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:44.155712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:44.155712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:44.155712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:44.155712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:44.155712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:44.155712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:44.155712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:44.155712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:44.155712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:44.155712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:44.155712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:44.155712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:44.155712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 241/494] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:44.155712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99115f2e-72bb-4408-a903-f53a9bf12587 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:44.172101 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6796b-e566-4f02-b53b-e13f0510f75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:44.172814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6796b-e566-4f02-b53b-e13f0510f75f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.173114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6796b-e566-4f02-b53b-e13f0510f75f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.173464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6796b-e566-4f02-b53b-e13f0510f75f None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.174185 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6796b-e566-4f02-b53b-e13f0510f75f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:44.174485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6796b-e566-4f02-b53b-e13f0510f75f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:44.175960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6796b-e566-4f02-b53b-e13f0510f75f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:44.218692 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 254/495] 10.222.0.71 () {56 vars in 1133 bytes} [Thu Sep 1 16:19:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:44.220467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6796b-e566-4f02-b53b-e13f0510f75f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:44.255993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99115f2e-72bb-4408-a903-f53a9bf12587 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:44.281345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:44.294228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1669b1-3271-4f65-b998-425bf58f5b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:44.294872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1669b1-3271-4f65-b998-425bf58f5b0b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.295148 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1669b1-3271-4f65-b998-425bf58f5b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.295413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1669b1-3271-4f65-b998-425bf58f5b0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.306011 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1669b1-3271-4f65-b998-425bf58f5b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:44.311468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-ec1669b1-3271-4f65-b998-425bf58f5b0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:44.311468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:44.311468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:44.311468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:44.311468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:44.311468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:44.311468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:44.311468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:44.311468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:44.311468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:44.311468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:44.311468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:44.311468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:44.311468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:44.311468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:44.311468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:44.312389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:44.312389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:44.312389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:44.312389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:44.312389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:44.312389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:44.312389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:44.312389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:44.312389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:44.312389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:44.312389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:44.312389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:44.312389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:44.312389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:44.312389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:44.312389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:44.313192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:44.313192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:44.313192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:44.313192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:44.313192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:44.313192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:44.313192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:44.313192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:44.313192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:44.313192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:44.313192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:44.313192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:44.313192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 242/496] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:44.313841 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1669b1-3271-4f65-b998-425bf58f5b0b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:44.329744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6796b-e566-4f02-b53b-e13f0510f75f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:44.358800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:44.369126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987a8b8-a99e-4f33-bd7a-2896989c77d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:44.370462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987a8b8-a99e-4f33-bd7a-2896989c77d8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.370778 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987a8b8-a99e-4f33-bd7a-2896989c77d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.371050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987a8b8-a99e-4f33-bd7a-2896989c77d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.381310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987a8b8-a99e-4f33-bd7a-2896989c77d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:44.386190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-c987a8b8-a99e-4f33-bd7a-2896989c77d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:44.386190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:44.386190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:44.386190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:44.386190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:44.386190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:44.386190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:44.386190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:44.386190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:44.386190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:44.386190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:44.386190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:44.386190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:44.386190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:44.386190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:44.386190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:44.387317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:44.387317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:44.387317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:44.387317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:44.387317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:44.387317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:44.387317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:44.387317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:44.387317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:44.387317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:44.387317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:44.387317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:44.387317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:44.387317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:44.387317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:44.387317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:44.388130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:44.388130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:44.388130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:44.388130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:44.388130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:44.388130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:44.388130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:44.388130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:44.388130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:44.388130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:44.388130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:44.388130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:44.388130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 255/497] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:44.388784 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987a8b8-a99e-4f33-bd7a-2896989c77d8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:44.424870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1669b1-3271-4f65-b998-425bf58f5b0b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:44.460676 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2da933-5e66-4548-bdfd-ce2cca21f72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:44.461277 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2da933-5e66-4548-bdfd-ce2cca21f72b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.461552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2da933-5e66-4548-bdfd-ce2cca21f72b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.461823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2da933-5e66-4548-bdfd-ce2cca21f72b None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.462484 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2da933-5e66-4548-bdfd-ce2cca21f72b None admin] RBAC: Adding query filter params (name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:44.462814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2da933-5e66-4548-bdfd-ce2cca21f72b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:44.464230 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2da933-5e66-4548-bdfd-ce2cca21f72b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:44.472460 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 243/498] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:44.473089 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2da933-5e66-4548-bdfd-ce2cca21f72b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:44.489335 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987a8b8-a99e-4f33-bd7a-2896989c77d8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:44.519654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:44.522950 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810de1e-ce2a-441d-bd63-ec03af4824fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:44.523545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810de1e-ce2a-441d-bd63-ec03af4824fd None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.523823 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810de1e-ce2a-441d-bd63-ec03af4824fd None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.524091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810de1e-ce2a-441d-bd63-ec03af4824fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.573966 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2da933-5e66-4548-bdfd-ce2cca21f72b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:44.584161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:44.597492 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810de1e-ce2a-441d-bd63-ec03af4824fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:44.599026 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810de1e-ce2a-441d-bd63-ec03af4824fd None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:44.607444 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b8daf-199d-4388-9f61-9e8bbe17f423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:44.608054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b8daf-199d-4388-9f61-9e8bbe17f423 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.608340 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b8daf-199d-4388-9f61-9e8bbe17f423 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.608613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b8daf-199d-4388-9f61-9e8bbe17f423 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.609270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b8daf-199d-4388-9f61-9e8bbe17f423 None admin] RBAC: Adding query filter params (name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:44.609573 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b8daf-199d-4388-9f61-9e8bbe17f423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:44.610959 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b8daf-199d-4388-9f61-9e8bbe17f423 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:44.619007 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 244/499] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:44.620365 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b8daf-199d-4388-9f61-9e8bbe17f423 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:44.696705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 256/500] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:44.698574 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d16c80-7ffb-4513-93ec-c3c40d551aea None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.698886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d16c80-7ffb-4513-93ec-c3c40d551aea None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.699155 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d16c80-7ffb-4513-93ec-c3c40d551aea None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.700566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 257/501] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:44.706965 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d16c80-7ffb-4513-93ec-c3c40d551aea None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:44.733143 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b8daf-199d-4388-9f61-9e8bbe17f423 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:44.742000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:44.768210 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1c504-dac2-4163-a047-3f2a746e5055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:44.768809 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1c504-dac2-4163-a047-3f2a746e5055 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.769086 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1c504-dac2-4163-a047-3f2a746e5055 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.769357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1c504-dac2-4163-a047-3f2a746e5055 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.770012 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1c504-dac2-4163-a047-3f2a746e5055 None admin] RBAC: Adding query filter params (name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:44.770312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1c504-dac2-4163-a047-3f2a746e5055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:44.771701 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1c504-dac2-4163-a047-3f2a746e5055 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:44.779439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 245/502] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:44.780216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1c504-dac2-4163-a047-3f2a746e5055 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:44.796351 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:44.812971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d16c80-7ffb-4513-93ec-c3c40d551aea None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:44.846309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af4258-02d3-4cab-8852-7e9b589576ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:44.846881 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af4258-02d3-4cab-8852-7e9b589576ef None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.847158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af4258-02d3-4cab-8852-7e9b589576ef None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.847430 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af4258-02d3-4cab-8852-7e9b589576ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.857945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af4258-02d3-4cab-8852-7e9b589576ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:44.859453 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af4258-02d3-4cab-8852-7e9b589576ef None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:44.874134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-05af4258-02d3-4cab-8852-7e9b589576ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:44.874134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:44.874134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:44.874134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:44.874134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:44.874134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:44.874134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:44.874134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:44.874134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:44.874134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:44.874134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:44.874134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:44.874134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:44.874134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:44.874134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:44.874134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:44.875092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:44.875092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:44.875092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:44.875092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:44.875092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:44.875092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:44.875092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:44.875092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:44.875092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:44.875092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:44.875092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:44.875092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:44.875092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:44.875092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:44.875092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:44.875092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:44.875092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:44.875945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:44.875945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:44.875945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:44.875945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 258/503] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:44.876165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af4258-02d3-4cab-8852-7e9b589576ef None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:44.882206 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1c504-dac2-4163-a047-3f2a746e5055 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:44.915648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72e7f4-0f1e-40ef-a757-b587cc4d250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:44.916266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72e7f4-0f1e-40ef-a757-b587cc4d250b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.917045 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72e7f4-0f1e-40ef-a757-b587cc4d250b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.917315 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72e7f4-0f1e-40ef-a757-b587cc4d250b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.927759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72e7f4-0f1e-40ef-a757-b587cc4d250b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:44.929178 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72e7f4-0f1e-40ef-a757-b587cc4d250b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:44.943310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-4b72e7f4-0f1e-40ef-a757-b587cc4d250b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:44.943310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:44.943310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:44.943310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:44.943310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:44.943310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:44.943310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:44.943310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:44.943310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:44.943310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:44.943310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:44.943310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:44.943310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:44.943310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:44.943310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:44.943310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:44.944689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:44.944689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:44.944689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:44.944689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:44.944689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:44.944689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:44.944689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:44.944689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:44.944689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:44.944689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:44.944689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:44.944689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:44.944689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:44.944689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:44.944689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:44.944689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:44.944689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:44.945729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:44.945729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:44.945729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:44.945729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 246/504] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:44.945729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d5658-b030-45ae-96cf-4d4895f5bc54 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.946214 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d5658-b030-45ae-96cf-4d4895f5bc54 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.946214 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d5658-b030-45ae-96cf-4d4895f5bc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.964382 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-333d5658-b030-45ae-96cf-4d4895f5bc54 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:44.965566 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-333d5658-b030-45ae-96cf-4d4895f5bc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:44.976909 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af4258-02d3-4cab-8852-7e9b589576ef None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:44.982780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:45.010327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc857c-1e41-484d-bf54-740578646c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:45.010977 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc857c-1e41-484d-bf54-740578646c1e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:45.011254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc857c-1e41-484d-bf54-740578646c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:45.011524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc857c-1e41-484d-bf54-740578646c1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:45.018338 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:45.022766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc857c-1e41-484d-bf54-740578646c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:45.024236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc857c-1e41-484d-bf54-740578646c1e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:45.032591 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 247/505] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:45.033328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d5658-b030-45ae-96cf-4d4895f5bc54 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:45.038485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-eabc857c-1e41-484d-bf54-740578646c1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:45.038485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:45.038485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:45.038485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:45.038485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:45.038485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:45.038485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:45.038485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:45.038485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:45.038485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:45.038485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:45.038485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:45.038485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:45.038485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:45.038485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:45.038485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:45.039575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:45.039575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:45.039575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:45.039575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:45.039575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:45.039575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:45.039575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:45.039575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:45.039575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:45.039575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:45.039575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:45.039575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:45.039575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:45.039575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:45.039575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:45.039575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:45.039575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:45.045719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:45.045719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:45.045719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:45.045719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 259/506] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:45.045719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc857c-1e41-484d-bf54-740578646c1e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:45.151049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc857c-1e41-484d-bf54-740578646c1e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:45.157219 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d5658-b030-45ae-96cf-4d4895f5bc54 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:45.188590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a6ced-7c96-4f1b-a2cb-f9e83014a694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:45.189320 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a6ced-7c96-4f1b-a2cb-f9e83014a694 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:45.189585 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a6ced-7c96-4f1b-a2cb-f9e83014a694 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:45.189861 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a6ced-7c96-4f1b-a2cb-f9e83014a694 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:45.190593 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a6ced-7c96-4f1b-a2cb-f9e83014a694 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:45.190915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a6ced-7c96-4f1b-a2cb-f9e83014a694 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:45.192278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a6ced-7c96-4f1b-a2cb-f9e83014a694 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:45.195438 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa441e-92a2-4cc2-8e14-3a68c4784a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:45.196061 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa441e-92a2-4cc2-8e14-3a68c4784a95 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:45.196342 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa441e-92a2-4cc2-8e14-3a68c4784a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:45.196613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa441e-92a2-4cc2-8e14-3a68c4784a95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:45.208495 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 260/507] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:45.208495 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a6ced-7c96-4f1b-a2cb-f9e83014a694 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:45.213357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa441e-92a2-4cc2-8e14-3a68c4784a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:45.214818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa441e-92a2-4cc2-8e14-3a68c4784a95 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:45.231619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-ddfa441e-92a2-4cc2-8e14-3a68c4784a95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:45.231619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:45.231619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:45.231619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:45.231619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:45.231619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:45.231619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:45.231619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:45.231619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:45.231619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:45.231619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:45.231619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:45.231619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:45.231619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:45.231619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:45.231619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:45.232519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:45.232519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:45.232519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:45.232519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:45.232519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:45.232519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:45.232519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:45.232519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:45.232519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:45.232519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:45.232519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:45.232519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:45.232519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:45.232519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:45.232519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:45.232519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:45.232519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:45.233384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:45.233384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:45.233384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:45.234193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 248/508] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:45.235037 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa441e-92a2-4cc2-8e14-3a68c4784a95 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:45.238811 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:45.266452 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:45.322503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a6ced-7c96-4f1b-a2cb-f9e83014a694 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:45.338093 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa441e-92a2-4cc2-8e14-3a68c4784a95 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:45.356688 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68438927-9765-4c84-bad4-0846f47586e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:45.357284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68438927-9765-4c84-bad4-0846f47586e4 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:45.357562 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68438927-9765-4c84-bad4-0846f47586e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:45.357831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68438927-9765-4c84-bad4-0846f47586e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:45.358465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68438927-9765-4c84-bad4-0846f47586e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:45.358793 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68438927-9765-4c84-bad4-0846f47586e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:45.360157 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68438927-9765-4c84-bad4-0846f47586e4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:45.370882 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 261/509] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:45.371656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68438927-9765-4c84-bad4-0846f47586e4 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:45.371892 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49518b50-b2f3-4c50-880e-2daf781a18cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:45.372490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49518b50-b2f3-4c50-880e-2daf781a18cf None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:45.372768 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49518b50-b2f3-4c50-880e-2daf781a18cf None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:45.373037 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49518b50-b2f3-4c50-880e-2daf781a18cf None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:45.373672 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49518b50-b2f3-4c50-880e-2daf781a18cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:45.373971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49518b50-b2f3-4c50-880e-2daf781a18cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:45.375341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49518b50-b2f3-4c50-880e-2daf781a18cf None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:45.387591 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 249/510] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:45.388394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49518b50-b2f3-4c50-880e-2daf781a18cf None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:45.453925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:45.475828 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68438927-9765-4c84-bad4-0846f47586e4 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:45.486745 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:45.492848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49518b50-b2f3-4c50-880e-2daf781a18cf None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:45.510624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba7757-ab11-4110-84de-b0d7d09fbbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:45.511270 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba7757-ab11-4110-84de-b0d7d09fbbf6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:45.511548 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba7757-ab11-4110-84de-b0d7d09fbbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:45.511816 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba7757-ab11-4110-84de-b0d7d09fbbf6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:45.519027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba7757-ab11-4110-84de-b0d7d09fbbf6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:45.520513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba7757-ab11-4110-84de-b0d7d09fbbf6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:45.525524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e3f8e-6571-4f3a-a32e-ca9a750979fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:45.526639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e3f8e-6571-4f3a-a32e-ca9a750979fa None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:45.526949 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e3f8e-6571-4f3a-a32e-ca9a750979fa None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:45.527218 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e3f8e-6571-4f3a-a32e-ca9a750979fa None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:45.527846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e3f8e-6571-4f3a-a32e-ca9a750979fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:45.528142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e3f8e-6571-4f3a-a32e-ca9a750979fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:45.529476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e3f8e-6571-4f3a-a32e-ca9a750979fa None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:45.532377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-e5ba7757-ab11-4110-84de-b0d7d09fbbf6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:19:45.532377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:45.532377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:45.532377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:45.532377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:45.532377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:45.532377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:45.532377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:45.532377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:45.532377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:45.532377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:45.532377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:45.532377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:45.532377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:45.532377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:45.532377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:45.533282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:45.534178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:45.534178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:45.534178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:45.534178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:45.534178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:45.534178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:45.534178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:45.534178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:45.534178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:19:45.534178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:45.534178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 262/511] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:45.535393 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba7757-ab11-4110-84de-b0d7d09fbbf6 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:45.545626 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 250/512] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:45.545626 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e3f8e-6571-4f3a-a32e-ca9a750979fa None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:45.636717 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba7757-ab11-4110-84de-b0d7d09fbbf6 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:45.643118 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e3f8e-6571-4f3a-a32e-ca9a750979fa None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:45.665493 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:45.670517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb4cd6-1bf8-4712-a988-e235a4887c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:45.671168 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb4cd6-1bf8-4712-a988-e235a4887c53 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:45.671447 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb4cd6-1bf8-4712-a988-e235a4887c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:45.671720 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb4cd6-1bf8-4712-a988-e235a4887c53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:45.676555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bb426-f997-4da5-ac0b-bc1759784981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:45.677189 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bb426-f997-4da5-ac0b-bc1759784981 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:45.677461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bb426-f997-4da5-ac0b-bc1759784981 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:45.677725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bb426-f997-4da5-ac0b-bc1759784981 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:45.681978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb4cd6-1bf8-4712-a988-e235a4887c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:45.684023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb4cd6-1bf8-4712-a988-e235a4887c53 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:45.685546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bb426-f997-4da5-ac0b-bc1759784981 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:45.686976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bb426-f997-4da5-ac0b-bc1759784981 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:45.697912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-53eb4cd6-1bf8-4712-a988-e235a4887c53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:45.697912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:45.697912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:45.697912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:45.697912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:45.697912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:45.697912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:45.697912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:45.697912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:45.697912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:45.697912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:45.697912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:45.697912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:45.697912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:45.697912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:45.697912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:45.699023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:45.699023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:45.699023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:45.699023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:45.699023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:45.699023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:45.699023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:45.699023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:45.699023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:45.699023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:45.699023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:45.699023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:45.699023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:45.699023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:45.699023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:45.699023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:45.699023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:45.700061 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:45.700061 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:45.700061 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:45.700248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-272bb426-f997-4da5-ac0b-bc1759784981 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:19:45.700248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:45.700248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:45.700248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:45.700248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:45.700248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:45.700248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:45.700248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:45.700248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:45.700248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:45.700248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:45.700248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:45.700248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:45.700248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:45.700248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:45.700248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:45.701205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:45.702299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:45.702299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:45.702299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:45.702299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:45.702299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:45.702299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:45.702299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:45.702299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:45.702299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:19:45.702299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:45.702926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 263/513] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:45.702926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb4cd6-1bf8-4712-a988-e235a4887c53 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:45.704876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 251/514] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:45.705627 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bb426-f997-4da5-ac0b-bc1759784981 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:45.725194 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:45.802544 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb4cd6-1bf8-4712-a988-e235a4887c53 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:45.810407 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bb426-f997-4da5-ac0b-bc1759784981 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:45.835047 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772aeab3-8d5a-42d0-aeff-2e4c2c94df44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:45.835662 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772aeab3-8d5a-42d0-aeff-2e4c2c94df44 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:45.835940 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772aeab3-8d5a-42d0-aeff-2e4c2c94df44 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:45.836208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772aeab3-8d5a-42d0-aeff-2e4c2c94df44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:45.842862 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772aeab3-8d5a-42d0-aeff-2e4c2c94df44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:45.842972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1000e-9426-42ac-97f3-76f82ffe0328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:45.843518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1000e-9426-42ac-97f3-76f82ffe0328 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:45.843798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1000e-9426-42ac-97f3-76f82ffe0328 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:45.844070 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1000e-9426-42ac-97f3-76f82ffe0328 None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:45.844287 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772aeab3-8d5a-42d0-aeff-2e4c2c94df44 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:45.844824 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1000e-9426-42ac-97f3-76f82ffe0328 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:45.845092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1000e-9426-42ac-97f3-76f82ffe0328 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:45.846550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1000e-9426-42ac-97f3-76f82ffe0328 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:45.856470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-772aeab3-8d5a-42d0-aeff-2e4c2c94df44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:45.856470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:45.856470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:45.856470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:45.856470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:45.856470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:45.856470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:45.856470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:45.856470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:45.856470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:45.856470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:45.856470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:45.856470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:19:45.856470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:19:45.856470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:19:45.857365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:19:45.857365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:45.857365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:45.857365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:45.857365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:45.857365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:45.857365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:45.857365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:45.857365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:45.857365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:45.857365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:45.857365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:45.857365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:45.857365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:45.857365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:45.857365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:45.857365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:45.858228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:19:45.858228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:19:45.858228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:19:45.858228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:19:45.858228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:19:45.858228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:19:45.858228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:45.858228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:45.858228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 264/515] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:45.858729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772aeab3-8d5a-42d0-aeff-2e4c2c94df44 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:45.888702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 252/516] 10.222.0.71 () {56 vars in 1137 bytes} [Thu Sep 1 16:19:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:45.889544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1000e-9426-42ac-97f3-76f82ffe0328 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:45.933784 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:45.947185 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:45.968055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772aeab3-8d5a-42d0-aeff-2e4c2c94df44 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:45.991908 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1000e-9426-42ac-97f3-76f82ffe0328 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:46.001201 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f9cff-bf16-455d-beda-af994485c360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:46.001821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f9cff-bf16-455d-beda-af994485c360 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:46.002096 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f9cff-bf16-455d-beda-af994485c360 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:46.002363 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f9cff-bf16-455d-beda-af994485c360 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:46.009592 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f9cff-bf16-455d-beda-af994485c360 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:46.011595 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f9cff-bf16-455d-beda-af994485c360 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:46.022451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-8a4f9cff-bf16-455d-beda-af994485c360 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:19:46.022451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:46.022451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:46.022451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:46.022451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:46.022451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:46.022451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:46.022451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:46.022451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:46.022451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:46.022451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:46.022451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:46.022451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:46.022451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:46.022451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:46.022451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:46.023385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:46.024288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:46.024288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:46.024288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:46.024288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:46.024288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:46.024288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:46.024288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:46.024288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:46.024288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:19:46.024288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:46.024288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 265/517] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:46.024288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f9cff-bf16-455d-beda-af994485c360 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:46.030664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b00fc8-8dee-4508-aa37-8684df9535bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:46.031280 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b00fc8-8dee-4508-aa37-8684df9535bc None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:46.031558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b00fc8-8dee-4508-aa37-8684df9535bc None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:46.031835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b00fc8-8dee-4508-aa37-8684df9535bc None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:46.032482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b00fc8-8dee-4508-aa37-8684df9535bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:46.032808 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b00fc8-8dee-4508-aa37-8684df9535bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:46.034193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b00fc8-8dee-4508-aa37-8684df9535bc None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:46.045829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 253/518] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:46.046663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b00fc8-8dee-4508-aa37-8684df9535bc None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:46.125700 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f9cff-bf16-455d-beda-af994485c360 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:46.144350 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b00fc8-8dee-4508-aa37-8684df9535bc None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:46.145847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:46.158383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb19d3-5e86-44ac-b1b4-5ceccdaed2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:46.159013 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb19d3-5e86-44ac-b1b4-5ceccdaed2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:46.159291 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb19d3-5e86-44ac-b1b4-5ceccdaed2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:46.159561 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb19d3-5e86-44ac-b1b4-5ceccdaed2c2 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:46.160289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb19d3-5e86-44ac-b1b4-5ceccdaed2c2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:46.160590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb19d3-5e86-44ac-b1b4-5ceccdaed2c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:46.162014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb19d3-5e86-44ac-b1b4-5ceccdaed2c2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:46.175701 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:46.178730 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0b421-9e95-4b2b-b6e4-1aace9593148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:46.179328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0b421-9e95-4b2b-b6e4-1aace9593148 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:46.179702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0b421-9e95-4b2b-b6e4-1aace9593148 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:46.179874 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0b421-9e95-4b2b-b6e4-1aace9593148 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:46.180563 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0b421-9e95-4b2b-b6e4-1aace9593148 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:46.180942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0b421-9e95-4b2b-b6e4-1aace9593148 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:46.182910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0b421-9e95-4b2b-b6e4-1aace9593148 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:46.183173 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 266/519] 10.222.0.71 () {56 vars in 1139 bytes} [Thu Sep 1 16:19:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:46.184083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb19d3-5e86-44ac-b1b4-5ceccdaed2c2 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:46.201855 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 254/520] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:19:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:46.202802 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0b421-9e95-4b2b-b6e4-1aace9593148 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:46.287272 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb19d3-5e86-44ac-b1b4-5ceccdaed2c2 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:46.300742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0b421-9e95-4b2b-b6e4-1aace9593148 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:46.320208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41248092-ca32-4476-b933-e61597d481ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:46.320807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41248092-ca32-4476-b933-e61597d481ef None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:46.321080 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41248092-ca32-4476-b933-e61597d481ef None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:46.321345 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41248092-ca32-4476-b933-e61597d481ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:46.334349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f190a6-d835-42c6-8b5f-04b96ea07c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:46.334975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f190a6-d835-42c6-8b5f-04b96ea07c73 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:46.335256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f190a6-d835-42c6-8b5f-04b96ea07c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:46.335527 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f190a6-d835-42c6-8b5f-04b96ea07c73 None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:46.336246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f190a6-d835-42c6-8b5f-04b96ea07c73 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:46.336899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f190a6-d835-42c6-8b5f-04b96ea07c73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:46.337991 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f190a6-d835-42c6-8b5f-04b96ea07c73 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:46.354756 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 255/521] 10.222.0.71 () {56 vars in 1137 bytes} [Thu Sep 1 16:19:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:46.355525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f190a6-d835-42c6-8b5f-04b96ea07c73 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:46.377670 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:46.387375 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:46.390320 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41248092-ca32-4476-b933-e61597d481ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:46.391938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41248092-ca32-4476-b933-e61597d481ef None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:46.458730 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f190a6-d835-42c6-8b5f-04b96ea07c73 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:46.491156 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 267/522] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:46.491832 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41248092-ca32-4476-b933-e61597d481ef None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:46.492982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd5e27-6dd0-4086-b1ca-6e19ffbff17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:46.493585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd5e27-6dd0-4086-b1ca-6e19ffbff17a None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:46.493968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd5e27-6dd0-4086-b1ca-6e19ffbff17a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:46.494137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd5e27-6dd0-4086-b1ca-6e19ffbff17a None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:46.495321 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd5e27-6dd0-4086-b1ca-6e19ffbff17a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:46.496761 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd5e27-6dd0-4086-b1ca-6e19ffbff17a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:46.516889 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 256/523] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:19:46 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:19:46.517674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd5e27-6dd0-4086-b1ca-6e19ffbff17a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:46.597357 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:46.600646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41248092-ca32-4476-b933-e61597d481ef None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:46.601997 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:46.630222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd5e27-6dd0-4086-b1ca-6e19ffbff17a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:46.648248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88d258-14e0-4140-a3fc-a2b7dadf83d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:46.649105 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88d258-14e0-4140-a3fc-a2b7dadf83d0 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:46.649105 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88d258-14e0-4140-a3fc-a2b7dadf83d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:46.649412 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88d258-14e0-4140-a3fc-a2b7dadf83d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:46.668479 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9b6cb-f775-4e4a-9a5c-4b6e09588ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:46.669540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9b6cb-f775-4e4a-9a5c-4b6e09588ffc None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:46.669540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9b6cb-f775-4e4a-9a5c-4b6e09588ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:46.669838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9b6cb-f775-4e4a-9a5c-4b6e09588ffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:46.671072 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9b6cb-f775-4e4a-9a5c-4b6e09588ffc None admin] RBAC: Adding query filter params (role.id=21a27b57a72246b2ade92d82599c569d, scope.project.id=9527063094354a99a80822107d2740fb, user.id=ed71d63cd24f4a6caf6ebba2c30d3608) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:46.671072 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9b6cb-f775-4e4a-9a5c-4b6e09588ffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:46.672296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9b6cb-f775-4e4a-9a5c-4b6e09588ffc None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:46.678955 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 257/524] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:46 2022] GET /identity/v3/role_assignments?user.id=ed71d63cd24f4a6caf6ebba2c30d3608&scope.project.id=9527063094354a99a80822107d2740fb&role.id=21a27b57a72246b2ade92d82599c569d => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:46.679864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9b6cb-f775-4e4a-9a5c-4b6e09588ffc None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:46.746805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88d258-14e0-4140-a3fc-a2b7dadf83d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:46.748293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88d258-14e0-4140-a3fc-a2b7dadf83d0 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:46.827441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9b6cb-f775-4e4a-9a5c-4b6e09588ffc None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:46.863770 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845df55-9292-48c2-9657-1312c0d50ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:46.864291 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845df55-9292-48c2-9657-1312c0d50ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:46.864570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845df55-9292-48c2-9657-1312c0d50ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:46.864837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845df55-9292-48c2-9657-1312c0d50ce1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:46.875673 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:46.879461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:46.889488 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 268/525] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:46.890893 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88d258-14e0-4140-a3fc-a2b7dadf83d0 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:46.936174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845df55-9292-48c2-9657-1312c0d50ce1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:46.937648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845df55-9292-48c2-9657-1312c0d50ce1 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:47.003880 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88d258-14e0-4140-a3fc-a2b7dadf83d0 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:47.044356 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be43474-e778-4c50-9340-1f90d4372cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:47.044997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be43474-e778-4c50-9340-1f90d4372cfb None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:47.045119 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 258/526] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:47.045988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845df55-9292-48c2-9657-1312c0d50ce1 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:47.046889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be43474-e778-4c50-9340-1f90d4372cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:47.047382 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be43474-e778-4c50-9340-1f90d4372cfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:47.068134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be43474-e778-4c50-9340-1f90d4372cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:47.070053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be43474-e778-4c50-9340-1f90d4372cfb None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:47.089429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-3be43474-e778-4c50-9340-1f90d4372cfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:47.089429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:47.089429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:47.089429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:47.089429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:47.089429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:47.089429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:47.089429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:47.089429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:47.089429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:47.089429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:47.089429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:47.089429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:47.089429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:47.089429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:47.089429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:47.090372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:47.090372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:47.090372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:47.090372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:47.090372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:47.090372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:47.090372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:47.090372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:47.090372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:47.090372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:47.090372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:47.090372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:47.090372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:47.090372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:47.090372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:47.090372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:47.090372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:47.091342 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:47.091342 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:47.091342 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:47.091342 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 269/527] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:47.092304 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be43474-e778-4c50-9340-1f90d4372cfb None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:47.099002 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:47.164376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:47.172983 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845df55-9292-48c2-9657-1312c0d50ce1 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:47.208572 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83141efa-7eba-4cbc-b43d-ddee6a80f216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:47.209209 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83141efa-7eba-4cbc-b43d-ddee6a80f216 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:47.209491 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83141efa-7eba-4cbc-b43d-ddee6a80f216 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:47.209768 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83141efa-7eba-4cbc-b43d-ddee6a80f216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:47.220737 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83141efa-7eba-4cbc-b43d-ddee6a80f216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:47.222082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83141efa-7eba-4cbc-b43d-ddee6a80f216 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:47.224030 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be43474-e778-4c50-9340-1f90d4372cfb None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:47.237878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-83141efa-7eba-4cbc-b43d-ddee6a80f216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:47.237878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:47.237878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:47.237878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:47.237878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:47.237878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:47.237878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:47.237878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:47.237878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:47.237878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:47.237878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:47.237878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:47.237878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:47.237878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:47.237878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:47.237878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:47.238887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:47.238887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:47.238887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:47.238887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:47.238887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:47.238887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:47.238887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:47.238887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:47.238887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:47.238887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:47.238887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:47.238887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:47.238887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:47.238887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:47.238887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:47.238887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:47.238887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:47.239732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:47.239732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:47.239732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:47.243584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 259/528] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:47.244455 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83141efa-7eba-4cbc-b43d-ddee6a80f216 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:47.264700 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939738c-dee8-4c3e-822b-9a5a3cf55ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:47.265775 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939738c-dee8-4c3e-822b-9a5a3cf55ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:47.266352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939738c-dee8-4c3e-822b-9a5a3cf55ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:47.266851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939738c-dee8-4c3e-822b-9a5a3cf55ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:47.278929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939738c-dee8-4c3e-822b-9a5a3cf55ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:47.280615 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939738c-dee8-4c3e-822b-9a5a3cf55ce4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:47.296545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-d939738c-dee8-4c3e-822b-9a5a3cf55ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:47.296545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:47.296545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:47.296545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:47.296545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:47.296545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:47.296545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:47.296545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:47.296545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:47.296545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:47.296545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:47.296545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:47.296545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:47.296545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:47.296545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:47.296545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:47.297458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:47.297458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:47.297458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:47.297458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:47.297458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:47.297458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:47.297458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:47.297458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:47.297458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:47.297458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:47.297458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:47.297458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:47.297458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:47.297458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:47.297458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:47.297458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:47.297458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:47.298305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:47.298305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:47.298305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:47.300454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 270/529] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:47.301426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939738c-dee8-4c3e-822b-9a5a3cf55ce4 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:47.344383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:47.353514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83141efa-7eba-4cbc-b43d-ddee6a80f216 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:47.388583 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fda3c-353a-4c0d-9635-e8f4ec379ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:47.389127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fda3c-353a-4c0d-9635-e8f4ec379ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:47.389412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fda3c-353a-4c0d-9635-e8f4ec379ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:47.389684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fda3c-353a-4c0d-9635-e8f4ec379ae5 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:47.390329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fda3c-353a-4c0d-9635-e8f4ec379ae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:47.390643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fda3c-353a-4c0d-9635-e8f4ec379ae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:47.392025 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fda3c-353a-4c0d-9635-e8f4ec379ae5 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:47.404137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 260/530] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:47.405015 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fda3c-353a-4c0d-9635-e8f4ec379ae5 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:47.417337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939738c-dee8-4c3e-822b-9a5a3cf55ce4 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:47.420075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:47.456355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947caccd-0077-4bbd-86a8-e7b5305208ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:47.457294 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947caccd-0077-4bbd-86a8-e7b5305208ab None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:47.457768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947caccd-0077-4bbd-86a8-e7b5305208ab None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:47.458232 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947caccd-0077-4bbd-86a8-e7b5305208ab None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:47.459226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947caccd-0077-4bbd-86a8-e7b5305208ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:47.459768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947caccd-0077-4bbd-86a8-e7b5305208ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:47.461321 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947caccd-0077-4bbd-86a8-e7b5305208ab None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:47.474661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 271/531] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:47.475719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947caccd-0077-4bbd-86a8-e7b5305208ab None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:47.522914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fda3c-353a-4c0d-9635-e8f4ec379ae5 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:47.570604 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741fcdd-f9a9-4418-83da-33d241f9e7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:47.571261 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741fcdd-f9a9-4418-83da-33d241f9e7ac None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:47.571544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741fcdd-f9a9-4418-83da-33d241f9e7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:47.571871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741fcdd-f9a9-4418-83da-33d241f9e7ac None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:47.572520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741fcdd-f9a9-4418-83da-33d241f9e7ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:47.572851 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741fcdd-f9a9-4418-83da-33d241f9e7ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:47.574224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741fcdd-f9a9-4418-83da-33d241f9e7ac None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:47.586114 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 261/532] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:47.591060 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741fcdd-f9a9-4418-83da-33d241f9e7ac None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:47.605666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947caccd-0077-4bbd-86a8-e7b5305208ab None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:47.611416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:47.656431 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3e191-400c-46f6-96c0-c119f67db3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:47.657327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3e191-400c-46f6-96c0-c119f67db3bf None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:47.657608 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3e191-400c-46f6-96c0-c119f67db3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:47.657884 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3e191-400c-46f6-96c0-c119f67db3bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:47.671074 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3e191-400c-46f6-96c0-c119f67db3bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:47.672731 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3e191-400c-46f6-96c0-c119f67db3bf None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:47.695698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-cfe3e191-400c-46f6-96c0-c119f67db3bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:47.695698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:47.695698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:47.695698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:47.695698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:47.695698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:47.695698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:47.695698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:47.695698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:47.695698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:47.695698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:47.695698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:47.695698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:19:47.695698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:19:47.695698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:19:47.696605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:19:47.696605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:47.696605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:47.696605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:47.696605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:47.696605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:47.696605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:47.696605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:47.696605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:47.696605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:47.696605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:47.696605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:47.696605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:47.696605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:47.696605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:47.696605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:47.696605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:47.697457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:19:47.697457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:19:47.697457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:19:47.697457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:19:47.697457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:19:47.697457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:19:47.697457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:47.697457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:47.700639 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 272/533] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:47.701856 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3e191-400c-46f6-96c0-c119f67db3bf None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:47.713084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741fcdd-f9a9-4418-83da-33d241f9e7ac None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:47.745574 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:47.748527 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198b6ab-3e00-4e1f-a1aa-1cd2bd21ca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:47.749276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198b6ab-3e00-4e1f-a1aa-1cd2bd21ca73 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:47.749567 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198b6ab-3e00-4e1f-a1aa-1cd2bd21ca73 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:47.749911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198b6ab-3e00-4e1f-a1aa-1cd2bd21ca73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:47.757147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198b6ab-3e00-4e1f-a1aa-1cd2bd21ca73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:47.758711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198b6ab-3e00-4e1f-a1aa-1cd2bd21ca73 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:47.771550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-9198b6ab-3e00-4e1f-a1aa-1cd2bd21ca73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:47.771550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:47.771550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:47.771550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:47.771550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:47.771550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:47.771550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:47.771550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:47.771550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:47.771550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:47.771550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:47.771550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:47.771550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:19:47.771550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:19:47.771550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:19:47.772417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:19:47.772417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:47.772417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:47.772417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:47.772417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:47.772417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:47.772417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:47.772417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:47.772417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:47.772417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:47.772417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:47.772417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:47.772417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:47.772417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:47.772417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:47.772417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:47.772417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:47.773421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:19:47.773421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:19:47.773421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:19:47.773421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:19:47.773421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:19:47.773421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:19:47.773421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:47.773421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:47.773421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 262/534] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:47.774344 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198b6ab-3e00-4e1f-a1aa-1cd2bd21ca73 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:47.844525 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3e191-400c-46f6-96c0-c119f67db3bf None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:47.850275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:47.882755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198b6ab-3e00-4e1f-a1aa-1cd2bd21ca73 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:47.896167 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46c5ab-6bed-4c4d-a583-aa878a194be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:47.897228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46c5ab-6bed-4c4d-a583-aa878a194be7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:47.898171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46c5ab-6bed-4c4d-a583-aa878a194be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:47.898792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46c5ab-6bed-4c4d-a583-aa878a194be7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:47.907911 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46c5ab-6bed-4c4d-a583-aa878a194be7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:47.910054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46c5ab-6bed-4c4d-a583-aa878a194be7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:47.920031 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30a251-cf67-4f45-8a9d-f8ce230df429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:47.920716 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30a251-cf67-4f45-8a9d-f8ce230df429 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:47.921146 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30a251-cf67-4f45-8a9d-f8ce230df429 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:47.921470 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30a251-cf67-4f45-8a9d-f8ce230df429 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:47.922291 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30a251-cf67-4f45-8a9d-f8ce230df429 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:47.922746 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30a251-cf67-4f45-8a9d-f8ce230df429 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:47.924260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30a251-cf67-4f45-8a9d-f8ce230df429 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:47.927322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-8a46c5ab-6bed-4c4d-a583-aa878a194be7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:47.927322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:47.927322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:47.927322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:47.927322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:47.927322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:47.927322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:47.927322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:47.927322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:47.927322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:47.927322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:47.927322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:47.927322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:19:47.927322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:19:47.927322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:19:47.928310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:19:47.928310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:47.928310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:47.928310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:47.928310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:47.928310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:47.928310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:47.928310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:47.928310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:47.928310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:47.928310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:47.928310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:47.928310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:47.928310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:47.928310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:47.928310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:47.928310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:47.929372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:19:47.929372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:19:47.929372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:19:47.929372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:19:47.929372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:19:47.929372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:19:47.929372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:47.929372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:47.931456 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 273/535] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:47.933172 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46c5ab-6bed-4c4d-a583-aa878a194be7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:47.945733 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 263/536] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:47.947191 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30a251-cf67-4f45-8a9d-f8ce230df429 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:48.031852 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:48.049434 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46c5ab-6bed-4c4d-a583-aa878a194be7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:48.081142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30a251-cf67-4f45-8a9d-f8ce230df429 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:48.085500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d752a7-7503-4947-b15f-9d4d33edf77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:48.086328 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d752a7-7503-4947-b15f-9d4d33edf77b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.086776 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d752a7-7503-4947-b15f-9d4d33edf77b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.087114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d752a7-7503-4947-b15f-9d4d33edf77b None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.087902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d752a7-7503-4947-b15f-9d4d33edf77b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:48.088297 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d752a7-7503-4947-b15f-9d4d33edf77b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:48.089799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d752a7-7503-4947-b15f-9d4d33edf77b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:48.113611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 274/537] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:48.114693 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d752a7-7503-4947-b15f-9d4d33edf77b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:48.116074 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:48.123926 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fe571-5655-45f3-ac4c-d2db89e5a453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:48.124535 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fe571-5655-45f3-ac4c-d2db89e5a453 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.124822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fe571-5655-45f3-ac4c-d2db89e5a453 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.125616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fe571-5655-45f3-ac4c-d2db89e5a453 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.126314 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fe571-5655-45f3-ac4c-d2db89e5a453 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:48.126648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fe571-5655-45f3-ac4c-d2db89e5a453 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:48.128544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fe571-5655-45f3-ac4c-d2db89e5a453 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:48.146716 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 264/538] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:48.147574 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fe571-5655-45f3-ac4c-d2db89e5a453 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:48.234497 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d752a7-7503-4947-b15f-9d4d33edf77b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:48.277238 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947bb5d-3fd1-497f-ab67-29e3d66b5490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:48.277831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947bb5d-3fd1-497f-ab67-29e3d66b5490 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.278103 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947bb5d-3fd1-497f-ab67-29e3d66b5490 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.278367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947bb5d-3fd1-497f-ab67-29e3d66b5490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.279114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947bb5d-3fd1-497f-ab67-29e3d66b5490 None admin] RBAC: Adding query filter params (role.id=21a27b57a72246b2ade92d82599c569d, scope.project.id=9527063094354a99a80822107d2740fb, user.id=b11356a5e3d041729f71515482033dce) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:48.279420 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947bb5d-3fd1-497f-ab67-29e3d66b5490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:48.280852 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947bb5d-3fd1-497f-ab67-29e3d66b5490 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:48.283284 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fe571-5655-45f3-ac4c-d2db89e5a453 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:48.287437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 275/539] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:48 2022] GET /identity/v3/role_assignments?user.id=b11356a5e3d041729f71515482033dce&scope.project.id=9527063094354a99a80822107d2740fb&role.id=21a27b57a72246b2ade92d82599c569d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:48.287565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947bb5d-3fd1-497f-ab67-29e3d66b5490 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:48.300256 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:48.328058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f6e30-712f-4026-95cc-72708bb274b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:48.329045 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f6e30-712f-4026-95cc-72708bb274b7 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.329591 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f6e30-712f-4026-95cc-72708bb274b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.330066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f6e30-712f-4026-95cc-72708bb274b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.331168 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f6e30-712f-4026-95cc-72708bb274b7 None admin] RBAC: Adding query filter params (role.id=21a27b57a72246b2ade92d82599c569d, scope.project.id=9527063094354a99a80822107d2740fb, user.id=d494fd310b1f40839f113d045f0bdcb9) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:48.331681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f6e30-712f-4026-95cc-72708bb274b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:48.333319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f6e30-712f-4026-95cc-72708bb274b7 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:48.340565 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 265/540] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:48 2022] GET /identity/v3/role_assignments?user.id=d494fd310b1f40839f113d045f0bdcb9&scope.project.id=9527063094354a99a80822107d2740fb&role.id=21a27b57a72246b2ade92d82599c569d => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:48.462871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947bb5d-3fd1-497f-ab67-29e3d66b5490 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:48.513408 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28695d1c-04f5-49aa-8710-e2dcc98737ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:48.513944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28695d1c-04f5-49aa-8710-e2dcc98737ca None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.514221 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28695d1c-04f5-49aa-8710-e2dcc98737ca None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.514493 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28695d1c-04f5-49aa-8710-e2dcc98737ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.515271 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28695d1c-04f5-49aa-8710-e2dcc98737ca None admin] RBAC: Adding query filter params (role.id=21a27b57a72246b2ade92d82599c569d, scope.project.id=9527063094354a99a80822107d2740fb, user.id=5a0dece90fc54641be30cdc2ddad9cf4) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:48.515582 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28695d1c-04f5-49aa-8710-e2dcc98737ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:48.517042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28695d1c-04f5-49aa-8710-e2dcc98737ca None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:48.533025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 276/541] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:48 2022] GET /identity/v3/role_assignments?user.id=5a0dece90fc54641be30cdc2ddad9cf4&scope.project.id=9527063094354a99a80822107d2740fb&role.id=21a27b57a72246b2ade92d82599c569d => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:48.573470 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fac445-303a-438a-a532-bde2ef355140 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.573967 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fac445-303a-438a-a532-bde2ef355140 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.574041 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fac445-303a-438a-a532-bde2ef355140 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.575728 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 266/542] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:48.581449 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbbc00-0acd-4055-a568-2f5194ef95a1 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.581744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbbc00-0acd-4055-a568-2f5194ef95a1 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.582003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbbc00-0acd-4055-a568-2f5194ef95a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.601605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-50dbbc00-0acd-4055-a568-2f5194ef95a1 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:48.602849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-50dbbc00-0acd-4055-a568-2f5194ef95a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:48.706101 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 277/543] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:48.895534 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a3a3b-5314-4adf-8bc1-d1ec840a9d18 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.895899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a3a3b-5314-4adf-8bc1-d1ec840a9d18 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.896083 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a3a3b-5314-4adf-8bc1-d1ec840a9d18 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.897720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 267/544] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:48.909884 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9d4bf-fe16-433a-baa8-5e3a542b73b1 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.909884 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9d4bf-fe16-433a-baa8-5e3a542b73b1 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.909884 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9d4bf-fe16-433a-baa8-5e3a542b73b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.916375 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:48.932399 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f6b9d4bf-fe16-433a-baa8-5e3a542b73b1 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:48.933938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f6b9d4bf-fe16-433a-baa8-5e3a542b73b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:49.004511 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 278/545] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:49.099739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a3a3b-5314-4adf-8bc1-d1ec840a9d18 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:49.161045 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:49.207878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a3a3b-5314-4adf-8bc1-d1ec840a9d18 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:49.243982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeebed-6a7d-4b92-988b-459345fe2b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:49.244997 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeebed-6a7d-4b92-988b-459345fe2b4e None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:49.245477 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeebed-6a7d-4b92-988b-459345fe2b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:49.245941 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeebed-6a7d-4b92-988b-459345fe2b4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:49.256644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baeebed-6a7d-4b92-988b-459345fe2b4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:49.261806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-5baeebed-6a7d-4b92-988b-459345fe2b4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:49.261806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:49.261806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:49.261806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:49.261806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:49.261806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:49.261806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:49.261806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:49.261806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:49.261806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:49.261806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:49.261806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:49.261806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:49.261806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:49.261806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:49.261806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:49.262734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:49.262734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:49.262734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:49.262734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:49.262734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:49.262734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:49.262734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:49.262734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:49.262734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:49.262734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:49.262734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:49.262734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:49.262734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:49.262734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:49.262734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:49.262734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:49.263564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:49.263564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:49.263564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:49.263564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:49.263564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:49.263564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:49.263564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:49.263564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:49.263564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:49.263564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:49.263564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:49.263564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:49.266072 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 268/546] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:49.272053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9d4bf-fe16-433a-baa8-5e3a542b73b1 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:49.331477 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeebed-6a7d-4b92-988b-459345fe2b4e None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:49.411302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9d4bf-fe16-433a-baa8-5e3a542b73b1 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:49.442139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:49.448117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6a63a-da1a-4039-8181-d3dfb0bd1fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:49.448969 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6a63a-da1a-4039-8181-d3dfb0bd1fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:49.449661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6a63a-da1a-4039-8181-d3dfb0bd1fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:49.450137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6a63a-da1a-4039-8181-d3dfb0bd1fc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:49.451056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6a63a-da1a-4039-8181-d3dfb0bd1fc7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:49.451670 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6a63a-da1a-4039-8181-d3dfb0bd1fc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:49.453249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6a63a-da1a-4039-8181-d3dfb0bd1fc7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:49.472620 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeebed-6a7d-4b92-988b-459345fe2b4e None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:49.474666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 279/547] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:49.483816 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6a63a-da1a-4039-8181-d3dfb0bd1fc7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:49.512794 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:49.546682 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8f80c-5dc3-49e9-a10c-f80afcb8f9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:49.548343 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8f80c-5dc3-49e9-a10c-f80afcb8f9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:49.549365 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8f80c-5dc3-49e9-a10c-f80afcb8f9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:49.550011 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8f80c-5dc3-49e9-a10c-f80afcb8f9b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:49.571205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8f80c-5dc3-49e9-a10c-f80afcb8f9b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:49.578721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-efa8f80c-5dc3-49e9-a10c-f80afcb8f9b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:49.578721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:49.578721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:49.578721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:49.578721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:49.578721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:49.578721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:49.578721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:49.578721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:49.578721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:49.578721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:49.578721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:49.578721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:49.578721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:49.578721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:49.578721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:49.580063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:49.580063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:49.580063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:49.580063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:49.580063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:49.580063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:49.580063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:49.580063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:49.580063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:49.580063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:49.580063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:49.580063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:49.580063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:49.580063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:49.580063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:49.580063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:49.580882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:49.580882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:49.580882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:49.580882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:49.580882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:49.580882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:49.580882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:49.580882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:49.580882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:49.580882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:49.580882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:49.580882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:49.586887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 269/548] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:19:49.592131 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8f80c-5dc3-49e9-a10c-f80afcb8f9b0 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:49.663294 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6a63a-da1a-4039-8181-d3dfb0bd1fc7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:49.708695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4be38-9133-4686-a3e4-3bc3e79dc342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:49.709311 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4be38-9133-4686-a3e4-3bc3e79dc342 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:49.709619 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4be38-9133-4686-a3e4-3bc3e79dc342 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:49.709894 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4be38-9133-4686-a3e4-3bc3e79dc342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:49.725555 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4be38-9133-4686-a3e4-3bc3e79dc342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:49.727031 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4be38-9133-4686-a3e4-3bc3e79dc342 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:49.751786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-83a4be38-9133-4686-a3e4-3bc3e79dc342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:49.751786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:49.751786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:49.751786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:49.751786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:49.751786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:49.751786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:49.751786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:49.751786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:49.751786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:49.751786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:49.751786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:49.751786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:49.751786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:49.751786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:49.751786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:49.753332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:49.753332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:49.753332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:49.753332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:49.753332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:49.753332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:49.753332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:49.753332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:49.753332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:49.753332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:49.753332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:49.753332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:49.753332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:49.753332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:49.753332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:49.753332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:49.753332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:49.754362 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:49.754362 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:49.754362 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:49.756649 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 280/549] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:49.761512 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4be38-9133-4686-a3e4-3bc3e79dc342 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:49.795674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8f80c-5dc3-49e9-a10c-f80afcb8f9b0 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:49.847404 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:49.870659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fc3a7-9149-4c56-99f1-ccc7906ca96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:49.871331 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fc3a7-9149-4c56-99f1-ccc7906ca96b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:49.871613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fc3a7-9149-4c56-99f1-ccc7906ca96b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:49.871886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fc3a7-9149-4c56-99f1-ccc7906ca96b None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:49.872558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fc3a7-9149-4c56-99f1-ccc7906ca96b None admin] RBAC: Adding query filter params (name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:49.872862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fc3a7-9149-4c56-99f1-ccc7906ca96b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:49.875593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fc3a7-9149-4c56-99f1-ccc7906ca96b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:49.893370 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 270/550] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:49.899005 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fc3a7-9149-4c56-99f1-ccc7906ca96b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:49.956856 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4be38-9133-4686-a3e4-3bc3e79dc342 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:49.984380 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:50.024156 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934791fd-1d12-4df8-b1e7-618c8948a287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:50.025839 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934791fd-1d12-4df8-b1e7-618c8948a287 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.026785 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934791fd-1d12-4df8-b1e7-618c8948a287 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.027835 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934791fd-1d12-4df8-b1e7-618c8948a287 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.028744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934791fd-1d12-4df8-b1e7-618c8948a287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:50.029366 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934791fd-1d12-4df8-b1e7-618c8948a287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:50.031450 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934791fd-1d12-4df8-b1e7-618c8948a287 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:50.056407 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 281/551] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:50.070971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934791fd-1d12-4df8-b1e7-618c8948a287 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:50.086645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fc3a7-9149-4c56-99f1-ccc7906ca96b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:50.119942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48baa7b-a425-42da-bbff-e25a173b1075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:50.120584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48baa7b-a425-42da-bbff-e25a173b1075 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.120863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48baa7b-a425-42da-bbff-e25a173b1075 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.121133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48baa7b-a425-42da-bbff-e25a173b1075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.144059 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48baa7b-a425-42da-bbff-e25a173b1075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:50.145541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48baa7b-a425-42da-bbff-e25a173b1075 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:50.169585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-e48baa7b-a425-42da-bbff-e25a173b1075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:50.169585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:50.169585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:50.169585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:50.169585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:50.169585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:50.169585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:50.169585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:50.169585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:50.169585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:50.169585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:50.169585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:50.169585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:50.169585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:50.169585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:50.169585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:50.170646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:50.170646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:50.170646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:50.170646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:50.170646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:50.170646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:50.170646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:50.170646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:50.170646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:50.170646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:50.170646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:50.170646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:50.170646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:50.170646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:50.170646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:50.170646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:50.170646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:50.171628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:50.171628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:50.171628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:50.173832 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 271/552] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:19:50.176351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48baa7b-a425-42da-bbff-e25a173b1075 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:50.280834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934791fd-1d12-4df8-b1e7-618c8948a287 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:50.293613 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:50.294024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:50.299837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48baa7b-a425-42da-bbff-e25a173b1075 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:50.336756 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56208856-ad9c-438f-be4c-231795f42f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:50.337372 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56208856-ad9c-438f-be4c-231795f42f25 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.337656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56208856-ad9c-438f-be4c-231795f42f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.337931 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56208856-ad9c-438f-be4c-231795f42f25 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.338791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56208856-ad9c-438f-be4c-231795f42f25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:50.339100 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56208856-ad9c-438f-be4c-231795f42f25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:50.340484 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56208856-ad9c-438f-be4c-231795f42f25 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:50.353350 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 272/553] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:50.362570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56208856-ad9c-438f-be4c-231795f42f25 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:50.376402 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362fe42-dd58-49df-8917-d6de709c5e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:50.377048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362fe42-dd58-49df-8917-d6de709c5e50 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.377326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362fe42-dd58-49df-8917-d6de709c5e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.377596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362fe42-dd58-49df-8917-d6de709c5e50 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.395708 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362fe42-dd58-49df-8917-d6de709c5e50 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:50.397166 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362fe42-dd58-49df-8917-d6de709c5e50 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:50.420706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-7362fe42-dd58-49df-8917-d6de709c5e50 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:19:50.420706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:50.420706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:50.420706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:50.420706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:50.420706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:50.420706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:50.420706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:50.420706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:50.420706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:50.420706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:50.420706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:50.420706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:50.420706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:50.420706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:50.420706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:50.421766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:50.422699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:50.422699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:50.422699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:50.422699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:50.422699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:50.422699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:50.422699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:50.422699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:50.422699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:19:50.422699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:50.431063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 282/554] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:19:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:50.437609 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362fe42-dd58-49df-8917-d6de709c5e50 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:50.471474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56208856-ad9c-438f-be4c-231795f42f25 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:50.524275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a26957-e5da-403e-9089-ba96069b0a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:50.524905 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a26957-e5da-403e-9089-ba96069b0a7e None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.525183 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a26957-e5da-403e-9089-ba96069b0a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.525444 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a26957-e5da-403e-9089-ba96069b0a7e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.542181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a26957-e5da-403e-9089-ba96069b0a7e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:50.543571 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a26957-e5da-403e-9089-ba96069b0a7e None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:50.563700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-86a26957-e5da-403e-9089-ba96069b0a7e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:19:50.563700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:50.563700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:50.563700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:50.563700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:50.563700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:50.563700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:50.563700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:50.563700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:50.563700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:50.563700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:50.563700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:50.563700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:50.563700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:50.563700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:50.563700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:50.564684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:50.566113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:50.566113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:50.566113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:50.566113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:50.566113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:50.566113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:50.566113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:50.566113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:50.566113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:19:50.566113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:50.566113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 273/555] 10.222.0.71 () {56 vars in 1093 bytes} [Thu Sep 1 16:19:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:19:50.571529 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a26957-e5da-403e-9089-ba96069b0a7e None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:50.594254 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:50.630694 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362fe42-dd58-49df-8917-d6de709c5e50 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:50.677675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77590cb8-746c-475e-a130-81479ad808d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:50.678648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77590cb8-746c-475e-a130-81479ad808d8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.679467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77590cb8-746c-475e-a130-81479ad808d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.680516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77590cb8-746c-475e-a130-81479ad808d8 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.681760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77590cb8-746c-475e-a130-81479ad808d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:50.682341 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77590cb8-746c-475e-a130-81479ad808d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:50.685263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77590cb8-746c-475e-a130-81479ad808d8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:50.708380 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 283/556] 10.222.0.71 () {56 vars in 1135 bytes} [Thu Sep 1 16:19:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:50.710682 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f093d-612a-4ed9-8dc2-924bc98d3e59 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.711805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f093d-612a-4ed9-8dc2-924bc98d3e59 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.712212 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f093d-612a-4ed9-8dc2-924bc98d3e59 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.714606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 284/557] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:50.715473 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f093d-612a-4ed9-8dc2-924bc98d3e59 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:50.722635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a26957-e5da-403e-9089-ba96069b0a7e None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:50.749403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:50.762428 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13523ce-4b4d-4ab1-ae34-d7d01d9bcd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:50.763134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13523ce-4b4d-4ab1-ae34-d7d01d9bcd50 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.763478 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13523ce-4b4d-4ab1-ae34-d7d01d9bcd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.764492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13523ce-4b4d-4ab1-ae34-d7d01d9bcd50 None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.764604 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13523ce-4b4d-4ab1-ae34-d7d01d9bcd50 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:50.764840 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13523ce-4b4d-4ab1-ae34-d7d01d9bcd50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:50.766270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13523ce-4b4d-4ab1-ae34-d7d01d9bcd50 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:50.785550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 274/558] 10.222.0.71 () {56 vars in 1133 bytes} [Thu Sep 1 16:19:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:50.786886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff70ff-dc7e-4065-bbe4-998863c9121b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.787177 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff70ff-dc7e-4065-bbe4-998863c9121b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.787454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff70ff-dc7e-4065-bbe4-998863c9121b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.806672 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-f4ff70ff-dc7e-4065-bbe4-998863c9121b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:50.807824 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f4ff70ff-dc7e-4065-bbe4-998863c9121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:50.832868 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f093d-612a-4ed9-8dc2-924bc98d3e59 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:50.866899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:50.869060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8918f99-afc2-4825-8a4d-844ba7415e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:50.869688 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8918f99-afc2-4825-8a4d-844ba7415e64 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.869958 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8918f99-afc2-4825-8a4d-844ba7415e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.870240 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8918f99-afc2-4825-8a4d-844ba7415e64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.872695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 275/559] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:50.873815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa04362-4b5c-4ea0-924e-808d1aec802b None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.874091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa04362-4b5c-4ea0-924e-808d1aec802b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.874360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa04362-4b5c-4ea0-924e-808d1aec802b None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.876171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 276/560] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:50.876586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b83aaa-bfc2-4014-9808-7c5d5652379d None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.876857 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b83aaa-bfc2-4014-9808-7c5d5652379d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.877122 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b83aaa-bfc2-4014-9808-7c5d5652379d None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.878261 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 277/561] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:50.878962 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b83aaa-bfc2-4014-9808-7c5d5652379d None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:50.948046 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8918f99-afc2-4825-8a4d-844ba7415e64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:50.949765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8918f99-afc2-4825-8a4d-844ba7415e64 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:50.978676 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:50.988444 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b83aaa-bfc2-4014-9808-7c5d5652379d None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.024180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ba25e-964a-4450-9312-082fb848dd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.024793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ba25e-964a-4450-9312-082fb848dd71 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.025065 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ba25e-964a-4450-9312-082fb848dd71 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.025331 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ba25e-964a-4450-9312-082fb848dd71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.037352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ba25e-964a-4450-9312-082fb848dd71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:51.038933 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ba25e-964a-4450-9312-082fb848dd71 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:51.054965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-420ba25e-964a-4450-9312-082fb848dd71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:51.054965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:51.054965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:51.054965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:51.054965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:51.054965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:51.054965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:51.054965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:51.054965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:51.054965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:51.054965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:51.054965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:51.054965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:51.054965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:51.054965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:51.054965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:51.055923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:51.055923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:51.055923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:51.055923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:51.055923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:51.055923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:51.055923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:51.055923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:51.055923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:51.055923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:51.055923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:51.055923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:51.055923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:51.055923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:51.055923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:51.055923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:51.055923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:51.056966 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:51.056966 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:51.056966 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:51.056966 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 278/562] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:51.057480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87a34f-19d5-4b53-a1f4-93c4346bacf1 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.057600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87a34f-19d5-4b53-a1f4-93c4346bacf1 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.057877 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87a34f-19d5-4b53-a1f4-93c4346bacf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.069903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 285/563] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:51.071436 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92381f2c-8b92-4a89-a666-f105543b1f20 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.071911 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92381f2c-8b92-4a89-a666-f105543b1f20 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.072255 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92381f2c-8b92-4a89-a666-f105543b1f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.076364 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-bd87a34f-19d5-4b53-a1f4-93c4346bacf1 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:51.077552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-bd87a34f-19d5-4b53-a1f4-93c4346bacf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:51.090796 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-92381f2c-8b92-4a89-a666-f105543b1f20 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:51.091970 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-92381f2c-8b92-4a89-a666-f105543b1f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:51.125696 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:51.148526 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 279/564] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:51.149354 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87a34f-19d5-4b53-a1f4-93c4346bacf1 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:51.166640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 286/565] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:51.166640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92381f2c-8b92-4a89-a666-f105543b1f20 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:51.223109 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:51.271602 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92381f2c-8b92-4a89-a666-f105543b1f20 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.292774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87a34f-19d5-4b53-a1f4-93c4346bacf1 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.309613 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f798926-91cd-49ae-a757-f787fc0c4b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.310280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f798926-91cd-49ae-a757-f787fc0c4b21 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.310587 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f798926-91cd-49ae-a757-f787fc0c4b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.310956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f798926-91cd-49ae-a757-f787fc0c4b21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.321728 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f798926-91cd-49ae-a757-f787fc0c4b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:51.323875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f798926-91cd-49ae-a757-f787fc0c4b21 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:51.334759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e417b7-b23f-4019-97e4-881d71b27016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.335476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e417b7-b23f-4019-97e4-881d71b27016 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.335816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e417b7-b23f-4019-97e4-881d71b27016 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.336174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e417b7-b23f-4019-97e4-881d71b27016 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.336877 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e417b7-b23f-4019-97e4-881d71b27016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:51.337238 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e417b7-b23f-4019-97e4-881d71b27016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:51.338753 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e417b7-b23f-4019-97e4-881d71b27016 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:51.339234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-8f798926-91cd-49ae-a757-f787fc0c4b21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:51.339234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:51.339234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:51.339234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:51.339234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:51.339234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:51.339234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:51.339234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:51.339234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:51.339234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:51.339234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:51.339234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:51.339234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:51.339234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:51.339234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:51.339234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:51.340137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:51.340137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:51.340137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:51.340137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:51.340137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:51.340137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:51.340137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:51.340137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:51.340137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:51.340137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:51.340137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:51.340137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:51.340137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:51.340137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:51.340137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:51.340137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:51.340137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:51.341020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:51.341020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:51.341020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:51.341020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 287/566] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:51.341900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f798926-91cd-49ae-a757-f787fc0c4b21 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:51.358293 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 280/567] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:51.359474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e417b7-b23f-4019-97e4-881d71b27016 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:51.413345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:51.455201 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f798926-91cd-49ae-a757-f787fc0c4b21 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.464299 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:51.480499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e417b7-b23f-4019-97e4-881d71b27016 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.491609 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5948cc-a47e-4054-9b6c-98489601bbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.492319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5948cc-a47e-4054-9b6c-98489601bbfe None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.492597 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5948cc-a47e-4054-9b6c-98489601bbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.492861 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5948cc-a47e-4054-9b6c-98489601bbfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.502686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5948cc-a47e-4054-9b6c-98489601bbfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:51.507915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-4a5948cc-a47e-4054-9b6c-98489601bbfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:51.507915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:51.507915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:51.507915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:51.507915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:51.507915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:51.507915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:51.507915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:51.507915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:51.507915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:51.507915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:51.507915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:51.507915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:51.507915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:51.507915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:51.507915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:51.510705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:51.510705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:51.510705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:51.510705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:51.510705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:51.510705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:51.510705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:51.510705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:51.510705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:51.510705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:51.510705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:51.510705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:51.510705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:51.510705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:51.510705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:51.510705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:51.511749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:51.511749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:51.511749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:51.511749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:51.511749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:51.511749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:51.511749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:51.511749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:51.511749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:51.511749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:51.511749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:51.511749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:51.511749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 288/568] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:51.511749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5948cc-a47e-4054-9b6c-98489601bbfe None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:51.518633 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abeb741-2f0f-407e-b5c8-59434879f3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.519240 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeb741-2f0f-407e-b5c8-59434879f3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.519521 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeb741-2f0f-407e-b5c8-59434879f3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.519821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeb741-2f0f-407e-b5c8-59434879f3f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.520467 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abeb741-2f0f-407e-b5c8-59434879f3f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:51.520768 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abeb741-2f0f-407e-b5c8-59434879f3f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:51.522139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abeb741-2f0f-407e-b5c8-59434879f3f3 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:51.534563 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 281/569] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:51.535477 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abeb741-2f0f-407e-b5c8-59434879f3f3 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:51.609625 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5948cc-a47e-4054-9b6c-98489601bbfe None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.633894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:51.637363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abeb741-2f0f-407e-b5c8-59434879f3f3 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.647773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5107b-bdc3-4949-8a7a-fbab46c1ee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.648399 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5107b-bdc3-4949-8a7a-fbab46c1ee20 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.648674 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5107b-bdc3-4949-8a7a-fbab46c1ee20 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.648941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5107b-bdc3-4949-8a7a-fbab46c1ee20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.655496 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5107b-bdc3-4949-8a7a-fbab46c1ee20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:51.656928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5107b-bdc3-4949-8a7a-fbab46c1ee20 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:51.668446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-d5d5107b-bdc3-4949-8a7a-fbab46c1ee20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:51.668446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:51.668446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:51.668446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:51.668446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:51.668446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:51.668446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:51.668446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:51.668446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:51.668446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:51.668446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:51.668446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:51.668446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:19:51.668446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:19:51.668446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:19:51.669316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:19:51.669316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:51.669316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:51.669316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:51.669316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:51.669316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:51.669316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:51.669316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:51.669316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:51.669316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:51.669316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:51.669316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:51.669316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:51.669316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:51.669316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:51.669316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:51.669316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:51.670207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:19:51.670207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:19:51.670207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:19:51.670207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:19:51.670207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:19:51.670207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:19:51.670207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:51.670207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:51.670207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 289/570] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:51.670721 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5107b-bdc3-4949-8a7a-fbab46c1ee20 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:51.675816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc8db5-95ca-4e94-9df2-5296689a5dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.676444 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc8db5-95ca-4e94-9df2-5296689a5dac None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.676718 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc8db5-95ca-4e94-9df2-5296689a5dac None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.676993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc8db5-95ca-4e94-9df2-5296689a5dac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.686938 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc8db5-95ca-4e94-9df2-5296689a5dac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:51.691707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-66bc8db5-95ca-4e94-9df2-5296689a5dac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:51.691707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:51.691707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:51.691707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:51.691707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:51.691707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:51.691707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:51.691707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:51.691707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:51.691707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:51.691707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:51.691707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:51.691707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:51.691707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:51.691707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:51.691707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:51.692859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:51.692859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:51.692859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:51.692859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:51.692859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:51.692859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:51.692859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:51.692859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:51.692859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:51.692859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:51.692859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:51.692859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:51.692859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:51.692859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:51.692859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:51.692859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:51.693899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:51.693899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:51.693899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:51.693899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:51.693899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:51.693899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:51.693899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:51.693899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:51.693899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:51.693899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:51.693899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:51.693899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:51.693899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 282/571] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:51.693899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc8db5-95ca-4e94-9df2-5296689a5dac None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:51.701203 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:51.772565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5107b-bdc3-4949-8a7a-fbab46c1ee20 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.792088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc8db5-95ca-4e94-9df2-5296689a5dac None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.804860 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27a96d-aa67-43a9-8ba5-15b0461f89be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.805476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27a96d-aa67-43a9-8ba5-15b0461f89be None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.805754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27a96d-aa67-43a9-8ba5-15b0461f89be None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.806025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27a96d-aa67-43a9-8ba5-15b0461f89be None admin] PATH_INFO: `/v3/roles/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.821467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27a96d-aa67-43a9-8ba5-15b0461f89be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:51.826079 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f41f78-01ad-446a-b6c1-5e43729df432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.826710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f41f78-01ad-446a-b6c1-5e43729df432 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.826990 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f41f78-01ad-446a-b6c1-5e43729df432 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.827257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f41f78-01ad-446a-b6c1-5e43729df432 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.828750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f41f78-01ad-446a-b6c1-5e43729df432 None admin] RBAC: Adding query filter params (name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:51.829395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-7d27a96d-aa67-43a9-8ba5-15b0461f89be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:51.829395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:51.829395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:51.829395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:51.829395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:51.829395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:51.829395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:51.829395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:51.829395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:51.829395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:51.829395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:51.829395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:51.829395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:51.829395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:51.829395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:51.829395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:51.830758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:51.830758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:51.830758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:51.830758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:51.830758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:51.830758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:51.830758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:51.830758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:51.830758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:51.830758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:51.830758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:51.830758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:51.830758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:51.830758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:51.830758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:51.830758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:51.831658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:51.831658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:51.831658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:51.831658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:51.831658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:51.831658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:51.831658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:51.831658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:51.831658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:51.831658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:51.831658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:51.831658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:51.832377 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f41f78-01ad-446a-b6c1-5e43729df432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:51.832467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 290/572] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:51.832546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f41f78-01ad-446a-b6c1-5e43729df432 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:51.832618 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27a96d-aa67-43a9-8ba5-15b0461f89be None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:51.842062 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 283/573] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:51.843196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f41f78-01ad-446a-b6c1-5e43729df432 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:51.872643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:51.921909 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:51.937748 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27a96d-aa67-43a9-8ba5-15b0461f89be None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.946551 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f41f78-01ad-446a-b6c1-5e43729df432 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.971103 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208ef09-663f-4a16-bc89-f0dd9065eddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.971711 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208ef09-663f-4a16-bc89-f0dd9065eddc None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.971982 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208ef09-663f-4a16-bc89-f0dd9065eddc None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.972252 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208ef09-663f-4a16-bc89-f0dd9065eddc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.978545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208ef09-663f-4a16-bc89-f0dd9065eddc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:51.978699 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3619b04-b00c-4f9f-84af-21fb4b2c77e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.979741 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3619b04-b00c-4f9f-84af-21fb4b2c77e1 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.980016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3619b04-b00c-4f9f-84af-21fb4b2c77e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.980287 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3619b04-b00c-4f9f-84af-21fb4b2c77e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.980483 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208ef09-663f-4a16-bc89-f0dd9065eddc None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:51.981010 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3619b04-b00c-4f9f-84af-21fb4b2c77e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:51.981266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3619b04-b00c-4f9f-84af-21fb4b2c77e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:51.982690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3619b04-b00c-4f9f-84af-21fb4b2c77e1 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:51.991337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-1208ef09-663f-4a16-bc89-f0dd9065eddc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:51.991337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:51.991337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:51.991337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:51.991337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:51.991337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:51.991337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:51.991337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:51.991337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:51.991337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:51.991337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:51.991337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:51.991337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:19:51.991337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:19:51.991337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:19:51.992249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:19:51.992249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:51.992249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:51.992249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:51.992249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:51.992249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:51.992249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:51.992249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:51.992249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:51.992249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:51.992249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:51.992249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:51.992249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:51.992249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:51.992249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:51.992249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:51.992249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:51.993781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:19:51.993781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:19:51.993781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:19:51.993781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:19:51.993781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:19:51.993781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:19:51.993781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:51.993781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:51.993781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 291/574] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:51.993781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208ef09-663f-4a16-bc89-f0dd9065eddc None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.002185 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 284/575] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:52.002185 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3619b04-b00c-4f9f-84af-21fb4b2c77e1 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.080261 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:52.097276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208ef09-663f-4a16-bc89-f0dd9065eddc None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.099697 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3619b04-b00c-4f9f-84af-21fb4b2c77e1 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.134643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26a970-2355-4076-ab27-2ce600530a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.134832 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff788d-56ba-4332-bbf1-ca812e31cf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.135165 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a970-2355-4076-ab27-2ce600530a3b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.135443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a970-2355-4076-ab27-2ce600530a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.135712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a970-2355-4076-ab27-2ce600530a3b None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.135817 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff788d-56ba-4332-bbf1-ca812e31cf8e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.136034 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff788d-56ba-4332-bbf1-ca812e31cf8e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.136307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff788d-56ba-4332-bbf1-ca812e31cf8e None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.136393 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26a970-2355-4076-ab27-2ce600530a3b None admin] RBAC: Adding query filter params (name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:52.136778 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26a970-2355-4076-ab27-2ce600530a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:52.136973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff788d-56ba-4332-bbf1-ca812e31cf8e None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:52.137276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff788d-56ba-4332-bbf1-ca812e31cf8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:52.138336 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26a970-2355-4076-ab27-2ce600530a3b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:52.138640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff788d-56ba-4332-bbf1-ca812e31cf8e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:52.147917 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 285/576] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:52.148313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 292/577] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:52.149144 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff788d-56ba-4332-bbf1-ca812e31cf8e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.149571 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26a970-2355-4076-ab27-2ce600530a3b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.160696 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:52.247564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff788d-56ba-4332-bbf1-ca812e31cf8e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.253665 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26a970-2355-4076-ab27-2ce600530a3b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.280188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e548b6-25bd-4d9e-9566-441d2a79d6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.280782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e548b6-25bd-4d9e-9566-441d2a79d6fc None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.281057 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e548b6-25bd-4d9e-9566-441d2a79d6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.281321 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e548b6-25bd-4d9e-9566-441d2a79d6fc None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.282000 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e548b6-25bd-4d9e-9566-441d2a79d6fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:52.282298 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e548b6-25bd-4d9e-9566-441d2a79d6fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:52.283845 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e548b6-25bd-4d9e-9566-441d2a79d6fc None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:52.287196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06b1d4-1dc5-4f14-9bff-3704be5e65f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.287813 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06b1d4-1dc5-4f14-9bff-3704be5e65f6 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.288092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06b1d4-1dc5-4f14-9bff-3704be5e65f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.288363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06b1d4-1dc5-4f14-9bff-3704be5e65f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.296013 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 293/578] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:19:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:52.297220 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e548b6-25bd-4d9e-9566-441d2a79d6fc None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.300166 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06b1d4-1dc5-4f14-9bff-3704be5e65f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:52.301609 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06b1d4-1dc5-4f14-9bff-3704be5e65f6 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:52.304155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:52.316731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-be06b1d4-1dc5-4f14-9bff-3704be5e65f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:52.316731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:52.316731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:52.316731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:52.316731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:52.316731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:52.316731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:52.316731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:52.316731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:52.316731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:52.316731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:52.316731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:52.316731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:52.316731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:52.316731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:52.316731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:52.317883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:52.317883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:52.317883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:52.317883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:52.317883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:52.317883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:52.317883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:52.317883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:52.317883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:52.317883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:52.317883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:52.317883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:52.317883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:52.317883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:52.317883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:52.317883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:52.317883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:52.318806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:52.318806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:52.318806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:52.322380 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 286/579] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:52.323292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06b1d4-1dc5-4f14-9bff-3704be5e65f6 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.362963 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:52.396206 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e548b6-25bd-4d9e-9566-441d2a79d6fc None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.421309 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06b1d4-1dc5-4f14-9bff-3704be5e65f6 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.429547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12540f2-c6ef-4754-9bf8-c350a84ff279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.430195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12540f2-c6ef-4754-9bf8-c350a84ff279 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.430468 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12540f2-c6ef-4754-9bf8-c350a84ff279 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.430774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12540f2-c6ef-4754-9bf8-c350a84ff279 None admin] PATH_INFO: `/v3/projects/9527063094354a99a80822107d2740fb/users/ed71d63cd24f4a6caf6ebba2c30d3608/roles/21a27b57a72246b2ade92d82599c569d` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.445090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12540f2-c6ef-4754-9bf8-c350a84ff279 None admin] RBAC: Authorizing `identity:create_grant(project_id=9527063094354a99a80822107d2740fb, user_id=ed71d63cd24f4a6caf6ebba2c30d3608, role_id=21a27b57a72246b2ade92d82599c569d)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:52.446524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12540f2-c6ef-4754-9bf8-c350a84ff279 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:52.454566 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff226da7-07f6-497f-b137-c7e8d7cb81c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.455218 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff226da7-07f6-497f-b137-c7e8d7cb81c4 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.455514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff226da7-07f6-497f-b137-c7e8d7cb81c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.455770 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff226da7-07f6-497f-b137-c7e8d7cb81c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.458592 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 294/580] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:19:52 2022] PUT /identity/v3/projects/9527063094354a99a80822107d2740fb/users/ed71d63cd24f4a6caf6ebba2c30d3608/roles/21a27b57a72246b2ade92d82599c569d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:52.459395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12540f2-c6ef-4754-9bf8-c350a84ff279 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.472890 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff226da7-07f6-497f-b137-c7e8d7cb81c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:52.474475 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff226da7-07f6-497f-b137-c7e8d7cb81c4 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:52.490412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-ff226da7-07f6-497f-b137-c7e8d7cb81c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:52.490412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:52.490412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:52.490412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:52.490412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:52.490412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:52.490412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:52.490412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:52.490412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:52.490412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:52.490412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:52.490412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:52.490412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:52.490412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:52.490412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:52.490412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:52.491736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:52.491736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:52.491736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:52.491736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:52.491736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:52.491736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:52.491736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:52.491736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:52.491736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:52.491736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:52.491736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:52.491736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:52.491736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:52.491736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:52.491736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:52.491736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:52.491736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:52.492641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:52.492641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:52.492641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:52.492641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 287/581] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:52.492641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff226da7-07f6-497f-b137-c7e8d7cb81c4 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.551501 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:52.587366 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12540f2-c6ef-4754-9bf8-c350a84ff279 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.614592 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:52.625185 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff226da7-07f6-497f-b137-c7e8d7cb81c4 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.634149 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d137a93-3796-4a74-851c-75689523621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.635780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d137a93-3796-4a74-851c-75689523621d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.636419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d137a93-3796-4a74-851c-75689523621d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.636764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d137a93-3796-4a74-851c-75689523621d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.649436 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d137a93-3796-4a74-851c-75689523621d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:52.651561 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d137a93-3796-4a74-851c-75689523621d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:52.660609 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f94f0f-d29d-4ce8-80ff-2bbb7d62198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.661210 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f94f0f-d29d-4ce8-80ff-2bbb7d62198b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.661488 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f94f0f-d29d-4ce8-80ff-2bbb7d62198b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.661760 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f94f0f-d29d-4ce8-80ff-2bbb7d62198b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.662481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f94f0f-d29d-4ce8-80ff-2bbb7d62198b None admin] RBAC: Adding query filter params (role.id=21a27b57a72246b2ade92d82599c569d, scope.project.id=9527063094354a99a80822107d2740fb, user.id=9f7afa63815643f580c91df4e4c3bafc) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:52.662821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f94f0f-d29d-4ce8-80ff-2bbb7d62198b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:52.664233 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f94f0f-d29d-4ce8-80ff-2bbb7d62198b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:52.669230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-2d137a93-3796-4a74-851c-75689523621d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:52.669230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:52.669230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:52.669230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:52.669230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:52.669230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:52.669230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:52.669230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:52.669230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:52.669230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:52.669230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:52.669230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:52.669230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:52.669230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:52.669230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:52.669230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:52.670179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:52.670179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:52.670179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:52.670179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:52.670179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:52.670179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:52.670179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:52.670179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:52.670179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:52.670179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:52.670179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:52.670179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:52.670179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:52.670179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:52.670179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:52.670179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:52.670179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:52.671082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:52.671082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:52.671082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:52.671270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 288/582] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:52 2022] GET /identity/v3/role_assignments?user.id=9f7afa63815643f580c91df4e4c3bafc&scope.project.id=9527063094354a99a80822107d2740fb&role.id=21a27b57a72246b2ade92d82599c569d => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:52.671270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f94f0f-d29d-4ce8-80ff-2bbb7d62198b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.672765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 295/583] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:52.673733 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d137a93-3796-4a74-851c-75689523621d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.799462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f94f0f-d29d-4ce8-80ff-2bbb7d62198b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.806010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d137a93-3796-4a74-851c-75689523621d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.814807 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:52.840841 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015916f-ec69-4566-acd4-29aa9020bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.841458 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015916f-ec69-4566-acd4-29aa9020bef6 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.841739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015916f-ec69-4566-acd4-29aa9020bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.842010 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015916f-ec69-4566-acd4-29aa9020bef6 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.842952 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015916f-ec69-4566-acd4-29aa9020bef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:52.843256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015916f-ec69-4566-acd4-29aa9020bef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:52.845570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015916f-ec69-4566-acd4-29aa9020bef6 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:52.848610 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88870030-0384-42dc-8485-910e642ab76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.849544 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88870030-0384-42dc-8485-910e642ab76b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.850023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88870030-0384-42dc-8485-910e642ab76b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.850490 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88870030-0384-42dc-8485-910e642ab76b None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.851363 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88870030-0384-42dc-8485-910e642ab76b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:52.851881 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88870030-0384-42dc-8485-910e642ab76b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:52.854913 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88870030-0384-42dc-8485-910e642ab76b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:52.859164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 289/584] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:52.859736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015916f-ec69-4566-acd4-29aa9020bef6 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.873053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 296/585] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:52.874416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88870030-0384-42dc-8485-910e642ab76b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.915727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:52.981574 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015916f-ec69-4566-acd4-29aa9020bef6 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.002877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88870030-0384-42dc-8485-910e642ab76b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.029544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d0fb5-4230-4778-bfe2-859beeabe6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:53.030495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d0fb5-4230-4778-bfe2-859beeabe6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:53.031213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d0fb5-4230-4778-bfe2-859beeabe6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:53.031649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d0fb5-4230-4778-bfe2-859beeabe6e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:53.032855 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d0fb5-4230-4778-bfe2-859beeabe6e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:53.033568 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d0fb5-4230-4778-bfe2-859beeabe6e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:53.035741 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d0fb5-4230-4778-bfe2-859beeabe6e2 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.040316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db89a65-4788-462a-a93a-9b7bda344dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:53.041068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89a65-4788-462a-a93a-9b7bda344dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:53.041524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89a65-4788-462a-a93a-9b7bda344dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:53.041892 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89a65-4788-462a-a93a-9b7bda344dc2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:53.049510 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db89a65-4788-462a-a93a-9b7bda344dc2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:53.054198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db89a65-4788-462a-a93a-9b7bda344dc2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.054836 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 290/586] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:53.056410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d0fb5-4230-4778-bfe2-859beeabe6e2 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.066651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-8db89a65-4788-462a-a93a-9b7bda344dc2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:19:53.066651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:53.066651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:53.066651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:53.066651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:53.066651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:53.066651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:53.066651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:53.066651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:53.066651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:53.066651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:53.066651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:53.066651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:53.066651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:53.066651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:53.066651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:53.067847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:53.069027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:53.069027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:53.069027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:53.069027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:53.069027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:53.069027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:53.069027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:53.069027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:53.069027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:19:53.069027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:53.070776 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 297/587] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:53.071842 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db89a65-4788-462a-a93a-9b7bda344dc2 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.099450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:53.172920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:53.184488 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db89a65-4788-462a-a93a-9b7bda344dc2 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.191360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d0fb5-4230-4778-bfe2-859beeabe6e2 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.223139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784b70a-2110-4f55-8211-ef70e97b4c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:53.223898 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784b70a-2110-4f55-8211-ef70e97b4c2c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:53.224277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784b70a-2110-4f55-8211-ef70e97b4c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:53.224688 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784b70a-2110-4f55-8211-ef70e97b4c2c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:53.226702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e6ee1-268e-45db-be99-7602923e7006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:53.227596 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e6ee1-268e-45db-be99-7602923e7006 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:53.228086 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e6ee1-268e-45db-be99-7602923e7006 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:53.228552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e6ee1-268e-45db-be99-7602923e7006 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:53.234272 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784b70a-2110-4f55-8211-ef70e97b4c2c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:53.235756 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784b70a-2110-4f55-8211-ef70e97b4c2c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.237441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e6ee1-268e-45db-be99-7602923e7006 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:53.239106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e6ee1-268e-45db-be99-7602923e7006 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.249440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-1784b70a-2110-4f55-8211-ef70e97b4c2c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:19:53.249440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:53.249440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:53.249440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:53.249440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:53.249440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:53.249440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:53.249440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:53.249440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:53.249440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:53.249440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:53.249440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:53.249440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:53.249440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:53.249440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:53.249440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:53.250471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:53.251458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:53.251458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:53.251458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:53.251458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:53.251458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:53.251458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:53.251458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:53.251458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:53.251458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:19:53.251458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:53.251458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 298/588] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:53.252049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784b70a-2110-4f55-8211-ef70e97b4c2c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.258957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-e53e6ee1-268e-45db-be99-7602923e7006 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:19:53.258957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:53.258957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:53.258957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:53.258957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:53.258957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:53.258957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:53.258957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:53.258957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:53.258957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:53.258957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:53.258957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:53.258957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:53.258957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:53.258957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:53.258957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:53.259946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:53.260883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:53.260883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:53.260883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:53.260883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:53.260883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:53.260883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:53.260883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:53.260883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:53.260883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:19:53.260883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:53.263296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 291/589] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:53.264259 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e6ee1-268e-45db-be99-7602923e7006 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.373839 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:53.380243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784b70a-2110-4f55-8211-ef70e97b4c2c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.387029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e6ee1-268e-45db-be99-7602923e7006 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.423245 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a55b99-110f-456f-9d9b-a6ec45413674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:53.424229 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a55b99-110f-456f-9d9b-a6ec45413674 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:53.424488 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d4682-ac77-4e52-ad33-368a8b565738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:53.424611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a55b99-110f-456f-9d9b-a6ec45413674 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:53.424827 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a55b99-110f-456f-9d9b-a6ec45413674 None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:53.424993 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d4682-ac77-4e52-ad33-368a8b565738 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:53.425268 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d4682-ac77-4e52-ad33-368a8b565738 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:53.425534 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d4682-ac77-4e52-ad33-368a8b565738 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:53.425629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a55b99-110f-456f-9d9b-a6ec45413674 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:53.425845 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a55b99-110f-456f-9d9b-a6ec45413674 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:53.426259 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d4682-ac77-4e52-ad33-368a8b565738 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:53.426559 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d4682-ac77-4e52-ad33-368a8b565738 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:53.427303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a55b99-110f-456f-9d9b-a6ec45413674 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.428010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d4682-ac77-4e52-ad33-368a8b565738 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.451780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 299/590] 10.222.0.71 () {56 vars in 1139 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:53.452621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d4682-ac77-4e52-ad33-368a8b565738 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.462943 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 292/591] 10.222.0.71 () {56 vars in 1137 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:53.464655 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:53.465448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a55b99-110f-456f-9d9b-a6ec45413674 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.571730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d4682-ac77-4e52-ad33-368a8b565738 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.586701 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a55b99-110f-456f-9d9b-a6ec45413674 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.614472 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29938781-1c88-4004-9351-04edd16b0047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:53.615421 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29938781-1c88-4004-9351-04edd16b0047 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:53.615750 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29938781-1c88-4004-9351-04edd16b0047 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:53.616044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29938781-1c88-4004-9351-04edd16b0047 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:53.617398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29938781-1c88-4004-9351-04edd16b0047 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:53.617706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29938781-1c88-4004-9351-04edd16b0047 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:53.622648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29938781-1c88-4004-9351-04edd16b0047 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.625038 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d68f10-5861-4e50-8c18-dd1eba7cd800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:53.625898 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d68f10-5861-4e50-8c18-dd1eba7cd800 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:53.626374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d68f10-5861-4e50-8c18-dd1eba7cd800 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:53.626910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d68f10-5861-4e50-8c18-dd1eba7cd800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:53.638484 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d68f10-5861-4e50-8c18-dd1eba7cd800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:53.640231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d68f10-5861-4e50-8c18-dd1eba7cd800 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.644566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 300/592] 10.222.0.71 () {56 vars in 1137 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:53.645411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29938781-1c88-4004-9351-04edd16b0047 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.656643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-60d68f10-5861-4e50-8c18-dd1eba7cd800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:53.656643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:53.656643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:53.656643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:53.656643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:53.656643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:53.656643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:53.656643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:53.656643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:53.656643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:53.656643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:53.656643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:53.656643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:53.656643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:53.656643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:53.656643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:53.657594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:53.657594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:53.657594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:53.657594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:53.657594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:53.657594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:53.657594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:53.657594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:53.657594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:53.657594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:53.657594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:53.657594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:53.657594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:53.657594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:53.657594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:53.657594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:53.657594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:53.658467 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:53.658467 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:53.658467 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:53.664812 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 293/593] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:53.666329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d68f10-5861-4e50-8c18-dd1eba7cd800 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.669672 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:53.731140 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:53.773161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29938781-1c88-4004-9351-04edd16b0047 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.780716 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d68f10-5861-4e50-8c18-dd1eba7cd800 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.817254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f640899-acdc-41f7-8207-7389ec556ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:53.817900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f640899-acdc-41f7-8207-7389ec556ffa None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:53.818176 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f640899-acdc-41f7-8207-7389ec556ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:53.818447 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f640899-acdc-41f7-8207-7389ec556ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:53.821960 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2277860-12da-4c13-92d9-f705561fa314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:53.823417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2277860-12da-4c13-92d9-f705561fa314 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:53.823842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2277860-12da-4c13-92d9-f705561fa314 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:53.824281 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2277860-12da-4c13-92d9-f705561fa314 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:53.831020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f640899-acdc-41f7-8207-7389ec556ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:53.832847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f640899-acdc-41f7-8207-7389ec556ffa None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.836704 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2277860-12da-4c13-92d9-f705561fa314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:53.838308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2277860-12da-4c13-92d9-f705561fa314 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.848885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-4f640899-acdc-41f7-8207-7389ec556ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:53.848885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:53.848885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:53.848885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:53.848885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:53.848885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:53.848885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:53.848885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:53.848885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:53.848885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:53.848885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:53.848885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:53.848885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:53.848885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:53.848885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:53.848885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:53.850022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:53.850022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:53.850022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:53.850022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:53.850022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:53.850022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:53.850022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:53.850022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:53.850022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:53.850022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:53.850022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:53.850022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:53.850022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:53.850022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:53.850022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:53.850022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:53.850022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:53.851088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:53.851088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:53.851088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:53.854821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 301/594] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:53.855666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f640899-acdc-41f7-8207-7389ec556ffa None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.856552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-e2277860-12da-4c13-92d9-f705561fa314 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:53.856552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:53.856552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:53.856552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:53.856552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:53.856552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:53.856552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:53.856552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:53.856552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:53.856552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:53.856552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:53.856552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:53.856552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:53.856552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:53.856552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:53.856552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:53.857634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:53.857634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:53.857634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:53.857634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:53.857634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:53.857634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:53.857634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:53.857634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:53.857634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:53.857634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:53.857634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:53.857634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:53.857634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:53.857634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:53.857634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:53.857634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:53.857634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:53.858590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:53.858590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:53.858590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:53.860297 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 294/595] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:53.861204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2277860-12da-4c13-92d9-f705561fa314 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.921349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:53.972895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f640899-acdc-41f7-8207-7389ec556ffa None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.974530 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2277860-12da-4c13-92d9-f705561fa314 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.991093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:54.009506 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc703b9-adc4-4e46-aa7e-235d36b56720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.010652 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc703b9-adc4-4e46-aa7e-235d36b56720 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.010940 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc703b9-adc4-4e46-aa7e-235d36b56720 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.011212 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc703b9-adc4-4e46-aa7e-235d36b56720 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.012025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc703b9-adc4-4e46-aa7e-235d36b56720 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:54.012348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc703b9-adc4-4e46-aa7e-235d36b56720 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.013822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc703b9-adc4-4e46-aa7e-235d36b56720 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.015032 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ab47a-b78a-46fe-9227-c2117461e590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.015859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ab47a-b78a-46fe-9227-c2117461e590 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.016349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ab47a-b78a-46fe-9227-c2117461e590 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.016761 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ab47a-b78a-46fe-9227-c2117461e590 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.017540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ab47a-b78a-46fe-9227-c2117461e590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:54.018003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ab47a-b78a-46fe-9227-c2117461e590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.019515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ab47a-b78a-46fe-9227-c2117461e590 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.027086 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 302/596] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:54.027927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc703b9-adc4-4e46-aa7e-235d36b56720 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:54.036269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 295/597] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:54.037735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ab47a-b78a-46fe-9227-c2117461e590 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:54.139250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc703b9-adc4-4e46-aa7e-235d36b56720 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:54.146305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ab47a-b78a-46fe-9227-c2117461e590 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:54.162717 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:54.178878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850ed8d-7e16-4391-8a99-6b94ac629ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.179485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850ed8d-7e16-4391-8a99-6b94ac629ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.179764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850ed8d-7e16-4391-8a99-6b94ac629ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.180037 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850ed8d-7e16-4391-8a99-6b94ac629ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.180788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850ed8d-7e16-4391-8a99-6b94ac629ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:54.181096 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850ed8d-7e16-4391-8a99-6b94ac629ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.182497 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850ed8d-7e16-4391-8a99-6b94ac629ff0 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.186220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84afb4-892c-4b69-8331-29f7f8566010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.187188 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84afb4-892c-4b69-8331-29f7f8566010 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.187715 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84afb4-892c-4b69-8331-29f7f8566010 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.188190 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84afb4-892c-4b69-8331-29f7f8566010 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.195622 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84afb4-892c-4b69-8331-29f7f8566010 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.197365 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84afb4-892c-4b69-8331-29f7f8566010 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.198760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 303/598] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:54.199805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850ed8d-7e16-4391-8a99-6b94ac629ff0 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:54.218906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-fc84afb4-892c-4b69-8331-29f7f8566010 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:54.218906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:54.218906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:54.218906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:54.218906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:54.218906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:54.218906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:54.218906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:54.218906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:54.218906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:54.218906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:54.218906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:54.218906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:19:54.218906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:19:54.218906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:19:54.219881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:19:54.219881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:54.219881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:54.219881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:54.219881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:54.219881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:54.219881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:54.219881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:54.219881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:54.219881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:54.219881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:54.219881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:54.219881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:54.219881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:54.219881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:54.219881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:54.219881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:54.220758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:19:54.220758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:19:54.220758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:19:54.220758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:19:54.220758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:19:54.220758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:19:54.220758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:54.220758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:54.220758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 296/599] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:54.221252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84afb4-892c-4b69-8331-29f7f8566010 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:54.252247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:54.321752 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850ed8d-7e16-4391-8a99-6b94ac629ff0 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:54.326260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84afb4-892c-4b69-8331-29f7f8566010 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:54.360477 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6698979-bf08-4da8-9e4d-e4279fc16e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.361102 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78dadd-f4a2-4635-8ed4-900c280d7f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.361730 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78dadd-f4a2-4635-8ed4-900c280d7f9b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.361963 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698979-bf08-4da8-9e4d-e4279fc16e0e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.362066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78dadd-f4a2-4635-8ed4-900c280d7f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.362256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78dadd-f4a2-4635-8ed4-900c280d7f9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.362788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698979-bf08-4da8-9e4d-e4279fc16e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.363413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698979-bf08-4da8-9e4d-e4279fc16e0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.369945 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78dadd-f4a2-4635-8ed4-900c280d7f9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.371415 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78dadd-f4a2-4635-8ed4-900c280d7f9b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.372132 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6698979-bf08-4da8-9e4d-e4279fc16e0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.373982 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6698979-bf08-4da8-9e4d-e4279fc16e0e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.382998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-bd78dadd-f4a2-4635-8ed4-900c280d7f9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:54.382998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:54.382998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:54.382998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:54.382998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:54.382998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:54.382998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:54.382998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:54.382998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:54.382998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:54.382998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:54.382998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:54.382998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:19:54.382998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:19:54.382998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:19:54.383882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:19:54.383882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:54.383882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:54.383882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:54.383882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:54.383882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:54.383882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:54.383882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:54.383882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:54.383882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:54.383882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:54.383882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:54.383882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:54.383882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:54.383882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:54.383882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:54.383882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:54.384765 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:19:54.384765 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:19:54.384765 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:19:54.384765 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:19:54.384765 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:19:54.384765 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:19:54.384765 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:54.384765 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:54.389420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 297/600] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:54.390228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78dadd-f4a2-4635-8ed4-900c280d7f9b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:54.391063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-d6698979-bf08-4da8-9e4d-e4279fc16e0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:54.391063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:54.391063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:54.391063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:54.391063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:54.391063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:54.391063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:54.391063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:54.391063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:54.391063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:54.391063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:54.391063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:54.391063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:19:54.391063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:19:54.391063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:19:54.391900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:19:54.391900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:54.391900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:54.391900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:54.391900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:54.391900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:54.391900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:54.391900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:54.391900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:54.391900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:54.391900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:54.391900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:54.391900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:54.391900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:54.391900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:54.391900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:54.391900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:54.392766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:19:54.392766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:19:54.392766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:19:54.392766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:19:54.392766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:19:54.392766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:19:54.392766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:54.392766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:54.396407 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 304/601] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:54.397501 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6698979-bf08-4da8-9e4d-e4279fc16e0e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:54.431693 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:54.501883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78dadd-f4a2-4635-8ed4-900c280d7f9b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:54.507971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:54.512330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6698979-bf08-4da8-9e4d-e4279fc16e0e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:54.537996 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85c845-cac5-4878-97af-9d845b1066d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.538598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85c845-cac5-4878-97af-9d845b1066d2 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.538909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85c845-cac5-4878-97af-9d845b1066d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.539180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85c845-cac5-4878-97af-9d845b1066d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.539873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85c845-cac5-4878-97af-9d845b1066d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:54.540167 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85c845-cac5-4878-97af-9d845b1066d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.541701 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85c845-cac5-4878-97af-9d845b1066d2 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.551567 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f5894-60e9-4de4-8338-58420f538faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.552406 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f5894-60e9-4de4-8338-58420f538faa None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.552867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f5894-60e9-4de4-8338-58420f538faa None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.553319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f5894-60e9-4de4-8338-58420f538faa None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.553674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 298/602] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:19:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:54.554388 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f5894-60e9-4de4-8338-58420f538faa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:54.554507 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85c845-cac5-4878-97af-9d845b1066d2 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:54.554990 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f5894-60e9-4de4-8338-58420f538faa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.556580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f5894-60e9-4de4-8338-58420f538faa None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.571042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 305/603] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:19:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:54.572274 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692a9ea-153c-413d-943c-3a9660b9efed None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.572615 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692a9ea-153c-413d-943c-3a9660b9efed None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.572886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692a9ea-153c-413d-943c-3a9660b9efed None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.577932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 306/604] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:54.577932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692a9ea-153c-413d-943c-3a9660b9efed None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:54.671736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:54.679298 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85c845-cac5-4878-97af-9d845b1066d2 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:54.689256 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692a9ea-153c-413d-943c-3a9660b9efed None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:54.711716 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3917d34-31ba-4b8a-a7a0-8b502b27afa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.712314 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3917d34-31ba-4b8a-a7a0-8b502b27afa6 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.712594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3917d34-31ba-4b8a-a7a0-8b502b27afa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.712865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3917d34-31ba-4b8a-a7a0-8b502b27afa6 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.714148 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3917d34-31ba-4b8a-a7a0-8b502b27afa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:54.714453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3917d34-31ba-4b8a-a7a0-8b502b27afa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.716049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3917d34-31ba-4b8a-a7a0-8b502b27afa6 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.723381 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580448a-c933-4962-88fe-e641d8a54638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.724018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580448a-c933-4962-88fe-e641d8a54638 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.724292 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580448a-c933-4962-88fe-e641d8a54638 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.724559 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580448a-c933-4962-88fe-e641d8a54638 None admin] PATH_INFO: `/v3/projects/9527063094354a99a80822107d2740fb/users/d494fd310b1f40839f113d045f0bdcb9/roles/21a27b57a72246b2ade92d82599c569d` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.732602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 299/605] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:19:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:54.732602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3917d34-31ba-4b8a-a7a0-8b502b27afa6 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:54.738845 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580448a-c933-4962-88fe-e641d8a54638 None admin] RBAC: Authorizing `identity:create_grant(project_id=9527063094354a99a80822107d2740fb, user_id=d494fd310b1f40839f113d045f0bdcb9, role_id=21a27b57a72246b2ade92d82599c569d)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.740256 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580448a-c933-4962-88fe-e641d8a54638 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.753007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 307/606] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:19:54 2022] PUT /identity/v3/projects/9527063094354a99a80822107d2740fb/users/d494fd310b1f40839f113d045f0bdcb9/roles/21a27b57a72246b2ade92d82599c569d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:54.754191 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0ba7f-3873-4b3f-9be2-968b06561cb2 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.754475 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0ba7f-3873-4b3f-9be2-968b06561cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.754781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0ba7f-3873-4b3f-9be2-968b06561cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.774649 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-69f0ba7f-3873-4b3f-9be2-968b06561cb2 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:54.776003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-69f0ba7f-3873-4b3f-9be2-968b06561cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:54.778512 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:54.852108 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3917d34-31ba-4b8a-a7a0-8b502b27afa6 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:54.865058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 308/607] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:54.865058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb3e6c-9cc3-42d3-9328-0d75a93884bb None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.865058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb3e6c-9cc3-42d3-9328-0d75a93884bb None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.865058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb3e6c-9cc3-42d3-9328-0d75a93884bb None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.865058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 309/608] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:54.865058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb3e6c-9cc3-42d3-9328-0d75a93884bb None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:54.901481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc29a4b-6e4d-43cb-88a1-da51dea5b3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.902146 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc29a4b-6e4d-43cb-88a1-da51dea5b3d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.902450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc29a4b-6e4d-43cb-88a1-da51dea5b3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.902755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc29a4b-6e4d-43cb-88a1-da51dea5b3d3 None admin] PATH_INFO: `/v3/projects/9527063094354a99a80822107d2740fb/users/5a0dece90fc54641be30cdc2ddad9cf4/roles/21a27b57a72246b2ade92d82599c569d` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.921340 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc29a4b-6e4d-43cb-88a1-da51dea5b3d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9527063094354a99a80822107d2740fb, user_id=5a0dece90fc54641be30cdc2ddad9cf4, role_id=21a27b57a72246b2ade92d82599c569d)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.924326 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc29a4b-6e4d-43cb-88a1-da51dea5b3d3 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.948613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 300/609] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:19:54 2022] PUT /identity/v3/projects/9527063094354a99a80822107d2740fb/users/5a0dece90fc54641be30cdc2ddad9cf4/roles/21a27b57a72246b2ade92d82599c569d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:54.950091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd917f-a12b-4022-bddf-305084a309e5 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.950206 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd917f-a12b-4022-bddf-305084a309e5 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.950440 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd917f-a12b-4022-bddf-305084a309e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.958977 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:54.971945 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-3dbd917f-a12b-4022-bddf-305084a309e5 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:54.973223 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-3dbd917f-a12b-4022-bddf-305084a309e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:55.036564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb3e6c-9cc3-42d3-9328-0d75a93884bb None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:55.065188 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 301/610] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:55.083897 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74374660-0bdf-45de-8257-a20d48d812aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:55.084940 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74374660-0bdf-45de-8257-a20d48d812aa None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:55.085450 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74374660-0bdf-45de-8257-a20d48d812aa None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:55.085925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74374660-0bdf-45de-8257-a20d48d812aa None admin] PATH_INFO: `/v3/projects/9527063094354a99a80822107d2740fb/users/b11356a5e3d041729f71515482033dce/roles/21a27b57a72246b2ade92d82599c569d` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:55.096140 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:55.105671 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74374660-0bdf-45de-8257-a20d48d812aa None admin] RBAC: Authorizing `identity:create_grant(project_id=9527063094354a99a80822107d2740fb, user_id=b11356a5e3d041729f71515482033dce, role_id=21a27b57a72246b2ade92d82599c569d)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:55.107532 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74374660-0bdf-45de-8257-a20d48d812aa None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:55.128041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 310/611] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:19:54 2022] PUT /identity/v3/projects/9527063094354a99a80822107d2740fb/users/b11356a5e3d041729f71515482033dce/roles/21a27b57a72246b2ade92d82599c569d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:55.163595 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd917f-a12b-4022-bddf-305084a309e5 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:55.296194 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd917f-a12b-4022-bddf-305084a309e5 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:55.337295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151c560-3161-4016-be92-fe7faca75f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:55.337935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151c560-3161-4016-be92-fe7faca75f81 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:55.338244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151c560-3161-4016-be92-fe7faca75f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:55.338518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151c560-3161-4016-be92-fe7faca75f81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:55.340740 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:55.351057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151c560-3161-4016-be92-fe7faca75f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:55.356082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-8151c560-3161-4016-be92-fe7faca75f81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:55.356082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:55.356082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:55.356082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:55.356082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:55.356082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:55.356082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:55.356082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:55.356082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:55.356082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:55.356082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:55.356082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:55.356082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:55.356082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:55.356082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:55.356082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:55.357016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:55.357016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:55.357016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:55.357016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:55.357016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:55.357016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:55.357016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:55.357016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:55.357016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:55.357016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:55.357016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:55.357016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:55.357016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:55.357016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:55.357016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:55.357016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:55.358258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:55.358258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:55.358258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:55.358258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:55.358258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:55.358258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:55.358258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:55.358258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:55.358258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:55.358258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:55.358258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:55.358258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:55.358258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 302/612] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:55.363957 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74374660-0bdf-45de-8257-a20d48d812aa None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:55.372031 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151c560-3161-4016-be92-fe7faca75f81 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:55.492956 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151c560-3161-4016-be92-fe7faca75f81 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:55.519020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74374660-0bdf-45de-8257-a20d48d812aa None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:55.530292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e78e8-2c7c-4144-8501-1700f087027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:55.531404 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e78e8-2c7c-4144-8501-1700f087027b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:55.531965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e78e8-2c7c-4144-8501-1700f087027b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:55.532525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e78e8-2c7c-4144-8501-1700f087027b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:55.548885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e78e8-2c7c-4144-8501-1700f087027b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:55.556413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-291e78e8-2c7c-4144-8501-1700f087027b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:55.556413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:55.556413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:55.556413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:55.556413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:55.556413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:55.556413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:55.556413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:55.556413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:55.556413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:55.556413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:55.556413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:55.556413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:55.556413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:55.556413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:55.556413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:55.558018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:55.558018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:55.558018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:55.558018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:55.558018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:55.558018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:55.558018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:55.558018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:55.558018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:55.558018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:55.558018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:55.558018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:55.558018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:55.558018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:55.558018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:55.558018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:55.558920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:55.558920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:55.558920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:55.558920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:55.558920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:55.558920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:55.558920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:55.558920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:55.558920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:55.558920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:55.558920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:55.558920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:55.565244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 303/613] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:19:55.568256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e78e8-2c7c-4144-8501-1700f087027b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:55.569492 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e09f44-2a71-4e65-af73-cd87bf5d6b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:55.570570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e09f44-2a71-4e65-af73-cd87bf5d6b7b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:55.571160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e09f44-2a71-4e65-af73-cd87bf5d6b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:55.571832 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e09f44-2a71-4e65-af73-cd87bf5d6b7b None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:55.573384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e09f44-2a71-4e65-af73-cd87bf5d6b7b None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:55.573893 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e09f44-2a71-4e65-af73-cd87bf5d6b7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:55.575500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e09f44-2a71-4e65-af73-cd87bf5d6b7b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:55.595971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 311/614] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:55.599110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e09f44-2a71-4e65-af73-cd87bf5d6b7b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:55.698645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:55.704233 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:55.760840 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e09f44-2a71-4e65-af73-cd87bf5d6b7b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:55.773623 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e78e8-2c7c-4144-8501-1700f087027b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:55.815433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392175f-b048-4bd0-9212-32390f55409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:55.816033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392175f-b048-4bd0-9212-32390f55409a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:55.816301 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392175f-b048-4bd0-9212-32390f55409a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:55.816570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392175f-b048-4bd0-9212-32390f55409a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:55.837636 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d876536-a2f2-43ab-b7eb-cf95b79dca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:55.838280 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d876536-a2f2-43ab-b7eb-cf95b79dca23 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:55.838560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d876536-a2f2-43ab-b7eb-cf95b79dca23 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:55.846687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d876536-a2f2-43ab-b7eb-cf95b79dca23 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:55.846687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d876536-a2f2-43ab-b7eb-cf95b79dca23 None admin] RBAC: Adding query filter params (name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:55.846687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d876536-a2f2-43ab-b7eb-cf95b79dca23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:55.846687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d876536-a2f2-43ab-b7eb-cf95b79dca23 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:55.853791 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392175f-b048-4bd0-9212-32390f55409a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:55.855488 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392175f-b048-4bd0-9212-32390f55409a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:55.861472 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 304/615] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:55.867085 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d876536-a2f2-43ab-b7eb-cf95b79dca23 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:55.885480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-0392175f-b048-4bd0-9212-32390f55409a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:55.885480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:55.885480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:55.885480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:55.885480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:55.885480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:55.885480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:55.885480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:55.885480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:55.885480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:55.885480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:55.885480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:55.885480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:55.885480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:55.885480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:55.885480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:55.886819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:55.886819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:55.886819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:55.886819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:55.886819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:55.886819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:55.886819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:55.886819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:55.886819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:55.886819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:55.886819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:55.886819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:55.886819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:55.886819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:55.886819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:55.886819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:55.886819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:55.887721 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:55.887721 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:55.887721 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:55.891039 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 312/616] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:55.901095 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392175f-b048-4bd0-9212-32390f55409a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:56.071789 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d876536-a2f2-43ab-b7eb-cf95b79dca23 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:56.102222 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392175f-b048-4bd0-9212-32390f55409a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:56.103895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:56.109599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:56.147144 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dffa75-6c53-457c-8df1-97fcc14e8f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:56.147777 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dffa75-6c53-457c-8df1-97fcc14e8f1e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:56.148055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dffa75-6c53-457c-8df1-97fcc14e8f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:56.148341 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dffa75-6c53-457c-8df1-97fcc14e8f1e None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:56.149009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dffa75-6c53-457c-8df1-97fcc14e8f1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:56.149313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dffa75-6c53-457c-8df1-97fcc14e8f1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:56.150778 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dffa75-6c53-457c-8df1-97fcc14e8f1e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:56.158292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869a10b-985c-4bb7-942c-d3ac57e187f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:56.158955 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869a10b-985c-4bb7-942c-d3ac57e187f4 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:56.159234 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869a10b-985c-4bb7-942c-d3ac57e187f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:56.159506 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869a10b-985c-4bb7-942c-d3ac57e187f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:56.184376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 313/617] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:56.184577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869a10b-985c-4bb7-942c-d3ac57e187f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:56.185395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869a10b-985c-4bb7-942c-d3ac57e187f4 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:56.187058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dffa75-6c53-457c-8df1-97fcc14e8f1e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:56.226843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-8869a10b-985c-4bb7-942c-d3ac57e187f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:56.226843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:56.226843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:56.226843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:56.226843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:56.226843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:56.226843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:56.226843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:56.226843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:56.226843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:56.226843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:56.226843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:56.226843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:56.226843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:56.226843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:56.226843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:56.227912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:56.227912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:56.227912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:56.227912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:56.227912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:56.227912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:56.227912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:56.227912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:56.227912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:56.227912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:56.227912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:56.227912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:56.227912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:56.227912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:56.227912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:56.227912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:56.227912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:56.229833 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:56.229833 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:56.229833 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:56.238098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 305/618] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:56.239372 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869a10b-985c-4bb7-942c-d3ac57e187f4 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:56.404716 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869a10b-985c-4bb7-942c-d3ac57e187f4 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:56.428783 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dffa75-6c53-457c-8df1-97fcc14e8f1e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:56.446803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909f81c-6193-4fb3-9bcf-87e6cfd93467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:56.447935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909f81c-6193-4fb3-9bcf-87e6cfd93467 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:56.448209 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909f81c-6193-4fb3-9bcf-87e6cfd93467 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:56.448478 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909f81c-6193-4fb3-9bcf-87e6cfd93467 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:56.449122 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909f81c-6193-4fb3-9bcf-87e6cfd93467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:56.449418 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909f81c-6193-4fb3-9bcf-87e6cfd93467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:56.450801 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909f81c-6193-4fb3-9bcf-87e6cfd93467 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:56.475595 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 306/619] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:56.482029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909f81c-6193-4fb3-9bcf-87e6cfd93467 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:56.495421 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cc7c0-15d5-44ee-9786-a62ae8cb49f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:56.496125 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cc7c0-15d5-44ee-9786-a62ae8cb49f4 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:56.496398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cc7c0-15d5-44ee-9786-a62ae8cb49f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:56.496665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cc7c0-15d5-44ee-9786-a62ae8cb49f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:56.507940 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cc7c0-15d5-44ee-9786-a62ae8cb49f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:56.509369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cc7c0-15d5-44ee-9786-a62ae8cb49f4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:56.530134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-0c0cc7c0-15d5-44ee-9786-a62ae8cb49f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:19:56.530134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:56.530134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:56.530134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:56.530134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:56.530134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:56.530134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:56.530134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:56.530134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:56.530134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:56.530134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:56.530134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:56.530134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:56.530134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:56.530134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:56.530134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:56.531348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:56.532403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:56.532403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:56.532403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:56.532403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:56.532403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:56.532403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:56.532403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:56.532403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:56.532403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:19:56.532403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:56.532403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 314/620] 10.222.0.71 () {56 vars in 1093 bytes} [Thu Sep 1 16:19:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:56.539521 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:56.541384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cc7c0-15d5-44ee-9786-a62ae8cb49f4 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:56.603464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:56.655464 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909f81c-6193-4fb3-9bcf-87e6cfd93467 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:56.728034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d04aa-4136-4628-bbb8-b24ced21a71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:56.728701 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d04aa-4136-4628-bbb8-b24ced21a71f None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:56.728952 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d04aa-4136-4628-bbb8-b24ced21a71f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:56.729215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d04aa-4136-4628-bbb8-b24ced21a71f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:56.743899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d04aa-4136-4628-bbb8-b24ced21a71f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:56.745891 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d04aa-4136-4628-bbb8-b24ced21a71f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:56.747376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cc7c0-15d5-44ee-9786-a62ae8cb49f4 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:56.770724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-fe3d04aa-4136-4628-bbb8-b24ced21a71f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:19:56.770724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:56.770724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:56.770724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:56.770724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:56.770724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:56.770724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:56.770724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:56.770724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:56.770724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:56.770724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:56.770724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:56.770724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:56.770724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:56.770724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:56.770724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:56.771858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:56.772852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:56.772852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:56.772852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:56.772852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:56.772852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:56.772852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:56.772852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:56.772852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:56.772852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:19:56.772852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:56.775291 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 307/621] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:19:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:56.781026 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d04aa-4136-4628-bbb8-b24ced21a71f None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:56.783123 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1baea-eca4-47ba-bedc-a60b0c4f1781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:56.783799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1baea-eca4-47ba-bedc-a60b0c4f1781 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:56.784142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1baea-eca4-47ba-bedc-a60b0c4f1781 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:56.784478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1baea-eca4-47ba-bedc-a60b0c4f1781 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:56.785276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1baea-eca4-47ba-bedc-a60b0c4f1781 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:56.785648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1baea-eca4-47ba-bedc-a60b0c4f1781 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:56.787165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1baea-eca4-47ba-bedc-a60b0c4f1781 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:56.805061 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 315/622] 10.222.0.71 () {56 vars in 1133 bytes} [Thu Sep 1 16:19:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:56.811227 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1baea-eca4-47ba-bedc-a60b0c4f1781 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:56.927080 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:56.959474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:56.975225 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d04aa-4136-4628-bbb8-b24ced21a71f None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:56.976229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1baea-eca4-47ba-bedc-a60b0c4f1781 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:57.012997 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b2ec7-2b8e-4115-8d9f-1d2672bfac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:57.014026 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b2ec7-2b8e-4115-8d9f-1d2672bfac7c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.014449 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b2ec7-2b8e-4115-8d9f-1d2672bfac7c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.014896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b2ec7-2b8e-4115-8d9f-1d2672bfac7c None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.015792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b2ec7-2b8e-4115-8d9f-1d2672bfac7c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:57.016238 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b2ec7-2b8e-4115-8d9f-1d2672bfac7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:57.018485 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b2ec7-2b8e-4115-8d9f-1d2672bfac7c None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:57.046968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 308/623] 10.222.0.71 () {56 vars in 1135 bytes} [Thu Sep 1 16:19:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:57.052960 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b2ec7-2b8e-4115-8d9f-1d2672bfac7c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:57.071168 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e06aaa-ce7c-406b-b677-089fdaf356ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:57.073514 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e06aaa-ce7c-406b-b677-089fdaf356ff None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.074297 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e06aaa-ce7c-406b-b677-089fdaf356ff None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.076149 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e06aaa-ce7c-406b-b677-089fdaf356ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.167103 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e06aaa-ce7c-406b-b677-089fdaf356ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:57.168992 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e06aaa-ce7c-406b-b677-089fdaf356ff None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:57.193151 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b2ec7-2b8e-4115-8d9f-1d2672bfac7c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:57.230627 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38ee14-039c-4a5f-971c-0292d79b6375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:57.231184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38ee14-039c-4a5f-971c-0292d79b6375 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.231465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38ee14-039c-4a5f-971c-0292d79b6375 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.231735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38ee14-039c-4a5f-971c-0292d79b6375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.242896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38ee14-039c-4a5f-971c-0292d79b6375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:57.244901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38ee14-039c-4a5f-971c-0292d79b6375 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:57.252697 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:57.260891 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:57.263129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-6d38ee14-039c-4a5f-971c-0292d79b6375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:57.263129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:57.263129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:57.263129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:57.263129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:57.263129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:57.263129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:57.263129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:57.263129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:57.263129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:57.263129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:57.263129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:57.263129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:57.263129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:57.263129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:57.263129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:57.264430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:57.264430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:57.264430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:57.264430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:57.264430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:57.264430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:57.264430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:57.264430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:57.264430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:57.264430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:57.264430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:57.264430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:57.264430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:57.264430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:57.264430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:57.264430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:57.264430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:57.265357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:57.265357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:57.265357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:57.265357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 309/624] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:19:57.266578 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a68172-325f-4f2d-8459-d789c32bdf7e None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.266901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a68172-325f-4f2d-8459-d789c32bdf7e None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.267627 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a68172-325f-4f2d-8459-d789c32bdf7e None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.273077 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 310/625] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:57.274087 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a68172-325f-4f2d-8459-d789c32bdf7e None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:57.289368 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 316/626] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:57.291108 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d775589-72ab-43cc-9b49-dfcad23b9af3 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.292127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d775589-72ab-43cc-9b49-dfcad23b9af3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.292755 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d775589-72ab-43cc-9b49-dfcad23b9af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.312178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8d775589-72ab-43cc-9b49-dfcad23b9af3 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:57.313921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8d775589-72ab-43cc-9b49-dfcad23b9af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:57.386553 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a68172-325f-4f2d-8459-d789c32bdf7e None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:57.389186 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 317/627] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:57.390324 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d775589-72ab-43cc-9b49-dfcad23b9af3 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:57.464869 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d8546-c254-43e7-a079-062d22628a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:57.465395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8546-c254-43e7-a079-062d22628a56 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.465672 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8546-c254-43e7-a079-062d22628a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.465939 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8546-c254-43e7-a079-062d22628a56 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.466579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d8546-c254-43e7-a079-062d22628a56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:57.467967 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d8546-c254-43e7-a079-062d22628a56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:57.469413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d8546-c254-43e7-a079-062d22628a56 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:57.486762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 311/628] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:57.488352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ffab2-fde5-471b-bce1-33985663c378 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.488866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ffab2-fde5-471b-bce1-33985663c378 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.490317 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ffab2-fde5-471b-bce1-33985663c378 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.492093 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 312/629] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:57.492796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ffab2-fde5-471b-bce1-33985663c378 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:57.507993 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d775589-72ab-43cc-9b49-dfcad23b9af3 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:57.521440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:57.546839 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c658743-3489-447c-930a-68baf6043b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:57.547567 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c658743-3489-447c-930a-68baf6043b2b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.547913 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c658743-3489-447c-930a-68baf6043b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.548251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c658743-3489-447c-930a-68baf6043b2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.559393 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c658743-3489-447c-930a-68baf6043b2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:57.560920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c658743-3489-447c-930a-68baf6043b2b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:57.573130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:57.582023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-7c658743-3489-447c-930a-68baf6043b2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:57.582023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:57.582023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:57.582023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:57.582023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:57.582023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:57.582023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:57.582023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:57.582023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:57.582023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:57.582023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:57.582023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:57.582023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:57.582023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:57.582023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:57.582023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:57.583463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:57.583463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:57.583463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:57.583463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:57.583463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:57.583463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:57.583463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:57.583463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:57.583463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:57.583463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:57.583463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:57.583463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:57.583463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:57.583463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:57.583463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:57.583463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:57.583463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:57.584357 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:57.584357 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:57.584357 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:57.584357 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 318/630] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:57.584944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0594f4-52a7-4cbb-8cd1-4a04f9594899 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.584944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0594f4-52a7-4cbb-8cd1-4a04f9594899 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.585167 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0594f4-52a7-4cbb-8cd1-4a04f9594899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.606648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9d0594f4-52a7-4cbb-8cd1-4a04f9594899 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:57.606648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9d0594f4-52a7-4cbb-8cd1-4a04f9594899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:57.627522 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ffab2-fde5-471b-bce1-33985663c378 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:57.675509 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169df37-de0c-462b-ab9a-799b367fc0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:57.676390 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169df37-de0c-462b-ab9a-799b367fc0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.676669 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169df37-de0c-462b-ab9a-799b367fc0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.677393 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169df37-de0c-462b-ab9a-799b367fc0a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.685526 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 319/631] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:57.686448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169df37-de0c-462b-ab9a-799b367fc0a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:57.686560 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0594f4-52a7-4cbb-8cd1-4a04f9594899 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:57.688004 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169df37-de0c-462b-ab9a-799b367fc0a9 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:57.702301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-a169df37-de0c-462b-ab9a-799b367fc0a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:57.702301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:57.702301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:57.702301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:57.702301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:57.702301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:57.702301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:57.702301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:57.702301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:57.702301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:57.702301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:57.702301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:57.702301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:19:57.702301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:19:57.702301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:19:57.703231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:19:57.703231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:57.703231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:57.703231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:57.703231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:57.703231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:57.703231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:57.703231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:57.703231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:57.703231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:57.703231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:57.703231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:57.703231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:57.703231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:57.703231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:57.703231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:57.703231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:57.704137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:19:57.704137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:19:57.704137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:19:57.704137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:19:57.704137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:19:57.704137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:19:57.704137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:57.704137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:57.704137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 313/632] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:57.709974 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169df37-de0c-462b-ab9a-799b367fc0a9 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:57.820361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:57.826863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169df37-de0c-462b-ab9a-799b367fc0a9 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:57.831226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0594f4-52a7-4cbb-8cd1-4a04f9594899 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:57.869935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aca154-ea0f-4a93-8f3f-8d67484fa58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:57.870951 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aca154-ea0f-4a93-8f3f-8d67484fa58f None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.871433 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aca154-ea0f-4a93-8f3f-8d67484fa58f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.871919 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aca154-ea0f-4a93-8f3f-8d67484fa58f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.874997 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:57.878465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72abed0-c91d-48b9-9a48-0012033a6ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:57.879102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72abed0-c91d-48b9-9a48-0012033a6ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.879382 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72abed0-c91d-48b9-9a48-0012033a6ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.879704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72abed0-c91d-48b9-9a48-0012033a6ae1 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.880360 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72abed0-c91d-48b9-9a48-0012033a6ae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:57.880660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72abed0-c91d-48b9-9a48-0012033a6ae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:57.882507 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72abed0-c91d-48b9-9a48-0012033a6ae1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:57.887153 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aca154-ea0f-4a93-8f3f-8d67484fa58f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:57.893462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-47aca154-ea0f-4a93-8f3f-8d67484fa58f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:57.893462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:57.893462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:57.893462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:57.893462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:57.893462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:57.893462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:57.893462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:57.893462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:57.893462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:57.893462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:57.893462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:57.893462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:57.893462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:57.893462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:57.893462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:57.894422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:57.894422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:57.894422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:57.894422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:57.894422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:57.894422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:57.894422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:57.894422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:57.894422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:57.894422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:57.894422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:57.894422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:57.894422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:57.894422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:57.894422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:57.894422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:57.895332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:57.895332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:57.895332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:57.895332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:57.895332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:57.895332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:57.895332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:57.895332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:57.895332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:57.895332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:57.895332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:57.895332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:57.895995 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 320/633] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:57.895995 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72abed0-c91d-48b9-9a48-0012033a6ae1 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:57.902754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 314/634] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:57.903849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aca154-ea0f-4a93-8f3f-8d67484fa58f None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.007239 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aca154-ea0f-4a93-8f3f-8d67484fa58f None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:58.009650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72abed0-c91d-48b9-9a48-0012033a6ae1 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:58.040145 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501aae4-4702-4f3e-90a8-d5337c1a1f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:58.040764 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501aae4-4702-4f3e-90a8-d5337c1a1f53 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.041042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501aae4-4702-4f3e-90a8-d5337c1a1f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.041892 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501aae4-4702-4f3e-90a8-d5337c1a1f53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.043342 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d8119-2b18-4808-9755-9466d18d9888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:58.044052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d8119-2b18-4808-9755-9466d18d9888 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.044330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d8119-2b18-4808-9755-9466d18d9888 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.044600 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d8119-2b18-4808-9755-9466d18d9888 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.045281 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d8119-2b18-4808-9755-9466d18d9888 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:58.045581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d8119-2b18-4808-9755-9466d18d9888 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:58.047161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d8119-2b18-4808-9755-9466d18d9888 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:58.048441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501aae4-4702-4f3e-90a8-d5337c1a1f53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:58.050382 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501aae4-4702-4f3e-90a8-d5337c1a1f53 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:58.058825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 321/635] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:58.059603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d8119-2b18-4808-9755-9466d18d9888 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.062437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-2501aae4-4702-4f3e-90a8-d5337c1a1f53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:58.062437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:58.062437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:58.062437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:58.062437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:58.062437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:58.062437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:58.062437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:58.062437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:58.062437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:58.062437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:58.062437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:58.062437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:19:58.062437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:19:58.062437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:19:58.063457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:19:58.063457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:58.063457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:58.063457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:58.063457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:58.063457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:58.063457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:58.063457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:58.063457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:58.063457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:58.063457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:58.063457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:58.063457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:58.063457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:58.063457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:58.063457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:58.063457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:58.064430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:19:58.064430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:19:58.064430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:19:58.064430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:19:58.064430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:19:58.064430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:19:58.064430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:58.064430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:58.064430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 315/636] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:58.064904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501aae4-4702-4f3e-90a8-d5337c1a1f53 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.078716 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:58.115135 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:58.169737 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d8119-2b18-4808-9755-9466d18d9888 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:58.175387 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501aae4-4702-4f3e-90a8-d5337c1a1f53 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:58.204870 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5fb1a-35dd-497b-accd-546705e48da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:58.205464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5fb1a-35dd-497b-accd-546705e48da9 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.205741 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5fb1a-35dd-497b-accd-546705e48da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.206009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5fb1a-35dd-497b-accd-546705e48da9 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.206701 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5fb1a-35dd-497b-accd-546705e48da9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:58.207007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5fb1a-35dd-497b-accd-546705e48da9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:58.208385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5fb1a-35dd-497b-accd-546705e48da9 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:58.209254 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aeb2ce-02b5-43e5-80b0-2b5446f8c3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:58.209871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aeb2ce-02b5-43e5-80b0-2b5446f8c3ae None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.210143 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aeb2ce-02b5-43e5-80b0-2b5446f8c3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.210413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aeb2ce-02b5-43e5-80b0-2b5446f8c3ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.216694 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 322/637] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:58.218172 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b10e-ea2d-482f-85fe-b2d804dea69c None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.218664 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b10e-ea2d-482f-85fe-b2d804dea69c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.218772 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b10e-ea2d-482f-85fe-b2d804dea69c None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.222650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 323/638] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:58.222650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250b10e-ea2d-482f-85fe-b2d804dea69c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.224059 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aeb2ce-02b5-43e5-80b0-2b5446f8c3ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:58.228780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-80aeb2ce-02b5-43e5-80b0-2b5446f8c3ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:58.228780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:58.228780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:58.228780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:58.228780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:58.228780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:58.228780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:58.228780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:58.228780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:58.228780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:58.228780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:58.228780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:58.228780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:58.228780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:58.228780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:58.228780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:58.229743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:58.229743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:58.229743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:58.229743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:58.229743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:58.229743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:58.229743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:58.229743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:58.229743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:58.229743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:58.229743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:58.229743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:58.229743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:58.229743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:58.229743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:58.229743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:58.230587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:58.230587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:58.230587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:58.230587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:58.230587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:58.230587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:58.230587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:58.230587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:58.230587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:58.230587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:58.230587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:58.230587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:58.230587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 316/639] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:58.231310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aeb2ce-02b5-43e5-80b0-2b5446f8c3ae None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.299195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:58.324732 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250b10e-ea2d-482f-85fe-b2d804dea69c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:58.329317 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:58.333193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aeb2ce-02b5-43e5-80b0-2b5446f8c3ae None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:58.357919 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47bc64-b012-47fc-9810-623129cd9efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:58.358563 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47bc64-b012-47fc-9810-623129cd9efc None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.358859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47bc64-b012-47fc-9810-623129cd9efc None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.359131 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47bc64-b012-47fc-9810-623129cd9efc None admin] PATH_INFO: `/v3/projects/9527063094354a99a80822107d2740fb/users/9f7afa63815643f580c91df4e4c3bafc/roles/21a27b57a72246b2ade92d82599c569d` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.367135 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035750e1-6a1a-4b87-b58c-8ce3cf10ed31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:58.367756 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035750e1-6a1a-4b87-b58c-8ce3cf10ed31 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.368035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035750e1-6a1a-4b87-b58c-8ce3cf10ed31 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.368308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035750e1-6a1a-4b87-b58c-8ce3cf10ed31 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.368994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035750e1-6a1a-4b87-b58c-8ce3cf10ed31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:58.369838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035750e1-6a1a-4b87-b58c-8ce3cf10ed31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:58.371366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035750e1-6a1a-4b87-b58c-8ce3cf10ed31 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:58.375091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47bc64-b012-47fc-9810-623129cd9efc None admin] RBAC: Authorizing `identity:create_grant(project_id=9527063094354a99a80822107d2740fb, user_id=9f7afa63815643f580c91df4e4c3bafc, role_id=21a27b57a72246b2ade92d82599c569d)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:58.376515 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47bc64-b012-47fc-9810-623129cd9efc None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:58.382901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 317/640] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:19:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:58.383714 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035750e1-6a1a-4b87-b58c-8ce3cf10ed31 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.393422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 324/641] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:19:58 2022] PUT /identity/v3/projects/9527063094354a99a80822107d2740fb/users/9f7afa63815643f580c91df4e4c3bafc/roles/21a27b57a72246b2ade92d82599c569d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:58.394622 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec1e14-6627-4125-bb78-4b25bee10113 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.394912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec1e14-6627-4125-bb78-4b25bee10113 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.395181 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec1e14-6627-4125-bb78-4b25bee10113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.413449 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-fbec1e14-6627-4125-bb78-4b25bee10113 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:58.414727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fbec1e14-6627-4125-bb78-4b25bee10113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:58.495651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 325/642] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:58.496590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec1e14-6627-4125-bb78-4b25bee10113 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.500845 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035750e1-6a1a-4b87-b58c-8ce3cf10ed31 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:58.553781 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd2bb8-cae5-4bd3-9adc-ed30ff350375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:58.555188 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd2bb8-cae5-4bd3-9adc-ed30ff350375 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.555473 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd2bb8-cae5-4bd3-9adc-ed30ff350375 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.555745 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd2bb8-cae5-4bd3-9adc-ed30ff350375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.558577 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:58.573150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd2bb8-cae5-4bd3-9adc-ed30ff350375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:58.574935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd2bb8-cae5-4bd3-9adc-ed30ff350375 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:58.590821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-70bd2bb8-cae5-4bd3-9adc-ed30ff350375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:58.590821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:58.590821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:58.590821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:58.590821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:58.590821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:58.590821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:58.590821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:58.590821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:58.590821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:58.590821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:58.590821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:58.590821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:58.590821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:58.590821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:58.590821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:58.591846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:58.591846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:58.591846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:58.591846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:58.591846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:58.591846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:58.591846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:58.591846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:58.591846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:58.591846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:58.591846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:58.591846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:58.591846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:58.591846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:58.591846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:58.591846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:58.591846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:58.593082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:58.593082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:58.593082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:58.594989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 318/643] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:58.595983 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd2bb8-cae5-4bd3-9adc-ed30ff350375 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.609408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:58.617212 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec1e14-6627-4125-bb78-4b25bee10113 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:58.654571 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea372c5-858e-4267-9ac6-c73fb2b05b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:58.655446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea372c5-858e-4267-9ac6-c73fb2b05b71 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.655875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea372c5-858e-4267-9ac6-c73fb2b05b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.656322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea372c5-858e-4267-9ac6-c73fb2b05b71 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.657135 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea372c5-858e-4267-9ac6-c73fb2b05b71 None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:58.657584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea372c5-858e-4267-9ac6-c73fb2b05b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:58.659121 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea372c5-858e-4267-9ac6-c73fb2b05b71 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:58.668490 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 326/644] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:58.669520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea372c5-858e-4267-9ac6-c73fb2b05b71 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.703370 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd2bb8-cae5-4bd3-9adc-ed30ff350375 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:58.739077 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e5e2b-5fcf-4e26-84f4-e75348e49725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:58.739875 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e5e2b-5fcf-4e26-84f4-e75348e49725 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.740256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e5e2b-5fcf-4e26-84f4-e75348e49725 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.740660 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e5e2b-5fcf-4e26-84f4-e75348e49725 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.741486 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e5e2b-5fcf-4e26-84f4-e75348e49725 None admin] RBAC: Adding query filter params (role.id=21a27b57a72246b2ade92d82599c569d, scope.project.id=9527063094354a99a80822107d2740fb, user.id=ed71d63cd24f4a6caf6ebba2c30d3608) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:58.742311 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e5e2b-5fcf-4e26-84f4-e75348e49725 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:58.743501 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e5e2b-5fcf-4e26-84f4-e75348e49725 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:58.750047 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 319/645] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:58 2022] GET /identity/v3/role_assignments?user.id=ed71d63cd24f4a6caf6ebba2c30d3608&scope.project.id=9527063094354a99a80822107d2740fb&role.id=21a27b57a72246b2ade92d82599c569d => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:58.751017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e5e2b-5fcf-4e26-84f4-e75348e49725 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.781639 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea372c5-858e-4267-9ac6-c73fb2b05b71 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:58.800465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:58.824370 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37088d33-0720-4e5b-8eed-4132e8087287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:58.825297 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37088d33-0720-4e5b-8eed-4132e8087287 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.825866 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37088d33-0720-4e5b-8eed-4132e8087287 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.826334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37088d33-0720-4e5b-8eed-4132e8087287 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.827196 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37088d33-0720-4e5b-8eed-4132e8087287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:58.827731 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37088d33-0720-4e5b-8eed-4132e8087287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:58.829310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37088d33-0720-4e5b-8eed-4132e8087287 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:58.843349 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 327/646] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:58.848371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:58.849740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37088d33-0720-4e5b-8eed-4132e8087287 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.871889 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e5e2b-5fcf-4e26-84f4-e75348e49725 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:58.923643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7e8c8-29bf-4a73-85ae-9230a3198c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:58.924292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7e8c8-29bf-4a73-85ae-9230a3198c2b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.924575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7e8c8-29bf-4a73-85ae-9230a3198c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.924845 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7e8c8-29bf-4a73-85ae-9230a3198c2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.941740 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7e8c8-29bf-4a73-85ae-9230a3198c2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:58.943273 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7e8c8-29bf-4a73-85ae-9230a3198c2b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:58.962720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-2da7e8c8-29bf-4a73-85ae-9230a3198c2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:58.962720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:58.962720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:58.962720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:58.962720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:58.962720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:58.962720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:58.962720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:58.962720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:58.962720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:58.962720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:58.962720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:58.962720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:58.962720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:58.962720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:58.962720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:58.964249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:58.964249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:58.964249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:58.964249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:58.964249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:58.964249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:58.964249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:58.964249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:58.964249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:58.964249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:58.964249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:58.964249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:58.964249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:58.964249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:58.964249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:58.964249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:58.964249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:58.965248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:58.965248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:58.965248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:58.965430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 320/647] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:58.966696 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7e8c8-29bf-4a73-85ae-9230a3198c2b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.977933 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37088d33-0720-4e5b-8eed-4132e8087287 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:59.019543 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41167a-9805-44fc-be3e-44fd653a2557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:59.020198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41167a-9805-44fc-be3e-44fd653a2557 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:59.020565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41167a-9805-44fc-be3e-44fd653a2557 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:59.021094 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41167a-9805-44fc-be3e-44fd653a2557 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:59.033569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41167a-9805-44fc-be3e-44fd653a2557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:59.038403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-1d41167a-9805-44fc-be3e-44fd653a2557 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:59.038403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:59.038403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:59.038403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:59.038403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:59.038403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:59.038403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:59.038403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:59.038403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:59.038403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:59.038403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:59.038403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:59.038403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:59.038403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:59.038403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:59.038403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:59.039384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:59.039384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:59.039384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:59.039384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:59.039384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:59.039384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:59.039384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:59.039384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:59.039384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:59.039384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:59.039384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:59.039384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:59.039384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:59.039384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:59.039384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:59.039384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:59.040226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:59.040226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:59.040226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:59.040226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:59.040226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:59.040226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:59.040226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:59.040226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:59.040226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:59.040226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:59.040226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:59.040226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:59.040903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 328/648] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:59.041637 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41167a-9805-44fc-be3e-44fd653a2557 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:59.088458 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7e8c8-29bf-4a73-85ae-9230a3198c2b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:59.090346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:59.121373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:59.130675 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c4367-ff7a-4b84-b8aa-dd942005644e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:59.131384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c4367-ff7a-4b84-b8aa-dd942005644e None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:59.131865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c4367-ff7a-4b84-b8aa-dd942005644e None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:59.132326 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c4367-ff7a-4b84-b8aa-dd942005644e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:59.141039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c4367-ff7a-4b84-b8aa-dd942005644e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:59.142497 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c4367-ff7a-4b84-b8aa-dd942005644e None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:59.155159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-5b7c4367-ff7a-4b84-b8aa-dd942005644e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:19:59.155159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:59.155159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:59.155159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:59.155159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:59.155159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:59.155159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:59.155159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:59.155159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:59.155159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:59.155159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:59.155159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:59.155159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:59.155159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:59.155159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:59.155159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:59.156140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:59.157095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:59.157095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:59.157095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:59.157095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:59.157095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:59.157095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:59.157095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:59.157095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:59.157095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:19:59.157095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:59.157095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 321/649] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:59.157696 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c4367-ff7a-4b84-b8aa-dd942005644e None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:59.176749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41167a-9805-44fc-be3e-44fd653a2557 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:59.214829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd31b7f-7b38-4c1c-bd7f-0d86327b93d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:59.215533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd31b7f-7b38-4c1c-bd7f-0d86327b93d6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:59.215816 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd31b7f-7b38-4c1c-bd7f-0d86327b93d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:59.216090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd31b7f-7b38-4c1c-bd7f-0d86327b93d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:59.216737 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd31b7f-7b38-4c1c-bd7f-0d86327b93d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:59.217092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd31b7f-7b38-4c1c-bd7f-0d86327b93d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:59.219023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd31b7f-7b38-4c1c-bd7f-0d86327b93d6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:59.232421 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 329/650] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:59.233310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd31b7f-7b38-4c1c-bd7f-0d86327b93d6 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:59.272142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c4367-ff7a-4b84-b8aa-dd942005644e None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:59.317901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642ee30-ab5d-4fcb-81c1-da3a0d3d083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:59.318530 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642ee30-ab5d-4fcb-81c1-da3a0d3d083a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:59.318853 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642ee30-ab5d-4fcb-81c1-da3a0d3d083a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:59.319140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642ee30-ab5d-4fcb-81c1-da3a0d3d083a None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:59.319982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642ee30-ab5d-4fcb-81c1-da3a0d3d083a None admin] RBAC: Adding query filter params (name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:59.320294 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642ee30-ab5d-4fcb-81c1-da3a0d3d083a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:59.322265 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642ee30-ab5d-4fcb-81c1-da3a0d3d083a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:59.337708 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 322/651] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:59.338646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642ee30-ab5d-4fcb-81c1-da3a0d3d083a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:59.362471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:59.370885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd31b7f-7b38-4c1c-bd7f-0d86327b93d6 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:59.400984 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:59.415578 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067820b-b90b-4cd9-a120-e006e5d2a420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:59.416695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067820b-b90b-4cd9-a120-e006e5d2a420 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:59.416977 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067820b-b90b-4cd9-a120-e006e5d2a420 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:59.417244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067820b-b90b-4cd9-a120-e006e5d2a420 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:59.417975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067820b-b90b-4cd9-a120-e006e5d2a420 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:59.418300 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067820b-b90b-4cd9-a120-e006e5d2a420 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:59.419747 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067820b-b90b-4cd9-a120-e006e5d2a420 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:59.439741 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 330/652] 10.222.0.71 () {56 vars in 1139 bytes} [Thu Sep 1 16:19:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:59.440697 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067820b-b90b-4cd9-a120-e006e5d2a420 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:59.459722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642ee30-ab5d-4fcb-81c1-da3a0d3d083a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:59.496529 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa52948-75f6-4314-8760-9c82a2064627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:59.497527 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa52948-75f6-4314-8760-9c82a2064627 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:59.498012 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa52948-75f6-4314-8760-9c82a2064627 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:59.498541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa52948-75f6-4314-8760-9c82a2064627 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:59.507782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa52948-75f6-4314-8760-9c82a2064627 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:59.509477 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa52948-75f6-4314-8760-9c82a2064627 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:59.521925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-3aa52948-75f6-4314-8760-9c82a2064627 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:19:59.521925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:59.521925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:59.521925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:59.521925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:59.521925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:59.521925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:59.521925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:59.521925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:59.521925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:59.521925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:59.521925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:59.521925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:59.521925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:59.521925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:59.521925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:59.522948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:59.523902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:59.523902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:59.523902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:59.523902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:59.523902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:59.523902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:59.523902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:59.523902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:59.523902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:19:59.523902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:19:59.526436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 323/653] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:59.527486 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa52948-75f6-4314-8760-9c82a2064627 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:59.561943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067820b-b90b-4cd9-a120-e006e5d2a420 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:59.601487 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229783d-c86f-4738-ab84-b2d52a904cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:59.602119 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229783d-c86f-4738-ab84-b2d52a904cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:59.602450 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229783d-c86f-4738-ab84-b2d52a904cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:59.602770 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229783d-c86f-4738-ab84-b2d52a904cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:59.631072 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229783d-c86f-4738-ab84-b2d52a904cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:59.632773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229783d-c86f-4738-ab84-b2d52a904cf1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:59.645580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa52948-75f6-4314-8760-9c82a2064627 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:59.649020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-1229783d-c86f-4738-ab84-b2d52a904cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:59.649020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:59.649020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:59.649020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:59.649020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:59.649020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:59.649020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:59.649020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:59.649020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:59.649020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:59.649020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:59.649020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:59.649020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:59.649020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:59.649020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:59.649020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:59.650009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:59.650009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:59.650009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:59.650009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:59.650009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:59.650009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:59.650009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:59.650009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:59.650009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:59.650009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:59.650009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:59.650009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:59.650009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:59.650009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:59.650009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:59.650009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:59.650009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:59.651065 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:59.651065 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:59.651065 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:19:59.653196 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 331/654] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:59.654170 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229783d-c86f-4738-ab84-b2d52a904cf1 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:59.661781 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:59.664674 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:59.703926 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda57e6-40e6-4a90-bd63-e53d5ebe4c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:59.704661 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda57e6-40e6-4a90-bd63-e53d5ebe4c89 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:59.705012 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda57e6-40e6-4a90-bd63-e53d5ebe4c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:59.705351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda57e6-40e6-4a90-bd63-e53d5ebe4c89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:59.785820 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229783d-c86f-4738-ab84-b2d52a904cf1 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:59.791508 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda57e6-40e6-4a90-bd63-e53d5ebe4c89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:59.793146 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda57e6-40e6-4a90-bd63-e53d5ebe4c89 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:59.833226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6754d-e893-42bb-a457-43341dd12339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:59.834064 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6754d-e893-42bb-a457-43341dd12339 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:59.834440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6754d-e893-42bb-a457-43341dd12339 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:59.834803 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6754d-e893-42bb-a457-43341dd12339 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:59.835603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6754d-e893-42bb-a457-43341dd12339 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:59.835977 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6754d-e893-42bb-a457-43341dd12339 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:59.837464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6754d-e893-42bb-a457-43341dd12339 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:59.866236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 332/655] 10.222.0.71 () {56 vars in 1137 bytes} [Thu Sep 1 16:19:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:59.866236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6754d-e893-42bb-a457-43341dd12339 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:59.918538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 324/656] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:59.919401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda57e6-40e6-4a90-bd63-e53d5ebe4c89 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:59.929942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:59.940495 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:59.986649 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6754d-e893-42bb-a457-43341dd12339 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.021823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda57e6-40e6-4a90-bd63-e53d5ebe4c89 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.026706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a95f9-9180-4e58-a034-e5a74db2ae6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.027434 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a95f9-9180-4e58-a034-e5a74db2ae6d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.027781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a95f9-9180-4e58-a034-e5a74db2ae6d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.028124 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a95f9-9180-4e58-a034-e5a74db2ae6d None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.028865 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a95f9-9180-4e58-a034-e5a74db2ae6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:00.029236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a95f9-9180-4e58-a034-e5a74db2ae6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:00.030831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a95f9-9180-4e58-a034-e5a74db2ae6d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:00.044047 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 333/657] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:00.049400 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a95f9-9180-4e58-a034-e5a74db2ae6d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:00.061187 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2beeeff-e6b8-45a9-8f90-d5fca40ff5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.061984 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beeeff-e6b8-45a9-8f90-d5fca40ff5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.062426 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beeeff-e6b8-45a9-8f90-d5fca40ff5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.062879 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beeeff-e6b8-45a9-8f90-d5fca40ff5a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.136464 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2beeeff-e6b8-45a9-8f90-d5fca40ff5a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:00.138132 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2beeeff-e6b8-45a9-8f90-d5fca40ff5a5 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:00.147935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:00.167604 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a95f9-9180-4e58-a034-e5a74db2ae6d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.193005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:00.207358 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f21050-1a0d-40e7-8c46-03b173200958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.208171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f21050-1a0d-40e7-8c46-03b173200958 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.208645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f21050-1a0d-40e7-8c46-03b173200958 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.209157 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f21050-1a0d-40e7-8c46-03b173200958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.221362 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f21050-1a0d-40e7-8c46-03b173200958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:00.223109 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f21050-1a0d-40e7-8c46-03b173200958 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:00.238934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-59f21050-1a0d-40e7-8c46-03b173200958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:00.238934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:00.238934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:00.238934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:00.238934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:00.238934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:00.238934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:00.238934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:00.238934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:00.238934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:00.238934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:00.238934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:00.238934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:00.238934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:00.238934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:00.238934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:00.240083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:00.240083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:00.240083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:00.240083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:00.240083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:00.240083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:00.240083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:00.240083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:00.240083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:00.240083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:00.240083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:00.240083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:00.240083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:00.240083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:00.240083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:00.240083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:00.240083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:00.241126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:00.241126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:00.241126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:00.241309 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 325/658] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:20:00.241309 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2beeeff-e6b8-45a9-8f90-d5fca40ff5a5 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:00.243264 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 334/659] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:00.250670 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f21050-1a0d-40e7-8c46-03b173200958 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:00.346113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2beeeff-e6b8-45a9-8f90-d5fca40ff5a5 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.355578 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:00.363716 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f21050-1a0d-40e7-8c46-03b173200958 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.381367 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1ec18-985f-40a5-8616-3f62e7cc2ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.382050 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1ec18-985f-40a5-8616-3f62e7cc2ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.382311 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1ec18-985f-40a5-8616-3f62e7cc2ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.382585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1ec18-985f-40a5-8616-3f62e7cc2ed3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.390533 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1ec18-985f-40a5-8616-3f62e7cc2ed3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:00.392005 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1ec18-985f-40a5-8616-3f62e7cc2ed3 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:00.402356 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf48ba1-2b37-45bd-9959-deb5530aa324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.403290 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf48ba1-2b37-45bd-9959-deb5530aa324 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.403754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf48ba1-2b37-45bd-9959-deb5530aa324 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.403886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-96b1ec18-985f-40a5-8616-3f62e7cc2ed3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:20:00.403886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:00.403886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:00.403886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:00.403886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:00.403886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:00.403886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:00.403886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:00.403886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:00.403886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:00.403886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:00.403886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:00.403886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:00.403886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:00.403886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:00.403886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:00.404759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:00.405721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:00.405721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:00.405721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:00.405721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:00.405721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:00.405721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:00.405721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:00.405721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:00.405721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:20:00.405721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:00.405721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 326/660] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:00.406556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1ec18-985f-40a5-8616-3f62e7cc2ed3 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:00.406749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf48ba1-2b37-45bd-9959-deb5530aa324 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.421634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf48ba1-2b37-45bd-9959-deb5530aa324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:00.423233 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf48ba1-2b37-45bd-9959-deb5530aa324 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:00.439312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-cdf48ba1-2b37-45bd-9959-deb5530aa324 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:00.439312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:00.439312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:00.439312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:00.439312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:00.439312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:00.439312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:00.439312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:00.439312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:00.439312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:00.439312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:00.439312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:00.439312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:00.439312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:00.439312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:00.439312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:00.440285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:00.440285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:00.440285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:00.440285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:00.440285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:00.440285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:00.440285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:00.440285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:00.440285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:00.440285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:00.440285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:00.440285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:00.440285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:00.440285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:00.440285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:00.440285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:00.440285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:00.441190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:00.441190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:00.441190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:00.441190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 335/661] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:00.441829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517644c-d4d9-409f-972b-0e010fe6fda4 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.441992 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517644c-d4d9-409f-972b-0e010fe6fda4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.442238 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517644c-d4d9-409f-972b-0e010fe6fda4 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.443716 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 336/662] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:00.444159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517644c-d4d9-409f-972b-0e010fe6fda4 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:00.475720 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:00.518283 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1ec18-985f-40a5-8616-3f62e7cc2ed3 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.552981 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f456ed-44b2-4298-a887-6bba5698c1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.553579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f456ed-44b2-4298-a887-6bba5698c1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.553854 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f456ed-44b2-4298-a887-6bba5698c1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.554126 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f456ed-44b2-4298-a887-6bba5698c1f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.554685 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517644c-d4d9-409f-972b-0e010fe6fda4 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.554812 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f456ed-44b2-4298-a887-6bba5698c1f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:00.555084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f456ed-44b2-4298-a887-6bba5698c1f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:00.556440 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f456ed-44b2-4298-a887-6bba5698c1f9 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:00.573860 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 327/663] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:00.573860 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f456ed-44b2-4298-a887-6bba5698c1f9 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:00.595236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fae4d-699d-4dd4-9952-a84ce74f1927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.596098 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fae4d-699d-4dd4-9952-a84ce74f1927 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.596361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fae4d-699d-4dd4-9952-a84ce74f1927 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.596634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fae4d-699d-4dd4-9952-a84ce74f1927 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.597371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fae4d-699d-4dd4-9952-a84ce74f1927 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:00.597679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fae4d-699d-4dd4-9952-a84ce74f1927 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:00.599142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fae4d-699d-4dd4-9952-a84ce74f1927 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:00.604096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:00.617519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 337/664] 10.222.0.71 () {56 vars in 1137 bytes} [Thu Sep 1 16:20:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:00.625679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6915bdc-8b41-43ce-9677-02e377f2d842 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.625963 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6915bdc-8b41-43ce-9677-02e377f2d842 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.626232 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6915bdc-8b41-43ce-9677-02e377f2d842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.644954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d6915bdc-8b41-43ce-9677-02e377f2d842 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:00.646151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d6915bdc-8b41-43ce-9677-02e377f2d842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:00.689495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f456ed-44b2-4298-a887-6bba5698c1f9 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.722853 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 338/665] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:20:00.722853 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6915bdc-8b41-43ce-9677-02e377f2d842 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:00.730754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037df4a-b4cb-4169-b852-84a14596b16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.731459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037df4a-b4cb-4169-b852-84a14596b16f None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.731831 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037df4a-b4cb-4169-b852-84a14596b16f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.732195 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037df4a-b4cb-4169-b852-84a14596b16f None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.732936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037df4a-b4cb-4169-b852-84a14596b16f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:00.733352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037df4a-b4cb-4169-b852-84a14596b16f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:00.734979 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037df4a-b4cb-4169-b852-84a14596b16f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:00.747292 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:00.750492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 328/666] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:00.751537 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037df4a-b4cb-4169-b852-84a14596b16f None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:00.857725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:00.858056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6915bdc-8b41-43ce-9677-02e377f2d842 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.872474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037df4a-b4cb-4169-b852-84a14596b16f None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.895757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90a232-50fc-4d9c-b4b6-0b8fcccc1131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.896751 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90a232-50fc-4d9c-b4b6-0b8fcccc1131 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.897231 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90a232-50fc-4d9c-b4b6-0b8fcccc1131 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.897701 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90a232-50fc-4d9c-b4b6-0b8fcccc1131 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.905223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90a232-50fc-4d9c-b4b6-0b8fcccc1131 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:00.906807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90a232-50fc-4d9c-b4b6-0b8fcccc1131 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:00.906942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe02c7f-bbe5-4c10-baa5-cb7e78ab7969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.907465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe02c7f-bbe5-4c10-baa5-cb7e78ab7969 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.907739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe02c7f-bbe5-4c10-baa5-cb7e78ab7969 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.908003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe02c7f-bbe5-4c10-baa5-cb7e78ab7969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.918568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-dc90a232-50fc-4d9c-b4b6-0b8fcccc1131 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:00.918568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:00.918568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:00.918568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:00.918568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:00.918568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:00.918568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:00.918568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:00.918568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:00.918568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:00.918568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:00.918568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:00.918568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:00.918568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:00.918568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:00.919498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:00.919498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:00.919498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:00.919498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:00.919498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:00.919498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:00.919498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:00.919498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:00.919498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:00.919498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:00.919498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:00.919498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:00.919498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:00.919498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:00.919498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:00.919498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:00.919498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:00.921085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:00.921085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:00.921085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:00.921085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:00.921085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:00.921085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:00.921085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:00.921085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:00.924408 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 339/667] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:00.925049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90a232-50fc-4d9c-b4b6-0b8fcccc1131 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:00.981601 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe02c7f-bbe5-4c10-baa5-cb7e78ab7969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:00.982987 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe02c7f-bbe5-4c10-baa5-cb7e78ab7969 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:01.005164 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:01.029358 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90a232-50fc-4d9c-b4b6-0b8fcccc1131 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.062313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af6047-9bc5-4609-b32a-01d3936c55e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.062963 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af6047-9bc5-4609-b32a-01d3936c55e1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.063243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af6047-9bc5-4609-b32a-01d3936c55e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.063515 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af6047-9bc5-4609-b32a-01d3936c55e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.067578 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:01.070260 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af6047-9bc5-4609-b32a-01d3936c55e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:01.071711 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af6047-9bc5-4609-b32a-01d3936c55e1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:01.080238 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 329/668] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:20:01.081462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad134aa5-0478-43bd-b156-0e5036b9c560 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.081748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad134aa5-0478-43bd-b156-0e5036b9c560 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.082023 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad134aa5-0478-43bd-b156-0e5036b9c560 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.082887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-c8af6047-9bc5-4609-b32a-01d3936c55e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:01.082887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:01.082887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:01.082887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:01.082887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:01.082887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:01.082887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:01.082887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:01.082887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:01.082887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:01.082887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:01.082887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:01.082887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:01.082887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:01.082887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:01.083726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:01.083726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:01.083726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:01.083726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:01.083726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:01.083726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:01.083726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:01.083726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:01.083726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:01.083726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:01.083726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:01.083726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:01.083726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:01.083726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:01.083726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:01.083726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:01.083726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:01.084624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:01.084624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:01.084624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:01.084624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:01.084624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:01.084624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:01.084624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:01.084624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:01.084624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 340/669] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:01.085125 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af6047-9bc5-4609-b32a-01d3936c55e1 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.087200 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 330/670] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:01.088475 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad134aa5-0478-43bd-b156-0e5036b9c560 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.183383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af6047-9bc5-4609-b32a-01d3936c55e1 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.186458 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad134aa5-0478-43bd-b156-0e5036b9c560 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.221764 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d870c-a4b3-49a5-81dc-ffd60db82868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.222385 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d870c-a4b3-49a5-81dc-ffd60db82868 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.222691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d870c-a4b3-49a5-81dc-ffd60db82868 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.222963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d870c-a4b3-49a5-81dc-ffd60db82868 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.224733 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bec984-f831-4927-bd70-ba3e66603634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.225009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bec984-f831-4927-bd70-ba3e66603634 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.225288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bec984-f831-4927-bd70-ba3e66603634 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.225559 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bec984-f831-4927-bd70-ba3e66603634 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.226256 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bec984-f831-4927-bd70-ba3e66603634 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:01.226557 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bec984-f831-4927-bd70-ba3e66603634 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:01.228011 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bec984-f831-4927-bd70-ba3e66603634 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:01.231058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:01.237431 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d870c-a4b3-49a5-81dc-ffd60db82868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:01.241458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 341/671] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:01.242213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-907d870c-a4b3-49a5-81dc-ffd60db82868 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:01.242213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:01.242213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:01.242213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:01.242213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:01.242213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:01.242213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:01.242213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:01.242213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:01.242213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:01.242213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:01.242213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:01.242213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:01.242213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:01.242213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:01.242213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:01.243169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:01.243169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:01.243169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:01.243169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:01.243169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:01.243169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:01.243169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:01.243169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:01.243169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:01.243169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:01.243169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:01.243169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:01.243169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:01.243169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:01.243169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:01.243169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:01.244044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:01.244044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:01.244044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:01.244044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:01.244044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:01.244044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:01.244044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:01.244044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:01.244044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:01.244044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:01.244044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:01.244044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:01.244696 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bec984-f831-4927-bd70-ba3e66603634 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.244770 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 331/672] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:01.244770 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b07d-9ac6-4d36-91c5-82901f8eb805 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.245475 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b07d-9ac6-4d36-91c5-82901f8eb805 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.245475 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b07d-9ac6-4d36-91c5-82901f8eb805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.262551 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-b2a9b07d-9ac6-4d36-91c5-82901f8eb805 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:01.263745 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b2a9b07d-9ac6-4d36-91c5-82901f8eb805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:01.305635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:01.328199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 332/673] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:20:01.329244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9b07d-9ac6-4d36-91c5-82901f8eb805 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.343424 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bec984-f831-4927-bd70-ba3e66603634 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.379560 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08598f1-9e52-405e-8ae5-85c15160910e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.380188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08598f1-9e52-405e-8ae5-85c15160910e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.380474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08598f1-9e52-405e-8ae5-85c15160910e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.380745 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08598f1-9e52-405e-8ae5-85c15160910e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.391348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08598f1-9e52-405e-8ae5-85c15160910e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:01.392770 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08598f1-9e52-405e-8ae5-85c15160910e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:01.409122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-a08598f1-9e52-405e-8ae5-85c15160910e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:01.409122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:01.409122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:01.409122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:01.409122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:01.409122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:01.409122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:01.409122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:01.409122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:01.409122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:01.409122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:01.409122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:01.409122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:01.409122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:01.409122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:01.409122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:01.410112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:01.410112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:01.410112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:01.410112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:01.410112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:01.410112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:01.410112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:01.410112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:01.410112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:01.410112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:01.410112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:01.410112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:01.410112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:01.410112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:01.410112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:01.410112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:01.410112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:01.411155 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:01.411155 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:01.411155 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:01.411912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 342/674] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:01.412725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08598f1-9e52-405e-8ae5-85c15160910e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.441613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9b07d-9ac6-4d36-91c5-82901f8eb805 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.466359 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:01.479002 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338a1a5-f580-4767-9489-eec7c1326551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.479660 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338a1a5-f580-4767-9489-eec7c1326551 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.479965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338a1a5-f580-4767-9489-eec7c1326551 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.480244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338a1a5-f580-4767-9489-eec7c1326551 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.480939 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338a1a5-f580-4767-9489-eec7c1326551 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:01.481248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338a1a5-f580-4767-9489-eec7c1326551 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:01.482710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338a1a5-f580-4767-9489-eec7c1326551 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:01.499823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 333/675] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:01.499823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338a1a5-f580-4767-9489-eec7c1326551 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.526423 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08598f1-9e52-405e-8ae5-85c15160910e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.539523 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:01.567207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3d1b8-af35-4cff-9b95-924c5ea47e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.567806 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3d1b8-af35-4cff-9b95-924c5ea47e9a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.568078 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3d1b8-af35-4cff-9b95-924c5ea47e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.568343 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3d1b8-af35-4cff-9b95-924c5ea47e9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.569056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3d1b8-af35-4cff-9b95-924c5ea47e9a None admin] RBAC: Adding query filter params (role.id=21a27b57a72246b2ade92d82599c569d, scope.project.id=9527063094354a99a80822107d2740fb, user.id=d494fd310b1f40839f113d045f0bdcb9) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:01.569358 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3d1b8-af35-4cff-9b95-924c5ea47e9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:01.570830 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3d1b8-af35-4cff-9b95-924c5ea47e9a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:01.577447 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 343/676] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/role_assignments?user.id=d494fd310b1f40839f113d045f0bdcb9&scope.project.id=9527063094354a99a80822107d2740fb&role.id=21a27b57a72246b2ade92d82599c569d => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:01.578165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3d1b8-af35-4cff-9b95-924c5ea47e9a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.641198 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338a1a5-f580-4767-9489-eec7c1326551 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.679586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce49550-9fa6-4db3-876f-e3a1f8b3ee83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.680208 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce49550-9fa6-4db3-876f-e3a1f8b3ee83 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.680530 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce49550-9fa6-4db3-876f-e3a1f8b3ee83 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.680808 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce49550-9fa6-4db3-876f-e3a1f8b3ee83 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.681534 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce49550-9fa6-4db3-876f-e3a1f8b3ee83 None admin] RBAC: Adding query filter params (name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:01.681835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce49550-9fa6-4db3-876f-e3a1f8b3ee83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:01.683276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce49550-9fa6-4db3-876f-e3a1f8b3ee83 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:01.697936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 334/677] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:01.697936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce49550-9fa6-4db3-876f-e3a1f8b3ee83 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.704547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3d1b8-af35-4cff-9b95-924c5ea47e9a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.720168 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:01.749386 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb1297-380b-49be-a1d0-6568e828012a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.749786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb1297-380b-49be-a1d0-6568e828012a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.750021 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb1297-380b-49be-a1d0-6568e828012a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.750278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb1297-380b-49be-a1d0-6568e828012a None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.750976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb1297-380b-49be-a1d0-6568e828012a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:01.751280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb1297-380b-49be-a1d0-6568e828012a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:01.752834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb1297-380b-49be-a1d0-6568e828012a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:01.768055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 344/678] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:01.769179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb1297-380b-49be-a1d0-6568e828012a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.814419 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:01.818218 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce49550-9fa6-4db3-876f-e3a1f8b3ee83 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.855619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a40eb5-99dc-47bc-bcc7-a0f36555316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.856465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a40eb5-99dc-47bc-bcc7-a0f36555316a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.856749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a40eb5-99dc-47bc-bcc7-a0f36555316a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.857024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a40eb5-99dc-47bc-bcc7-a0f36555316a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.857749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a40eb5-99dc-47bc-bcc7-a0f36555316a None admin] RBAC: Adding query filter params (role.id=21a27b57a72246b2ade92d82599c569d, scope.project.id=9527063094354a99a80822107d2740fb, user.id=5a0dece90fc54641be30cdc2ddad9cf4) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:01.858060 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a40eb5-99dc-47bc-bcc7-a0f36555316a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:01.859507 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a40eb5-99dc-47bc-bcc7-a0f36555316a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:01.874649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 335/679] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/role_assignments?user.id=5a0dece90fc54641be30cdc2ddad9cf4&scope.project.id=9527063094354a99a80822107d2740fb&role.id=21a27b57a72246b2ade92d82599c569d => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:01.874649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a40eb5-99dc-47bc-bcc7-a0f36555316a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.888449 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb1297-380b-49be-a1d0-6568e828012a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.937484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a2771-6b73-4824-b17a-15c80a12608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.938354 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a2771-6b73-4824-b17a-15c80a12608d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.938818 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a2771-6b73-4824-b17a-15c80a12608d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.939163 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a2771-6b73-4824-b17a-15c80a12608d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.953458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a2771-6b73-4824-b17a-15c80a12608d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:01.958921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-839a2771-6b73-4824-b17a-15c80a12608d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:01.958921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:01.958921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:01.958921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:01.958921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:01.958921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:01.958921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:01.958921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:01.958921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:01.958921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:01.958921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:01.958921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:01.958921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:01.958921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:01.958921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:01.958921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:01.959930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:01.959930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:01.959930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:01.959930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:01.959930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:01.959930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:01.959930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:01.959930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:01.959930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:01.959930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:01.959930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:01.959930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:01.959930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:01.959930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:01.959930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:01.959930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:01.960771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:01.960771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:01.960771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:01.960771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:01.960771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:01.960771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:01.960771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:01.960771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:01.960771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:01.960771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:01.960771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:01.960771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:01.960771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 345/680] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:01.961476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a2771-6b73-4824-b17a-15c80a12608d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:02.002117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:02.012346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a40eb5-99dc-47bc-bcc7-a0f36555316a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:02.061792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797df684-8fb1-42fd-a425-6bb08818aad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:02.062848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797df684-8fb1-42fd-a425-6bb08818aad3 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:02.063360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797df684-8fb1-42fd-a425-6bb08818aad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:02.063639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797df684-8fb1-42fd-a425-6bb08818aad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:02.075723 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797df684-8fb1-42fd-a425-6bb08818aad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:02.077122 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797df684-8fb1-42fd-a425-6bb08818aad3 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:02.095681 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a2771-6b73-4824-b17a-15c80a12608d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:02.096181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-797df684-8fb1-42fd-a425-6bb08818aad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:02.096181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:02.096181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:02.096181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:02.096181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:02.096181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:02.096181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:02.096181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:02.096181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:02.096181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:02.096181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:02.096181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:02.096181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:02.096181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:02.096181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:02.096181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:02.097215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:02.097215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:02.097215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:02.097215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:02.097215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:02.097215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:02.097215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:02.097215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:02.097215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:02.097215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:02.097215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:02.097215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:02.097215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:02.097215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:02.097215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:02.097215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:02.097215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:02.098211 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:02.098211 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:02.098211 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:02.098211 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 336/681] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:02.098211 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797df684-8fb1-42fd-a425-6bb08818aad3 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:02.120688 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:02.147338 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ee80c-3e0b-4365-b8b9-bb3cc75d3486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:02.147976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ee80c-3e0b-4365-b8b9-bb3cc75d3486 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:02.148257 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ee80c-3e0b-4365-b8b9-bb3cc75d3486 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:02.148535 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ee80c-3e0b-4365-b8b9-bb3cc75d3486 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:02.158493 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ee80c-3e0b-4365-b8b9-bb3cc75d3486 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:02.160491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ee80c-3e0b-4365-b8b9-bb3cc75d3486 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:02.176901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-5b6ee80c-3e0b-4365-b8b9-bb3cc75d3486 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:02.176901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:02.176901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:02.176901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:02.176901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:02.176901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:02.176901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:02.176901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:02.176901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:02.176901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:02.176901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:02.176901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:02.176901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:02.176901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:02.176901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:02.177829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:02.177829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:02.177829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:02.177829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:02.177829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:02.177829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:02.177829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:02.177829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:02.177829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:02.177829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:02.177829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:02.177829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:02.177829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:02.177829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:02.177829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:02.177829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:02.177829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:02.178763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:02.178763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:02.178763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:02.178763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:02.178763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:02.178763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:02.178763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:02.178763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:02.178763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 346/682] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:02.179475 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ee80c-3e0b-4365-b8b9-bb3cc75d3486 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:02.230534 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797df684-8fb1-42fd-a425-6bb08818aad3 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:02.280408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed66fc-fa09-4c6e-b95a-53e9923ea530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:02.280942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed66fc-fa09-4c6e-b95a-53e9923ea530 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:02.281256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed66fc-fa09-4c6e-b95a-53e9923ea530 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:02.281750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed66fc-fa09-4c6e-b95a-53e9923ea530 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:02.282921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed66fc-fa09-4c6e-b95a-53e9923ea530 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:02.283233 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed66fc-fa09-4c6e-b95a-53e9923ea530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:02.284887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed66fc-fa09-4c6e-b95a-53e9923ea530 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:02.294015 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:02.299187 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 337/683] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:02.300262 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed66fc-fa09-4c6e-b95a-53e9923ea530 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:02.309657 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ee80c-3e0b-4365-b8b9-bb3cc75d3486 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:02.347567 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9c018-03c6-4ffd-b634-d17f0814e45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:02.348205 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9c018-03c6-4ffd-b634-d17f0814e45f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:02.348489 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9c018-03c6-4ffd-b634-d17f0814e45f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:02.348763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9c018-03c6-4ffd-b634-d17f0814e45f None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:02.354213 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9c018-03c6-4ffd-b634-d17f0814e45f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:02.354781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9c018-03c6-4ffd-b634-d17f0814e45f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:02.356864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9c018-03c6-4ffd-b634-d17f0814e45f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:02.373863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 347/684] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:02.375985 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9c018-03c6-4ffd-b634-d17f0814e45f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:02.396733 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:02.422608 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed66fc-fa09-4c6e-b95a-53e9923ea530 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:02.458490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2c3bf-d75b-417e-8a54-245acc8209c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:02.459572 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2c3bf-d75b-417e-8a54-245acc8209c4 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:02.460057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2c3bf-d75b-417e-8a54-245acc8209c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:02.460533 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2c3bf-d75b-417e-8a54-245acc8209c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:02.461426 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2c3bf-d75b-417e-8a54-245acc8209c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:02.461948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2c3bf-d75b-417e-8a54-245acc8209c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:02.463614 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2c3bf-d75b-417e-8a54-245acc8209c4 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:02.476859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 338/685] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:02.478085 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2c3bf-d75b-417e-8a54-245acc8209c4 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:02.497765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9c018-03c6-4ffd-b634-d17f0814e45f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:02.535647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eae9c8-08e3-4240-a4bc-be8da2a50087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:02.536314 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eae9c8-08e3-4240-a4bc-be8da2a50087 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:02.536595 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eae9c8-08e3-4240-a4bc-be8da2a50087 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:02.536872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eae9c8-08e3-4240-a4bc-be8da2a50087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:02.549426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eae9c8-08e3-4240-a4bc-be8da2a50087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:02.550963 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eae9c8-08e3-4240-a4bc-be8da2a50087 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:02.566481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-c3eae9c8-08e3-4240-a4bc-be8da2a50087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:02.566481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:02.566481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:02.566481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:02.566481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:02.566481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:02.566481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:02.566481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:02.566481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:02.566481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:02.566481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:02.566481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:02.566481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:02.566481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:02.566481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:02.566481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:02.567465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:02.567465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:02.567465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:02.567465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:02.567465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:02.567465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:02.567465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:02.567465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:02.567465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:02.567465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:02.567465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:02.567465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:02.567465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:02.567465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:02.567465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:02.567465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:02.567465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:02.568369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:02.568369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:02.568369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:02.572514 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 348/686] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:02.573358 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eae9c8-08e3-4240-a4bc-be8da2a50087 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:02.577465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:02.592900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2c3bf-d75b-417e-8a54-245acc8209c4 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:02.636402 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781c31e-ab87-4256-9430-7d57002dc330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:02.637446 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781c31e-ab87-4256-9430-7d57002dc330 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:02.637977 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781c31e-ab87-4256-9430-7d57002dc330 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:02.638452 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781c31e-ab87-4256-9430-7d57002dc330 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:02.646219 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781c31e-ab87-4256-9430-7d57002dc330 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:02.647913 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781c31e-ab87-4256-9430-7d57002dc330 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:02.649956 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:02.663274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-d781c31e-ab87-4256-9430-7d57002dc330 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:02.663274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:02.663274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:02.663274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:02.663274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:02.663274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:02.663274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:02.663274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:02.663274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:02.663274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:02.663274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:02.663274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:02.663274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:02.663274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:02.663274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:02.663274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:02.664252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:02.665201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:02.665201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:02.665201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:02.665201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:02.665201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:02.665201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:02.665201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:02.665201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:02.665201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:02.665201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:02.668333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 339/687] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:02.669404 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781c31e-ab87-4256-9430-7d57002dc330 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:02.688579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eae9c8-08e3-4240-a4bc-be8da2a50087 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:02.727635 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f49acf-b4d3-40fd-9126-1692740da740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:02.728419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f49acf-b4d3-40fd-9126-1692740da740 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:02.729365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f49acf-b4d3-40fd-9126-1692740da740 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:02.729645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f49acf-b4d3-40fd-9126-1692740da740 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:02.730375 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f49acf-b4d3-40fd-9126-1692740da740 None admin] RBAC: Adding query filter params (role.id=21a27b57a72246b2ade92d82599c569d, scope.project.id=9527063094354a99a80822107d2740fb, user.id=b11356a5e3d041729f71515482033dce) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:02.731103 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f49acf-b4d3-40fd-9126-1692740da740 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:02.732280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f49acf-b4d3-40fd-9126-1692740da740 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:02.746298 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 349/688] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:02 2022] GET /identity/v3/role_assignments?user.id=b11356a5e3d041729f71515482033dce&scope.project.id=9527063094354a99a80822107d2740fb&role.id=21a27b57a72246b2ade92d82599c569d => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:02.747218 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f49acf-b4d3-40fd-9126-1692740da740 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:02.779411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781c31e-ab87-4256-9430-7d57002dc330 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:02.833385 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd37667-5369-478d-9705-ef01ea4f6575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:02.834392 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd37667-5369-478d-9705-ef01ea4f6575 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:02.834904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd37667-5369-478d-9705-ef01ea4f6575 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:02.835381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd37667-5369-478d-9705-ef01ea4f6575 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:02.836235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd37667-5369-478d-9705-ef01ea4f6575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:02.836821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd37667-5369-478d-9705-ef01ea4f6575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:02.838954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd37667-5369-478d-9705-ef01ea4f6575 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:02.852251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:02.865627 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 340/689] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:02.884197 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd37667-5369-478d-9705-ef01ea4f6575 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:02.899361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f49acf-b4d3-40fd-9126-1692740da740 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:02.937644 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e92e8c-7fae-40f9-b930-c36f210ebf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:02.938272 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e92e8c-7fae-40f9-b930-c36f210ebf7c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:02.938554 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e92e8c-7fae-40f9-b930-c36f210ebf7c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:02.938940 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e92e8c-7fae-40f9-b930-c36f210ebf7c None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:02.939689 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e92e8c-7fae-40f9-b930-c36f210ebf7c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:02.940056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e92e8c-7fae-40f9-b930-c36f210ebf7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:02.941429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e92e8c-7fae-40f9-b930-c36f210ebf7c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:02.966555 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 350/690] 10.222.0.71 () {56 vars in 1135 bytes} [Thu Sep 1 16:20:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:02.972075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e92e8c-7fae-40f9-b930-c36f210ebf7c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:03.012940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:03.077175 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd37667-5369-478d-9705-ef01ea4f6575 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:03.120820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab2710-a10e-469a-b156-820b2560e28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:03.121366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab2710-a10e-469a-b156-820b2560e28a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.121650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab2710-a10e-469a-b156-820b2560e28a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.121924 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab2710-a10e-469a-b156-820b2560e28a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.130761 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab2710-a10e-469a-b156-820b2560e28a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:03.132197 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab2710-a10e-469a-b156-820b2560e28a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:03.139915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e92e8c-7fae-40f9-b930-c36f210ebf7c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:03.144969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-efab2710-a10e-469a-b156-820b2560e28a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:03.144969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:03.144969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:03.144969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:03.144969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:03.144969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:03.144969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:03.144969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:03.144969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:03.144969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:03.144969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:03.144969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:03.144969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:03.144969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:03.144969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:03.144969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:03.145971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:03.146998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:03.146998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:03.146998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:03.146998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:03.146998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:03.146998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:03.146998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:03.146998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:03.146998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:03.146998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:03.146998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 341/691] 10.222.0.71 () {56 vars in 1093 bytes} [Thu Sep 1 16:20:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:03.155188 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab2710-a10e-469a-b156-820b2560e28a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:03.179615 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:03.192709 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018a494-c7e6-48f5-b7fa-ca29e509036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:03.193782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018a494-c7e6-48f5-b7fa-ca29e509036d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.194666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018a494-c7e6-48f5-b7fa-ca29e509036d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.195092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018a494-c7e6-48f5-b7fa-ca29e509036d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.283852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab2710-a10e-469a-b156-820b2560e28a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:03.284468 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018a494-c7e6-48f5-b7fa-ca29e509036d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:03.286193 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018a494-c7e6-48f5-b7fa-ca29e509036d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:03.308720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:03.338667 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55a213-5e30-4d42-a957-61b078c59a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:03.339585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55a213-5e30-4d42-a957-61b078c59a59 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.339970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55a213-5e30-4d42-a957-61b078c59a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.340343 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55a213-5e30-4d42-a957-61b078c59a59 None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.341515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55a213-5e30-4d42-a957-61b078c59a59 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:03.342658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55a213-5e30-4d42-a957-61b078c59a59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:03.344540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55a213-5e30-4d42-a957-61b078c59a59 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:03.371383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 342/692] 10.222.0.71 () {56 vars in 1133 bytes} [Thu Sep 1 16:20:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:03.377692 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55a213-5e30-4d42-a957-61b078c59a59 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:03.421781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 351/693] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:20:03.427600 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018a494-c7e6-48f5-b7fa-ca29e509036d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:03.480231 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:03.556754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55a213-5e30-4d42-a957-61b078c59a59 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:03.575766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018a494-c7e6-48f5-b7fa-ca29e509036d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:03.624936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329fc03-ce86-4bb1-89c8-aa2caff8eab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:03.625273 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329fc03-ce86-4bb1-89c8-aa2caff8eab7 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.625578 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329fc03-ce86-4bb1-89c8-aa2caff8eab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.625821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329fc03-ce86-4bb1-89c8-aa2caff8eab7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.636102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a37b79-b438-4d79-b5b6-71588e132944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:03.637029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a37b79-b438-4d79-b5b6-71588e132944 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.637941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a37b79-b438-4d79-b5b6-71588e132944 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.638445 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a37b79-b438-4d79-b5b6-71588e132944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.653282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a37b79-b438-4d79-b5b6-71588e132944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:03.655712 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a37b79-b438-4d79-b5b6-71588e132944 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:03.675313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-b9a37b79-b438-4d79-b5b6-71588e132944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:03.675313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:03.675313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:03.675313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:03.675313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:03.675313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:03.675313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:03.675313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:03.675313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:03.675313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:03.675313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:03.675313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:03.675313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:03.675313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:03.675313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:03.675313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:03.676379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:03.676379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:03.676379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:03.676379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:03.676379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:03.676379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:03.676379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:03.676379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:03.676379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:03.676379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:03.676379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:03.676379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:03.676379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:03.676379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:03.676379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:03.676379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:03.676379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:03.677286 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:03.677286 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:03.677286 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:03.677458 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:03.679773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 352/694] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:03.681566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc21551-738a-42a6-814b-e6e3431dfdb5 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.682024 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc21551-738a-42a6-814b-e6e3431dfdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.682587 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc21551-738a-42a6-814b-e6e3431dfdb5 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.684607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 353/695] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:03.685588 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc21551-738a-42a6-814b-e6e3431dfdb5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:03.707558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329fc03-ce86-4bb1-89c8-aa2caff8eab7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:03.709261 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329fc03-ce86-4bb1-89c8-aa2caff8eab7 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:03.796926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:03.821105 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc21551-738a-42a6-814b-e6e3431dfdb5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:03.840443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 343/696] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:20:03.840443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6077ea5-f1f7-46b6-8d86-e5f51a60c677 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.840443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6077ea5-f1f7-46b6-8d86-e5f51a60c677 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.840753 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6077ea5-f1f7-46b6-8d86-e5f51a60c677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.859058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-a6077ea5-f1f7-46b6-8d86-e5f51a60c677 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:03.860312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a6077ea5-f1f7-46b6-8d86-e5f51a60c677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:03.867322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0b8a2-d5f2-4a45-a8ac-91f6a972a6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:03.868809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0b8a2-d5f2-4a45-a8ac-91f6a972a6ca None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.869323 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0b8a2-d5f2-4a45-a8ac-91f6a972a6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.869806 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0b8a2-d5f2-4a45-a8ac-91f6a972a6ca None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.871124 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0b8a2-d5f2-4a45-a8ac-91f6a972a6ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:03.871628 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0b8a2-d5f2-4a45-a8ac-91f6a972a6ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:03.873882 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0b8a2-d5f2-4a45-a8ac-91f6a972a6ca None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:03.892423 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 354/697] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:03.893818 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0b8a2-d5f2-4a45-a8ac-91f6a972a6ca None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:03.936993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 344/698] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:20:03.938000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6077ea5-f1f7-46b6-8d86-e5f51a60c677 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:03.951927 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:04.020229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0b8a2-d5f2-4a45-a8ac-91f6a972a6ca None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.067076 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3826a7-181a-47a8-9329-be7863066e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:04.068469 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3826a7-181a-47a8-9329-be7863066e8b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.068926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3826a7-181a-47a8-9329-be7863066e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.069607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3826a7-181a-47a8-9329-be7863066e8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.079710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:04.081347 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6077ea5-f1f7-46b6-8d86-e5f51a60c677 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.085951 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3826a7-181a-47a8-9329-be7863066e8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:04.087618 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3826a7-181a-47a8-9329-be7863066e8b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:04.103276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-4b3826a7-181a-47a8-9329-be7863066e8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:04.103276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:04.103276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:04.103276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:04.103276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:04.103276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:04.103276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:04.103276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:04.103276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:04.103276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:04.103276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:04.103276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:04.103276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:04.103276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:04.103276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:04.103276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:04.104249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:04.104249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:04.104249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:04.104249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:04.104249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:04.104249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:04.104249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:04.104249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:04.104249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:04.104249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:04.104249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:04.104249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:04.104249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:04.104249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:04.104249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:04.104249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:04.104249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:04.105445 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:04.105445 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:04.105445 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:04.105445 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 355/699] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:04.110435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb8234-5f3d-494a-af07-65d12d1c7845 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.110809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb8234-5f3d-494a-af07-65d12d1c7845 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.111157 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb8234-5f3d-494a-af07-65d12d1c7845 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.112804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 356/700] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:04.113695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb8234-5f3d-494a-af07-65d12d1c7845 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.130056 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e91bac-6383-4d76-8b77-e7b62c1a9496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:04.131413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e91bac-6383-4d76-8b77-e7b62c1a9496 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.132133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e91bac-6383-4d76-8b77-e7b62c1a9496 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.132602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e91bac-6383-4d76-8b77-e7b62c1a9496 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.146376 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e91bac-6383-4d76-8b77-e7b62c1a9496 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:04.148726 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e91bac-6383-4d76-8b77-e7b62c1a9496 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:04.163546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-36e91bac-6383-4d76-8b77-e7b62c1a9496 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:04.163546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:04.163546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:04.163546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:04.163546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:04.163546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:04.163546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:04.163546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:04.163546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:04.163546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:04.163546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:04.163546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:04.163546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:04.163546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:04.163546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:04.164544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:04.164544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:04.164544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:04.164544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:04.164544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:04.164544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:04.164544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:04.164544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:04.164544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:04.164544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:04.164544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:04.164544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:04.164544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:04.164544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:04.164544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:04.164544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:04.164544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:04.165432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:04.165432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:04.165432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:04.165432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:04.165432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:04.165432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:04.165432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:04.165432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:04.168282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 345/701] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:04.169973 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca43fc-99ec-4d0d-9f87-369c5e45054b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.170682 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca43fc-99ec-4d0d-9f87-369c5e45054b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.171098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca43fc-99ec-4d0d-9f87-369c5e45054b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.195076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-1eca43fc-99ec-4d0d-9f87-369c5e45054b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:04.198056 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1eca43fc-99ec-4d0d-9f87-369c5e45054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:04.230481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb8234-5f3d-494a-af07-65d12d1c7845 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.267626 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e64f1-488b-4eb9-b712-02b652b38287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:04.268225 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e64f1-488b-4eb9-b712-02b652b38287 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.268499 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e64f1-488b-4eb9-b712-02b652b38287 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.268769 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e64f1-488b-4eb9-b712-02b652b38287 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.269408 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e64f1-488b-4eb9-b712-02b652b38287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:04.269707 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e64f1-488b-4eb9-b712-02b652b38287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:04.271106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e64f1-488b-4eb9-b712-02b652b38287 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:04.271820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:04.280394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 346/702] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:20:04.281222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca43fc-99ec-4d0d-9f87-369c5e45054b None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.286201 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 357/703] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:04.287547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e64f1-488b-4eb9-b712-02b652b38287 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.339872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:04.394519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e64f1-488b-4eb9-b712-02b652b38287 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.397751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca43fc-99ec-4d0d-9f87-369c5e45054b None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.430272 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff87d1-97db-42d4-83c1-03d0bfda5c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:04.431393 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff87d1-97db-42d4-83c1-03d0bfda5c10 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.432443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff87d1-97db-42d4-83c1-03d0bfda5c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.432905 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff87d1-97db-42d4-83c1-03d0bfda5c10 None admin] PATH_INFO: `/v3/services/network` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.433675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff87d1-97db-42d4-83c1-03d0bfda5c10 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:04.435271 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff87d1-97db-42d4-83c1-03d0bfda5c10 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:04.435669 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce149a07-3977-4928-9b2f-c8c0fb4804cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:04.436451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce149a07-3977-4928-9b2f-c8c0fb4804cc None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.436727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce149a07-3977-4928-9b2f-c8c0fb4804cc None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.436994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce149a07-3977-4928-9b2f-c8c0fb4804cc None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.437734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce149a07-3977-4928-9b2f-c8c0fb4804cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:04.438040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce149a07-3977-4928-9b2f-c8c0fb4804cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:04.439597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce149a07-3977-4928-9b2f-c8c0fb4804cc None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:04.448564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-06ff87d1-97db-42d4-83c1-03d0bfda5c10 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:04.448564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:04.448564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:04.448564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:04.448564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:04.448564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:04.448564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:04.448564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:04.448564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:04.448564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:04.448564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:04.448564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:04.448564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:04.448564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:04.448564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:04.448564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:04.448564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:04.449579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:04.449579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:04.449579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:04.449579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:04.449579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:04.449579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:04.449579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:04.449579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:04.449579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:04.449579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:04.449579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:04.449579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:04.449579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:04.449579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:04.449579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:04.449579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:04.450427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:04.450427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:04.450427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:04.450427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:04.450427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:04.450427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:04.450427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:04.450427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:04.450427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:04.450427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:04.450427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:04.450427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:04.450427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:04.450427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:04.452373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 347/704] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:04.453526 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce149a07-3977-4928-9b2f-c8c0fb4804cc None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.453731 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 358/705] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:04 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:04.461205 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff87d1-97db-42d4-83c1-03d0bfda5c10 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.514096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:04.562765 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce149a07-3977-4928-9b2f-c8c0fb4804cc None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.563570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff87d1-97db-42d4-83c1-03d0bfda5c10 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.578937 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:04.600842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efc8f3-e799-4542-90d0-d34cc5e21990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:04.601122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b3805-2722-4d24-83ce-4e39e44e39b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:04.601465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efc8f3-e799-4542-90d0-d34cc5e21990 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.601721 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b3805-2722-4d24-83ce-4e39e44e39b0 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.601824 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efc8f3-e799-4542-90d0-d34cc5e21990 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.601998 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b3805-2722-4d24-83ce-4e39e44e39b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.602096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efc8f3-e799-4542-90d0-d34cc5e21990 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.602260 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b3805-2722-4d24-83ce-4e39e44e39b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.603012 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b3805-2722-4d24-83ce-4e39e44e39b0 None admin] RBAC: Adding query filter params (role.id=21a27b57a72246b2ade92d82599c569d, scope.project.id=9527063094354a99a80822107d2740fb, user.id=9f7afa63815643f580c91df4e4c3bafc) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:04.603344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b3805-2722-4d24-83ce-4e39e44e39b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:04.604775 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b3805-2722-4d24-83ce-4e39e44e39b0 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:04.609630 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efc8f3-e799-4542-90d0-d34cc5e21990 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:04.611566 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efc8f3-e799-4542-90d0-d34cc5e21990 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:04.614592 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 359/706] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:04 2022] GET /identity/v3/role_assignments?user.id=9f7afa63815643f580c91df4e4c3bafc&scope.project.id=9527063094354a99a80822107d2740fb&role.id=21a27b57a72246b2ade92d82599c569d => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:04.615454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b3805-2722-4d24-83ce-4e39e44e39b0 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.624115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-e1efc8f3-e799-4542-90d0-d34cc5e21990 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:04.624115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:04.624115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:04.624115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:04.624115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:04.624115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:04.624115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:04.624115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:04.624115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:04.624115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:04.624115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:04.624115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:04.624115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:04.624115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:04.624115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:04.625078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:04.625078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:04.625078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:04.625078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:04.625078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:04.625078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:04.625078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:04.625078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:04.625078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:04.625078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:04.625078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:04.625078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:04.625078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:04.625078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:04.625078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:04.625078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:04.625078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:04.626021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:04.626021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:04.626021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:04.626021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:04.626021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:04.626021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:04.626021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:04.626021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:04.628565 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 348/707] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:04.629593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efc8f3-e799-4542-90d0-d34cc5e21990 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.771213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efc8f3-e799-4542-90d0-d34cc5e21990 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.776730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b3805-2722-4d24-83ce-4e39e44e39b0 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.795380 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:04.820888 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37b291-d882-4775-b828-a8c7639f8e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:04.821788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37b291-d882-4775-b828-a8c7639f8e2c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.822271 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950cf61-c817-4053-9b59-d79207a154df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:04.822412 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37b291-d882-4775-b828-a8c7639f8e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.823423 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37b291-d882-4775-b828-a8c7639f8e2c None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.823542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950cf61-c817-4053-9b59-d79207a154df None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.823542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950cf61-c817-4053-9b59-d79207a154df None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.823542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950cf61-c817-4053-9b59-d79207a154df None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.823865 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37b291-d882-4775-b828-a8c7639f8e2c None admin] RBAC: Adding query filter params (name=network) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:04.824027 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950cf61-c817-4053-9b59-d79207a154df None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:04.824355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37b291-d882-4775-b828-a8c7639f8e2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:04.825389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950cf61-c817-4053-9b59-d79207a154df None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:04.826122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37b291-d882-4775-b828-a8c7639f8e2c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:04.833061 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 360/708] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:04.834132 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37b291-d882-4775-b828-a8c7639f8e2c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.840492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-5950cf61-c817-4053-9b59-d79207a154df None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:04.840492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:04.840492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:04.840492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:04.840492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:04.840492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:04.840492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:04.840492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:04.840492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:04.840492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:04.840492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:04.840492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:04.840492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:04.840492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:04.840492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:04.840492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:04.840492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:04.841580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:04.841580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:04.841580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:04.841580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:04.841580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:04.841580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:04.841580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:04.841580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:04.841580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:04.841580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:04.841580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:04.841580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:04.841580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:04.841580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:04.841580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:04.841580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:04.843182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:04.843182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:04.843182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:04.843182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:04.843182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:04.843182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:04.843182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:04.843182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:04.843182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:04.843182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:04.843182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:04.843182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:04.843182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:04.843182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:04.843182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 349/709] 10.222.0.71 () {56 vars in 1129 bytes} [Thu Sep 1 16:20:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:04.844122 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950cf61-c817-4053-9b59-d79207a154df None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.896060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:04.969114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37b291-d882-4775-b828-a8c7639f8e2c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.985548 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950cf61-c817-4053-9b59-d79207a154df None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:05.005063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822f9a1-2392-4468-9273-0f3ca525f86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:05.005672 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822f9a1-2392-4468-9273-0f3ca525f86d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:05.005948 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822f9a1-2392-4468-9273-0f3ca525f86d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:05.006219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822f9a1-2392-4468-9273-0f3ca525f86d None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:05.006971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822f9a1-2392-4468-9273-0f3ca525f86d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:05.007273 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822f9a1-2392-4468-9273-0f3ca525f86d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:05.008703 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822f9a1-2392-4468-9273-0f3ca525f86d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:05.021574 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 361/710] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:05.022323 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822f9a1-2392-4468-9273-0f3ca525f86d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:05.030638 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d4024-fc65-43b1-9069-83a7fabcd3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:05.032195 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d4024-fc65-43b1-9069-83a7fabcd3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:05.032480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d4024-fc65-43b1-9069-83a7fabcd3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:05.032757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d4024-fc65-43b1-9069-83a7fabcd3a1 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:05.033396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d4024-fc65-43b1-9069-83a7fabcd3a1 None admin] RBAC: Adding query filter params (type=network) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:05.033702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d4024-fc65-43b1-9069-83a7fabcd3a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:05.035109 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d4024-fc65-43b1-9069-83a7fabcd3a1 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:05.044267 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 350/711] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:05.047570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d4024-fc65-43b1-9069-83a7fabcd3a1 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:05.122892 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:05.209698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d4024-fc65-43b1-9069-83a7fabcd3a1 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:05.234563 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822f9a1-2392-4468-9273-0f3ca525f86d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:05.237104 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:05.263547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401b772-e7f3-47e6-b178-eb94037e17f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:05.264245 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401b772-e7f3-47e6-b178-eb94037e17f0 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:05.264594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401b772-e7f3-47e6-b178-eb94037e17f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:05.264942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401b772-e7f3-47e6-b178-eb94037e17f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:05.265678 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401b772-e7f3-47e6-b178-eb94037e17f0 None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.project.id=9527063094354a99a80822107d2740fb, user.id=ed71d63cd24f4a6caf6ebba2c30d3608) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:05.265994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401b772-e7f3-47e6-b178-eb94037e17f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:05.267488 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401b772-e7f3-47e6-b178-eb94037e17f0 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:05.272548 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a96ba1-7ff5-4b99-a73c-6e6f6f9be6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:05.273089 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a96ba1-7ff5-4b99-a73c-6e6f6f9be6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:05.273361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a96ba1-7ff5-4b99-a73c-6e6f6f9be6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:05.273841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a96ba1-7ff5-4b99-a73c-6e6f6f9be6e7 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:05.273953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 351/712] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:05 2022] GET /identity/v3/role_assignments?user.id=ed71d63cd24f4a6caf6ebba2c30d3608&scope.project.id=9527063094354a99a80822107d2740fb&role.id=3cd61239237441418529e9028ef801e4 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:05.274328 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a96ba1-7ff5-4b99-a73c-6e6f6f9be6e7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:05.274779 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a96ba1-7ff5-4b99-a73c-6e6f6f9be6e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:05.275475 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09069a5-df20-43a2-b593-1a85684af459 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:05.275767 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09069a5-df20-43a2-b593-1a85684af459 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:05.276042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09069a5-df20-43a2-b593-1a85684af459 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:05.276209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a96ba1-7ff5-4b99-a73c-6e6f6f9be6e7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:05.277529 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 352/713] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:05.282662 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 362/714] 10.222.0.71 () {56 vars in 1124 bytes} [Thu Sep 1 16:20:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:05.283173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0625a9-8d7e-46a5-9770-4322d4812f6e None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:05.283527 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0625a9-8d7e-46a5-9770-4322d4812f6e None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:05.283869 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0625a9-8d7e-46a5-9770-4322d4812f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:05.288071 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a96ba1-7ff5-4b99-a73c-6e6f6f9be6e7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:05.306746 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-dc0625a9-8d7e-46a5-9770-4322d4812f6e None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:05.307991 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-dc0625a9-8d7e-46a5-9770-4322d4812f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:05.383462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 353/715] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:20:05.416319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a96ba1-7ff5-4b99-a73c-6e6f6f9be6e7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:05.454815 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3388d0-c216-43e4-906e-b2ea2101ead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:05.455439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3388d0-c216-43e4-906e-b2ea2101ead8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:05.455721 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3388d0-c216-43e4-906e-b2ea2101ead8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:05.455998 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3388d0-c216-43e4-906e-b2ea2101ead8 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:05.456639 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3388d0-c216-43e4-906e-b2ea2101ead8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:05.456945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3388d0-c216-43e4-906e-b2ea2101ead8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:05.458324 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3388d0-c216-43e4-906e-b2ea2101ead8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:05.464611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 363/716] 10.222.0.71 () {56 vars in 1124 bytes} [Thu Sep 1 16:20:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:05.710320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0625a9-8d7e-46a5-9770-4322d4812f6e None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:05.755313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:05.824459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0625a9-8d7e-46a5-9770-4322d4812f6e None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:05.865756 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34661ded-4922-4359-a5c8-8c0b879c611b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:05.866400 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34661ded-4922-4359-a5c8-8c0b879c611b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:05.866702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34661ded-4922-4359-a5c8-8c0b879c611b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:05.866974 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34661ded-4922-4359-a5c8-8c0b879c611b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:05.880130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34661ded-4922-4359-a5c8-8c0b879c611b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:05.881515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34661ded-4922-4359-a5c8-8c0b879c611b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:05.901738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-34661ded-4922-4359-a5c8-8c0b879c611b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:05.901738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:05.901738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:05.901738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:05.901738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:05.901738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:05.901738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:05.901738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:05.901738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:05.901738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:05.901738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:05.901738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:05.901738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:05.901738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:05.901738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:05.901738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:05.902814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:05.902814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:05.902814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:05.902814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:05.902814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:05.902814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:05.902814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:05.902814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:05.902814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:05.902814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:05.902814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:05.902814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:05.902814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:05.902814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:05.902814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:05.902814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:05.902814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:05.903751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:05.903751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:05.903751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:05.907312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 354/717] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:05.913140 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3388d0-c216-43e4-906e-b2ea2101ead8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:05.955698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:06.050865 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3388d0-c216-43e4-906e-b2ea2101ead8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:06.096164 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cb701-75ea-44a5-8f78-b6864ca1ffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:06.096776 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cb701-75ea-44a5-8f78-b6864ca1ffcc None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:06.097055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cb701-75ea-44a5-8f78-b6864ca1ffcc None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:06.097324 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cb701-75ea-44a5-8f78-b6864ca1ffcc None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:06.097963 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cb701-75ea-44a5-8f78-b6864ca1ffcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:06.098262 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cb701-75ea-44a5-8f78-b6864ca1ffcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:06.099683 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cb701-75ea-44a5-8f78-b6864ca1ffcc None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:06.117476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 364/718] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:06.123797 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34661ded-4922-4359-a5c8-8c0b879c611b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:06.234639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:06.241385 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34661ded-4922-4359-a5c8-8c0b879c611b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:06.289717 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c420a44-e9a7-472b-9e4e-829e00c9a08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:06.290331 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c420a44-e9a7-472b-9e4e-829e00c9a08e None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:06.290632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c420a44-e9a7-472b-9e4e-829e00c9a08e None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:06.290939 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c420a44-e9a7-472b-9e4e-829e00c9a08e None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:06.291602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c420a44-e9a7-472b-9e4e-829e00c9a08e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:06.293026 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c420a44-e9a7-472b-9e4e-829e00c9a08e None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:06.320829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 355/719] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:20:06 2022] POST /identity/v3/users => generated 254 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:06.955898 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941e712-e72d-4084-9062-d00cc45992de None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:06.956394 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941e712-e72d-4084-9062-d00cc45992de None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:06.956394 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941e712-e72d-4084-9062-d00cc45992de None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:06.957952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 365/720] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:06.963810 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3df753-23d0-4c13-abd3-448d2f77f49b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:06.964098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3df753-23d0-4c13-abd3-448d2f77f49b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:06.964377 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3df753-23d0-4c13-abd3-448d2f77f49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:06.987568 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-7a3df753-23d0-4c13-abd3-448d2f77f49b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:06.988765 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7a3df753-23d0-4c13-abd3-448d2f77f49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:07.069111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 356/721] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:20:07.330803 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda1daa-5127-4c57-b674-085be3abedcc None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:07.331202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda1daa-5127-4c57-b674-085be3abedcc None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:07.331381 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda1daa-5127-4c57-b674-085be3abedcc None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:07.332920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 366/722] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:07.338333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91525c29-518c-4709-a736-b5a6a775fff9 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:07.338811 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91525c29-518c-4709-a736-b5a6a775fff9 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:07.338903 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91525c29-518c-4709-a736-b5a6a775fff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:07.360187 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-91525c29-518c-4709-a736-b5a6a775fff9 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:07.361362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-91525c29-518c-4709-a736-b5a6a775fff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:07.448172 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 357/723] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:20:07.554985 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49668bd0-a376-4f79-8468-e90f91f59a5b None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:07.555314 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49668bd0-a376-4f79-8468-e90f91f59a5b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:07.555525 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49668bd0-a376-4f79-8468-e90f91f59a5b None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:07.557203 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 367/724] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:07.559080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91525c29-518c-4709-a736-b5a6a775fff9 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:07.561625 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b86f5-4f37-49cc-b21f-21a4fada4865 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:07.561900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b86f5-4f37-49cc-b21f-21a4fada4865 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:07.562167 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b86f5-4f37-49cc-b21f-21a4fada4865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:07.576122 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:07.589811 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a15b86f5-4f37-49cc-b21f-21a4fada4865 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:07.590961 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a15b86f5-4f37-49cc-b21f-21a4fada4865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:07.708652 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 368/725] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:20:07.727083 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91525c29-518c-4709-a736-b5a6a775fff9 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:07.777537 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c38ae5-26f5-43d7-8ff3-ce2d65ad1b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:07.778161 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c38ae5-26f5-43d7-8ff3-ce2d65ad1b9e None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:07.778437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c38ae5-26f5-43d7-8ff3-ce2d65ad1b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:07.778730 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c38ae5-26f5-43d7-8ff3-ce2d65ad1b9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:07.790776 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b86f5-4f37-49cc-b21f-21a4fada4865 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:07.795783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c38ae5-26f5-43d7-8ff3-ce2d65ad1b9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:07.800656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-58c38ae5-26f5-43d7-8ff3-ce2d65ad1b9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:07.800656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:07.800656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:07.800656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:07.800656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:07.800656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:07.800656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:07.800656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:07.800656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:07.800656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:07.800656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:07.800656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:07.800656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:07.800656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:07.800656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:07.800656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:07.801754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:07.801754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:07.801754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:07.801754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:07.801754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:07.801754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:07.801754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:07.801754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:07.801754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:07.801754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:07.801754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:07.801754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:07.801754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:07.801754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:07.801754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:07.801754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:07.802658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:07.802658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:07.802658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:07.802658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:07.802658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:07.802658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:07.802658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:07.802658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:07.802658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:07.802658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:07.802658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:07.802658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:07.805980 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 358/726] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:07.808259 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c38ae5-26f5-43d7-8ff3-ce2d65ad1b9e None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:07.832647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:07.931078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:07.965305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b86f5-4f37-49cc-b21f-21a4fada4865 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:07.990722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c38ae5-26f5-43d7-8ff3-ce2d65ad1b9e None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:08.014580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8854af-91ff-41e0-bd6f-0da2d1b66d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:08.015261 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8854af-91ff-41e0-bd6f-0da2d1b66d41 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.015541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8854af-91ff-41e0-bd6f-0da2d1b66d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.015807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8854af-91ff-41e0-bd6f-0da2d1b66d41 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.016464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8854af-91ff-41e0-bd6f-0da2d1b66d41 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:08.017814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8854af-91ff-41e0-bd6f-0da2d1b66d41 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:08.046904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 369/727] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Sep 1 16:20:07 2022] POST /identity/v3/services => generated 240 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:20:08.077805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efd20e-ec3a-4b41-b8db-518fd05f4bc2 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.078122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efd20e-ec3a-4b41-b8db-518fd05f4bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.078351 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efd20e-ec3a-4b41-b8db-518fd05f4bc2 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.080486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 370/728] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:08.083184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f161725-9e6d-4a3e-b718-c475975d9465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:08.083819 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f161725-9e6d-4a3e-b718-c475975d9465 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.084098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f161725-9e6d-4a3e-b718-c475975d9465 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.084373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f161725-9e6d-4a3e-b718-c475975d9465 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.085087 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f161725-9e6d-4a3e-b718-c475975d9465 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:08.085395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f161725-9e6d-4a3e-b718-c475975d9465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:08.086894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f161725-9e6d-4a3e-b718-c475975d9465 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:08.090007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efd20e-ec3a-4b41-b8db-518fd05f4bc2 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:08.100907 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 359/729] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:08.102642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfda225-d95d-48b5-893b-15188a5c9545 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.103221 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfda225-d95d-48b5-893b-15188a5c9545 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.103729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfda225-d95d-48b5-893b-15188a5c9545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.127996 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-dcfda225-d95d-48b5-893b-15188a5c9545 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:08.130061 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-dcfda225-d95d-48b5-893b-15188a5c9545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:08.214036 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:08.227980 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 360/730] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:08 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:20:08.234637 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfda225-d95d-48b5-893b-15188a5c9545 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:08.247517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efd20e-ec3a-4b41-b8db-518fd05f4bc2 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:08.293841 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:08.294056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e45214-a861-4152-bcce-20c5c04aab7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:08.294506 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e45214-a861-4152-bcce-20c5c04aab7f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.294888 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e45214-a861-4152-bcce-20c5c04aab7f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.295201 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e45214-a861-4152-bcce-20c5c04aab7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.310670 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e45214-a861-4152-bcce-20c5c04aab7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:08.316284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-19e45214-a861-4152-bcce-20c5c04aab7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:08.316284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:08.316284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:08.316284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:08.316284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:08.316284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:08.316284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:08.316284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:08.316284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:08.316284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:08.316284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:08.316284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:08.316284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:08.316284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:08.316284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:08.316284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:08.317239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:08.317239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:08.317239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:08.317239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:08.317239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:08.317239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:08.317239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:08.317239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:08.317239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:08.317239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:08.317239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:08.317239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:08.317239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:08.317239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:08.317239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:08.317239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:08.318093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:08.318093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:08.318093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:08.318093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:08.318093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:08.318093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:08.318093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:08.318093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:08.318093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:08.318093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:08.318093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:08.318093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:08.318093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 371/731] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:08.324251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e45214-a861-4152-bcce-20c5c04aab7f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:08.349908 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfda225-d95d-48b5-893b-15188a5c9545 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:08.412271 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c5737-11f5-4a80-8489-4233f2b23e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:08.412912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c5737-11f5-4a80-8489-4233f2b23e54 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.413193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c5737-11f5-4a80-8489-4233f2b23e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.413466 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c5737-11f5-4a80-8489-4233f2b23e54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.436107 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c5737-11f5-4a80-8489-4233f2b23e54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:08.437583 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c5737-11f5-4a80-8489-4233f2b23e54 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:08.468910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-e11c5737-11f5-4a80-8489-4233f2b23e54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:08.468910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:08.468910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:08.468910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:08.468910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:08.468910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:08.468910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:08.468910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:08.468910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:08.468910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:08.468910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:08.468910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:08.468910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:08.468910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:08.468910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:08.468910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:08.471413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:08.471413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:08.471413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:08.471413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:08.471413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:08.471413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:08.471413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:08.471413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:08.471413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:08.471413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:08.471413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:08.471413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:08.471413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:08.471413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:08.471413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:08.471413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:08.471413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:08.473545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:08.473545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:08.473545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:08.473545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 361/732] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:08.479317 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c5737-11f5-4a80-8489-4233f2b23e54 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:08.488984 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e45214-a861-4152-bcce-20c5c04aab7f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:08.549400 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80151a-e723-4889-a698-bfada48dbcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:08.550011 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80151a-e723-4889-a698-bfada48dbcd6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.550292 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80151a-e723-4889-a698-bfada48dbcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.550566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80151a-e723-4889-a698-bfada48dbcd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.551271 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80151a-e723-4889-a698-bfada48dbcd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:08.552021 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80151a-e723-4889-a698-bfada48dbcd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:08.553047 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80151a-e723-4889-a698-bfada48dbcd6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:08.562826 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 372/733] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:08.563614 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80151a-e723-4889-a698-bfada48dbcd6 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:08.570877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:08.651156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c5737-11f5-4a80-8489-4233f2b23e54 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:08.663174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:08.697294 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80151a-e723-4889-a698-bfada48dbcd6 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:08.699269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e5ea7-53c4-41e0-8087-b8281429c336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:08.701006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e5ea7-53c4-41e0-8087-b8281429c336 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.701486 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e5ea7-53c4-41e0-8087-b8281429c336 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.701948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e5ea7-53c4-41e0-8087-b8281429c336 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.702800 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e5ea7-53c4-41e0-8087-b8281429c336 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:08.703299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e5ea7-53c4-41e0-8087-b8281429c336 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:08.704686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e5ea7-53c4-41e0-8087-b8281429c336 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:08.725147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 362/734] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:08.725147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e5ea7-53c4-41e0-8087-b8281429c336 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:08.751288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e5222-dd90-49ab-9d04-e8c23b961d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:08.751894 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e5222-dd90-49ab-9d04-e8c23b961d7a None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.752168 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e5222-dd90-49ab-9d04-e8c23b961d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.752578 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e5222-dd90-49ab-9d04-e8c23b961d7a None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.753229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e5222-dd90-49ab-9d04-e8c23b961d7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:08.754576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e5222-dd90-49ab-9d04-e8c23b961d7a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:08.771846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 373/735] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Sep 1 16:20:08 2022] POST /identity/v3/services => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:08.772740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e5222-dd90-49ab-9d04-e8c23b961d7a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:08.850042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:08.882146 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e5ea7-53c4-41e0-8087-b8281429c336 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:08.928968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fc537-96ed-4c0c-9b1c-ada4cf38e3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:08.929606 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fc537-96ed-4c0c-9b1c-ada4cf38e3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.929885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fc537-96ed-4c0c-9b1c-ada4cf38e3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.930158 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fc537-96ed-4c0c-9b1c-ada4cf38e3d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.942666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fc537-96ed-4c0c-9b1c-ada4cf38e3d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:08.944499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fc537-96ed-4c0c-9b1c-ada4cf38e3d5 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:08.961454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-e88fc537-96ed-4c0c-9b1c-ada4cf38e3d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:08.961454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:08.961454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:08.961454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:08.961454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:08.961454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:08.961454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:08.961454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:08.961454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:08.961454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:08.961454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:08.961454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:08.961454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:08.961454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:08.961454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:08.961454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:08.962516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:08.962516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:08.962516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:08.962516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:08.962516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:08.962516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:08.962516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:08.962516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:08.962516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:08.962516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:08.962516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:08.962516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:08.962516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:08.962516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:08.962516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:08.962516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:08.962516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:08.964078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:08.964078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:08.964078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:08.964078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 363/736] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:08.968033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e5222-dd90-49ab-9d04-e8c23b961d7a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:08.971257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fc537-96ed-4c0c-9b1c-ada4cf38e3d5 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:08.991287 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:09.014988 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d3227-d729-4524-87cd-0d3657513c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:09.015775 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d3227-d729-4524-87cd-0d3657513c01 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:09.016054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d3227-d729-4524-87cd-0d3657513c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:09.017118 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d3227-d729-4524-87cd-0d3657513c01 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:09.026467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d3227-d729-4524-87cd-0d3657513c01 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:09.028344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d3227-d729-4524-87cd-0d3657513c01 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:09.041503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-8e0d3227-d729-4524-87cd-0d3657513c01 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:09.041503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:09.041503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:09.041503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:09.041503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:09.041503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:09.041503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:09.041503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:09.041503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:09.041503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:09.041503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:09.041503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:09.041503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:09.041503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:09.041503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:09.041503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:09.042470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:09.043485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:09.043485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:09.043485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:09.043485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:09.043485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:09.043485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:09.043485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:09.043485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:09.043485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:09.043485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:09.043485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 374/737] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:09.044109 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c1cbb-cecd-4756-9d5e-ebb4e1dbe77f None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:09.044177 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c1cbb-cecd-4756-9d5e-ebb4e1dbe77f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:09.044896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c1cbb-cecd-4756-9d5e-ebb4e1dbe77f None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:09.045927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 375/738] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:09.052626 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c1cbb-cecd-4756-9d5e-ebb4e1dbe77f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:09.096236 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fc537-96ed-4c0c-9b1c-ada4cf38e3d5 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:09.134043 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83db8d-67c7-416b-897a-1f061a27e971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:09.135246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83db8d-67c7-416b-897a-1f061a27e971 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:09.135524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83db8d-67c7-416b-897a-1f061a27e971 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:09.135796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83db8d-67c7-416b-897a-1f061a27e971 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:09.136437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83db8d-67c7-416b-897a-1f061a27e971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:09.136739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83db8d-67c7-416b-897a-1f061a27e971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:09.138213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83db8d-67c7-416b-897a-1f061a27e971 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:09.151435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 364/739] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:09.152692 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a0419-99f6-4c53-bad8-b3880e8464e8 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:09.152976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a0419-99f6-4c53-bad8-b3880e8464e8 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:09.153310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a0419-99f6-4c53-bad8-b3880e8464e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:09.171242 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-2b2a0419-99f6-4c53-bad8-b3880e8464e8 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:09.172437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2b2a0419-99f6-4c53-bad8-b3880e8464e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:09.177896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c1cbb-cecd-4756-9d5e-ebb4e1dbe77f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:09.209588 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:09.223425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a1533-82a0-48e7-9cea-cdcebb85918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:09.224077 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a1533-82a0-48e7-9cea-cdcebb85918b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:09.224359 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a1533-82a0-48e7-9cea-cdcebb85918b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:09.224629 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a1533-82a0-48e7-9cea-cdcebb85918b None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:09.225464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a1533-82a0-48e7-9cea-cdcebb85918b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:09.225772 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a1533-82a0-48e7-9cea-cdcebb85918b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:09.227229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a1533-82a0-48e7-9cea-cdcebb85918b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:09.247265 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 376/740] 10.222.0.71 () {56 vars in 1135 bytes} [Thu Sep 1 16:20:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:09.248105 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a1533-82a0-48e7-9cea-cdcebb85918b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:09.272371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 365/741] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:09.273305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a0419-99f6-4c53-bad8-b3880e8464e8 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:09.277215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:09.396252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a0419-99f6-4c53-bad8-b3880e8464e8 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:09.436376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a1533-82a0-48e7-9cea-cdcebb85918b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:09.472337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2deb57-0d00-4f88-9454-f060bceae0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:09.473337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2deb57-0d00-4f88-9454-f060bceae0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:09.474692 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2deb57-0d00-4f88-9454-f060bceae0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:09.475307 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2deb57-0d00-4f88-9454-f060bceae0a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:09.494330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a1df0-cde9-4091-9556-3e90f8e4471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:09.495201 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a1df0-cde9-4091-9556-3e90f8e4471f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:09.495637 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a1df0-cde9-4091-9556-3e90f8e4471f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:09.496042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a1df0-cde9-4091-9556-3e90f8e4471f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:09.511471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a1df0-cde9-4091-9556-3e90f8e4471f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:09.514098 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a1df0-cde9-4091-9556-3e90f8e4471f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:09.538007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-224a1df0-cde9-4091-9556-3e90f8e4471f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:09.538007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:09.538007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:09.538007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:09.538007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:09.538007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:09.538007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:09.538007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:09.538007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:09.538007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:09.538007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:09.538007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:09.538007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:09.538007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:09.538007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:09.538007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:09.539018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:09.539978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:09.539978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:09.539978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:09.539978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:09.539978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:09.539978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:09.539978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:09.539978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:09.539978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:09.539978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:09.550058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 377/742] 10.222.0.71 () {56 vars in 1093 bytes} [Thu Sep 1 16:20:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:09.553983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a1df0-cde9-4091-9556-3e90f8e4471f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:09.613679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2deb57-0d00-4f88-9454-f060bceae0a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:09.615180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2deb57-0d00-4f88-9454-f060bceae0a7 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:09.618633 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:09.623245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:09.702178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a1df0-cde9-4091-9556-3e90f8e4471f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:09.722496 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 366/743] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:20:09.723675 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2deb57-0d00-4f88-9454-f060bceae0a7 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:09.745434 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441d9fe-8714-45eb-84f2-958722a031da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:09.746468 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441d9fe-8714-45eb-84f2-958722a031da None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:09.746778 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441d9fe-8714-45eb-84f2-958722a031da None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:09.747049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441d9fe-8714-45eb-84f2-958722a031da None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:09.747863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441d9fe-8714-45eb-84f2-958722a031da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:09.748166 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441d9fe-8714-45eb-84f2-958722a031da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:09.750396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441d9fe-8714-45eb-84f2-958722a031da None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:09.773429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 378/744] 10.222.0.71 () {56 vars in 1133 bytes} [Thu Sep 1 16:20:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:09.774201 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441d9fe-8714-45eb-84f2-958722a031da None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:09.857111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2deb57-0d00-4f88-9454-f060bceae0a7 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:09.860473 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:09.891142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:09.897016 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441d9fe-8714-45eb-84f2-958722a031da None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:09.904686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453dd59-463f-4871-9b16-b1f6f62eb87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:09.906405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453dd59-463f-4871-9b16-b1f6f62eb87c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:09.906917 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453dd59-463f-4871-9b16-b1f6f62eb87c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:09.907358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453dd59-463f-4871-9b16-b1f6f62eb87c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:09.922382 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453dd59-463f-4871-9b16-b1f6f62eb87c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:09.927632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-7453dd59-463f-4871-9b16-b1f6f62eb87c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:09.927632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:09.927632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:09.927632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:09.927632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:09.927632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:09.927632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:09.927632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:09.927632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:09.927632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:09.927632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:09.927632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:09.927632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:09.927632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:09.927632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:09.927632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:09.928787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:09.928787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:09.928787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:09.928787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:09.928787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:09.928787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:09.928787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:09.928787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:09.928787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:09.928787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:09.928787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:09.928787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:09.928787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:09.928787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:09.928787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:09.928787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:09.929658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:09.929658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:09.929658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:09.929658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:09.929658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:09.929658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:09.929658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:09.929658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:09.929658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:09.929658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:09.929658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:09.929658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:09.934183 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 367/745] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:09.935081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453dd59-463f-4871-9b16-b1f6f62eb87c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:09.946209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc280ac0-1c29-4307-b5c6-52453b146f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:09.947287 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc280ac0-1c29-4307-b5c6-52453b146f1f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:09.947691 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc280ac0-1c29-4307-b5c6-52453b146f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:09.947973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc280ac0-1c29-4307-b5c6-52453b146f1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:09.961825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc280ac0-1c29-4307-b5c6-52453b146f1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:09.963832 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc280ac0-1c29-4307-b5c6-52453b146f1f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:09.985841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-bc280ac0-1c29-4307-b5c6-52453b146f1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:09.985841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:09.985841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:09.985841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:09.985841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:09.985841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:09.985841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:09.985841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:09.985841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:09.985841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:09.985841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:09.985841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:09.985841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:09.985841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:09.985841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:09.985841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:09.987396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:09.987396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:09.987396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:09.987396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:09.987396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:09.987396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:09.987396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:09.987396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:09.987396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:09.987396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:09.987396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:09.987396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:09.987396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:09.987396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:09.987396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:09.987396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:09.987396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:09.988294 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:09.988294 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:09.988294 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:09.988294 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 379/746] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:09.988294 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc280ac0-1c29-4307-b5c6-52453b146f1f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:10.075553 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453dd59-463f-4871-9b16-b1f6f62eb87c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:10.121069 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687c22f-8a1f-4c36-8284-5da9baca6ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:10.122386 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687c22f-8a1f-4c36-8284-5da9baca6ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.123105 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687c22f-8a1f-4c36-8284-5da9baca6ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.123541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687c22f-8a1f-4c36-8284-5da9baca6ff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.125168 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc280ac0-1c29-4307-b5c6-52453b146f1f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:10.136515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687c22f-8a1f-4c36-8284-5da9baca6ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:10.139126 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687c22f-8a1f-4c36-8284-5da9baca6ff0 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:10.157395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-b687c22f-8a1f-4c36-8284-5da9baca6ff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:10.157395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:10.157395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:10.157395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:10.157395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:10.157395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:10.157395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:10.157395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:10.157395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:10.157395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:10.157395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:10.157395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:10.157395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:10.157395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:10.157395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:10.157395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:10.158451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:10.158451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:10.158451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:10.158451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:10.158451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:10.158451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:10.158451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:10.158451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:10.158451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:10.158451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:10.158451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:10.158451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:10.158451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:10.158451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:10.158451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:10.158451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:10.158451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:10.159500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:10.159500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:10.159500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:10.162874 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 368/747] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:10.163706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687c22f-8a1f-4c36-8284-5da9baca6ff0 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:10.171416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db570e97-df7e-4910-8380-f5a14d1fc2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:10.172305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db570e97-df7e-4910-8380-f5a14d1fc2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.172808 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db570e97-df7e-4910-8380-f5a14d1fc2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.173295 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db570e97-df7e-4910-8380-f5a14d1fc2d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.174164 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db570e97-df7e-4910-8380-f5a14d1fc2d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:10.174718 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db570e97-df7e-4910-8380-f5a14d1fc2d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:10.176403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db570e97-df7e-4910-8380-f5a14d1fc2d7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:10.184825 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:10.186847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 380/748] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:10.187964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db570e97-df7e-4910-8380-f5a14d1fc2d7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:10.210496 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:10.281973 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687c22f-8a1f-4c36-8284-5da9baca6ff0 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:10.302085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db570e97-df7e-4910-8380-f5a14d1fc2d7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:10.317475 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5717db-2551-45ee-805c-d89258f5118c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:10.318118 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5717db-2551-45ee-805c-d89258f5118c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.318439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5717db-2551-45ee-805c-d89258f5118c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.318745 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5717db-2551-45ee-805c-d89258f5118c None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.319614 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5717db-2551-45ee-805c-d89258f5118c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:10.319743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5717db-2551-45ee-805c-d89258f5118c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:10.321058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5717db-2551-45ee-805c-d89258f5118c None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:10.332598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 369/749] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:10.333338 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5717db-2551-45ee-805c-d89258f5118c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:10.344362 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc04e8e-5bec-4a52-a61b-ee4a4a266164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:10.344969 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc04e8e-5bec-4a52-a61b-ee4a4a266164 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.345505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc04e8e-5bec-4a52-a61b-ee4a4a266164 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.345505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc04e8e-5bec-4a52-a61b-ee4a4a266164 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.346143 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc04e8e-5bec-4a52-a61b-ee4a4a266164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:10.346443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc04e8e-5bec-4a52-a61b-ee4a4a266164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:10.347859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc04e8e-5bec-4a52-a61b-ee4a4a266164 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:10.361199 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 381/750] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:10.362393 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fa7cf-68e7-4750-9583-a2a304e2175e None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.362826 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fa7cf-68e7-4750-9583-a2a304e2175e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.363032 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fa7cf-68e7-4750-9583-a2a304e2175e None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.367082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 382/751] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:10.367082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fa7cf-68e7-4750-9583-a2a304e2175e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:10.421024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:10.448966 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5717db-2551-45ee-805c-d89258f5118c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:10.454562 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:10.486116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be802e-7160-443c-91a9-5a96084e7499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:10.486773 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be802e-7160-443c-91a9-5a96084e7499 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.487055 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be802e-7160-443c-91a9-5a96084e7499 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.487324 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be802e-7160-443c-91a9-5a96084e7499 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.488236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fa7cf-68e7-4750-9583-a2a304e2175e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:10.498122 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be802e-7160-443c-91a9-5a96084e7499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:10.499595 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be802e-7160-443c-91a9-5a96084e7499 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:10.514381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-94be802e-7160-443c-91a9-5a96084e7499 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:10.514381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:10.514381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:10.514381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:10.514381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:10.514381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:10.514381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:10.514381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:10.514381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:10.514381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:10.514381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:10.514381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:10.514381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:10.514381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:10.514381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:10.514381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:10.515399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:10.515399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:10.515399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:10.515399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:10.515399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:10.515399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:10.515399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:10.515399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:10.515399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:10.515399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:10.515399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:10.515399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:10.515399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:10.515399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:10.515399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:10.515399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:10.515399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:10.516305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:10.516305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:10.516305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:10.516305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 370/752] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:10.516305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be802e-7160-443c-91a9-5a96084e7499 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:10.529128 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274596a-2144-492b-8689-ab82bf06fc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:10.529753 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274596a-2144-492b-8689-ab82bf06fc45 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.530026 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274596a-2144-492b-8689-ab82bf06fc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.530291 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274596a-2144-492b-8689-ab82bf06fc45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.537802 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274596a-2144-492b-8689-ab82bf06fc45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:10.539282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274596a-2144-492b-8689-ab82bf06fc45 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:10.550458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-0274596a-2144-492b-8689-ab82bf06fc45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:10.550458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:10.550458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:10.550458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:10.550458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:10.550458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:10.550458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:10.550458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:10.550458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:10.550458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:10.550458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:10.550458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:10.550458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:10.550458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:10.550458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:10.551411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:10.551411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:10.551411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:10.551411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:10.551411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:10.551411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:10.551411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:10.551411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:10.551411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:10.551411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:10.551411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:10.551411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:10.551411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:10.551411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:10.551411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:10.551411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:10.551411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:10.552309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:10.552309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:10.552309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:10.552309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:10.552309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:10.552309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:10.552309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:10.552309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:10.552309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 383/753] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:10.553368 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5548c98-8246-49fe-acfe-b9f79c24b111 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.553368 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5548c98-8246-49fe-acfe-b9f79c24b111 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.553368 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5548c98-8246-49fe-acfe-b9f79c24b111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.573039 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-e5548c98-8246-49fe-acfe-b9f79c24b111 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:10.574234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e5548c98-8246-49fe-acfe-b9f79c24b111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:10.635364 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be802e-7160-443c-91a9-5a96084e7499 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:10.658904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 384/754] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:10.659734 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5548c98-8246-49fe-acfe-b9f79c24b111 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:10.665136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:10.674415 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae176724-afc1-4cd8-9e82-8abbce5bfda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:10.675108 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae176724-afc1-4cd8-9e82-8abbce5bfda1 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.675356 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae176724-afc1-4cd8-9e82-8abbce5bfda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.675666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae176724-afc1-4cd8-9e82-8abbce5bfda1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.683390 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae176724-afc1-4cd8-9e82-8abbce5bfda1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:10.684864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae176724-afc1-4cd8-9e82-8abbce5bfda1 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:10.696592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-ae176724-afc1-4cd8-9e82-8abbce5bfda1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:10.696592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:10.696592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:10.696592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:10.696592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:10.696592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:10.696592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:10.696592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:10.696592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:10.696592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:10.696592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:10.696592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:10.696592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:10.696592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:10.696592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:10.697605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:10.697605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:10.697605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:10.697605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:10.697605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:10.697605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:10.697605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:10.697605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:10.697605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:10.697605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:10.697605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:10.697605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:10.697605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:10.697605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:10.697605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:10.697605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:10.697605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:10.698499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:10.698499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:10.698499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:10.698499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:10.698499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:10.698499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:10.698499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:10.698499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:10.702863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 371/755] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:10.703613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae176724-afc1-4cd8-9e82-8abbce5bfda1 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:10.742476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:10.792986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5548c98-8246-49fe-acfe-b9f79c24b111 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:10.813360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae176724-afc1-4cd8-9e82-8abbce5bfda1 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:10.838095 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b597c-fb58-4846-a37b-fc6efc9f2d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:10.839255 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b597c-fb58-4846-a37b-fc6efc9f2d6a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.839536 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b597c-fb58-4846-a37b-fc6efc9f2d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.839805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b597c-fb58-4846-a37b-fc6efc9f2d6a None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.840454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b597c-fb58-4846-a37b-fc6efc9f2d6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:10.840755 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b597c-fb58-4846-a37b-fc6efc9f2d6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:10.842116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b597c-fb58-4846-a37b-fc6efc9f2d6a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:10.858653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 385/756] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:10.858653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b597c-fb58-4846-a37b-fc6efc9f2d6a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:10.859639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af864b3e-696c-431e-8594-0fe693e5029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:10.860255 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af864b3e-696c-431e-8594-0fe693e5029e None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.860529 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af864b3e-696c-431e-8594-0fe693e5029e None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.860796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af864b3e-696c-431e-8594-0fe693e5029e None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.861493 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af864b3e-696c-431e-8594-0fe693e5029e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:10.861798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af864b3e-696c-431e-8594-0fe693e5029e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:10.863286 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af864b3e-696c-431e-8594-0fe693e5029e None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:10.882723 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 372/757] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:10.882723 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af864b3e-696c-431e-8594-0fe693e5029e None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:10.941117 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:10.977059 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b597c-fb58-4846-a37b-fc6efc9f2d6a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:10.992793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af864b3e-696c-431e-8594-0fe693e5029e None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:10.999626 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:11.011893 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe05bd7-cfa0-4af6-83ad-6cccb547a84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.012490 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe05bd7-cfa0-4af6-83ad-6cccb547a84a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.012762 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe05bd7-cfa0-4af6-83ad-6cccb547a84a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.013030 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe05bd7-cfa0-4af6-83ad-6cccb547a84a None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.013718 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe05bd7-cfa0-4af6-83ad-6cccb547a84a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:11.014012 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe05bd7-cfa0-4af6-83ad-6cccb547a84a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:11.015460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe05bd7-cfa0-4af6-83ad-6cccb547a84a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:11.026871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee23673-ee6f-432b-a9f3-d9b689aaa652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.027227 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 386/758] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:11.027499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee23673-ee6f-432b-a9f3-d9b689aaa652 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.027777 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee23673-ee6f-432b-a9f3-d9b689aaa652 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.028012 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe05bd7-cfa0-4af6-83ad-6cccb547a84a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:11.028113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee23673-ee6f-432b-a9f3-d9b689aaa652 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.038833 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee23673-ee6f-432b-a9f3-d9b689aaa652 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:11.040313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee23673-ee6f-432b-a9f3-d9b689aaa652 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:11.051749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-cee23673-ee6f-432b-a9f3-d9b689aaa652 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:11.051749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:11.051749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:11.051749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:11.051749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:11.051749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:11.051749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:11.051749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:11.051749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:11.051749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:11.051749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:11.051749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:11.051749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:11.051749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:11.051749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:11.051749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:11.052783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:11.053727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:11.053727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:11.053727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:11.053727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:11.053727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:11.053727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:11.053727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:11.053727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:11.053727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:11.053727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:11.053727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 373/759] 10.222.0.71 () {56 vars in 1117 bytes} [Thu Sep 1 16:20:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:11.054315 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e53c2-246b-4467-8378-f1f415a69d8c None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.054315 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e53c2-246b-4467-8378-f1f415a69d8c None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.054532 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e53c2-246b-4467-8378-f1f415a69d8c None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.058785 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 374/760] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:11.058785 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e53c2-246b-4467-8378-f1f415a69d8c None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:11.135197 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe05bd7-cfa0-4af6-83ad-6cccb547a84a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:11.156801 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e53c2-246b-4467-8378-f1f415a69d8c None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:11.166210 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:11.169680 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336c66-e182-44f9-8ad8-93dc31463c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.170283 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336c66-e182-44f9-8ad8-93dc31463c07 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.170555 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336c66-e182-44f9-8ad8-93dc31463c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.170854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336c66-e182-44f9-8ad8-93dc31463c07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.171567 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05336c66-e182-44f9-8ad8-93dc31463c07 None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.project.id=9527063094354a99a80822107d2740fb, user.id=9f7afa63815643f580c91df4e4c3bafc) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:11.171869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05336c66-e182-44f9-8ad8-93dc31463c07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:11.173277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05336c66-e182-44f9-8ad8-93dc31463c07 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:11.178461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 387/761] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:11 2022] GET /identity/v3/role_assignments?user.id=9f7afa63815643f580c91df4e4c3bafc&scope.project.id=9527063094354a99a80822107d2740fb&role.id=3cd61239237441418529e9028ef801e4 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:11.179241 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336c66-e182-44f9-8ad8-93dc31463c07 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:11.192599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a344f6-9e3b-4413-978d-bf7178a218a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.193259 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a344f6-9e3b-4413-978d-bf7178a218a7 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.193538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a344f6-9e3b-4413-978d-bf7178a218a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.193811 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a344f6-9e3b-4413-978d-bf7178a218a7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.194421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a344f6-9e3b-4413-978d-bf7178a218a7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:11.195968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a344f6-9e3b-4413-978d-bf7178a218a7 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:11.205668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-d7a344f6-9e3b-4413-978d-bf7178a218a7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:11.205668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:11.205668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:11.205668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:11.205668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:11.205668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:11.205668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:11.205668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:11.205668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:11.205668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:11.205668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:11.205668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:11.205668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:11.205668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:11.205668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:11.205668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:11.205668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:11.207000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:11.207000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:11.207000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:11.207000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:11.207000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:11.207000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:11.207000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:11.207000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:11.207000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:11.207000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:11.207000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:11.207000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:11.207000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:11.207000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:11.207000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:11.207000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:11.208054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:11.208054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:11.208054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:11.208054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:11.208054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:11.208054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:11.208054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:11.208054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:11.208054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:11.208054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:11.208054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:11.208054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:11.208054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:11.208054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:11.211958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 375/762] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:11 2022] GET /identity/v3/services/network => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:11.213040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a344f6-9e3b-4413-978d-bf7178a218a7 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:11.239308 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:11.299588 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336c66-e182-44f9-8ad8-93dc31463c07 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:11.329579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a344f6-9e3b-4413-978d-bf7178a218a7 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:11.338939 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14816a50-bdf4-4987-8cfa-82c4c791e8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.339967 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14816a50-bdf4-4987-8cfa-82c4c791e8fa None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.340248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14816a50-bdf4-4987-8cfa-82c4c791e8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.340521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14816a50-bdf4-4987-8cfa-82c4c791e8fa None admin] PATH_INFO: `/v3/projects/9527063094354a99a80822107d2740fb/users/ed71d63cd24f4a6caf6ebba2c30d3608/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.343065 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14816a50-bdf4-4987-8cfa-82c4c791e8fa None admin] RBAC: Authorizing `identity:create_grant(project_id=9527063094354a99a80822107d2740fb, user_id=ed71d63cd24f4a6caf6ebba2c30d3608, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:11.344489 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14816a50-bdf4-4987-8cfa-82c4c791e8fa None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:11.358352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 388/763] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:20:11 2022] PUT /identity/v3/projects/9527063094354a99a80822107d2740fb/users/ed71d63cd24f4a6caf6ebba2c30d3608/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:20:11.359550 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aca8e-66f2-41a8-bf47-29ba326fd587 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.359836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aca8e-66f2-41a8-bf47-29ba326fd587 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.360106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aca8e-66f2-41a8-bf47-29ba326fd587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.383546 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b66aca8e-66f2-41a8-bf47-29ba326fd587 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:11.385383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b66aca8e-66f2-41a8-bf47-29ba326fd587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:11.389891 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ce71f-8955-4018-a170-ed6ed15d0af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.391002 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ce71f-8955-4018-a170-ed6ed15d0af9 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.391543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ce71f-8955-4018-a170-ed6ed15d0af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.392016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ce71f-8955-4018-a170-ed6ed15d0af9 None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.392986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ce71f-8955-4018-a170-ed6ed15d0af9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:11.393530 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ce71f-8955-4018-a170-ed6ed15d0af9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:11.396027 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ce71f-8955-4018-a170-ed6ed15d0af9 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:11.424871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 376/764] 10.222.0.71 () {56 vars in 1149 bytes} [Thu Sep 1 16:20:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:11.426692 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ce71f-8955-4018-a170-ed6ed15d0af9 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:11.463921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:11.490911 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 389/765] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:11.490911 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aca8e-66f2-41a8-bf47-29ba326fd587 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:11.539346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:11.564837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ce71f-8955-4018-a170-ed6ed15d0af9 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:11.618035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7353222-a94a-4313-befd-cc7d8caae6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.619248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7353222-a94a-4313-befd-cc7d8caae6bc None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.619545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7353222-a94a-4313-befd-cc7d8caae6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.619816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7353222-a94a-4313-befd-cc7d8caae6bc None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.620467 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7353222-a94a-4313-befd-cc7d8caae6bc None admin] RBAC: Adding query filter params (name=network) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:11.620773 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7353222-a94a-4313-befd-cc7d8caae6bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:11.622165 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7353222-a94a-4313-befd-cc7d8caae6bc None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:11.632311 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 377/766] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:11.639069 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aca8e-66f2-41a8-bf47-29ba326fd587 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:11.640523 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7353222-a94a-4313-befd-cc7d8caae6bc None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:11.728309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a379895-9c5a-4784-b8d8-c8ae1e5153b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.728928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a379895-9c5a-4784-b8d8-c8ae1e5153b3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.729205 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a379895-9c5a-4784-b8d8-c8ae1e5153b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.729474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a379895-9c5a-4784-b8d8-c8ae1e5153b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.743119 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:11.750852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7353222-a94a-4313-befd-cc7d8caae6bc None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:11.795552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6350e7d-8b11-496c-8bfa-620d1dc8041a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.796166 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350e7d-8b11-496c-8bfa-620d1dc8041a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.796443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350e7d-8b11-496c-8bfa-620d1dc8041a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.796714 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350e7d-8b11-496c-8bfa-620d1dc8041a None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.797469 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6350e7d-8b11-496c-8bfa-620d1dc8041a None admin] RBAC: Adding query filter params (type=network) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:11.797778 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6350e7d-8b11-496c-8bfa-620d1dc8041a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:11.799185 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6350e7d-8b11-496c-8bfa-620d1dc8041a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:11.804987 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 378/767] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:11.811722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6350e7d-8b11-496c-8bfa-620d1dc8041a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:11.847222 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a379895-9c5a-4784-b8d8-c8ae1e5153b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:11.848704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a379895-9c5a-4784-b8d8-c8ae1e5153b3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:11.887560 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:11.944163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6350e7d-8b11-496c-8bfa-620d1dc8041a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:12.006714 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 390/768] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:20:12.007668 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a379895-9c5a-4784-b8d8-c8ae1e5153b3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.013022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825bbc4-d343-47de-bf35-72d7c572704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:12.013873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825bbc4-d343-47de-bf35-72d7c572704b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:12.014303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825bbc4-d343-47de-bf35-72d7c572704b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:12.014757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825bbc4-d343-47de-bf35-72d7c572704b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:12.015938 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825bbc4-d343-47de-bf35-72d7c572704b None admin] RBAC: Adding query filter params (interface=public, service_id=21ff8dc8ba954d9c87b62562ba000013, region_id=RegionOne) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:12.016610 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825bbc4-d343-47de-bf35-72d7c572704b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:12.018273 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825bbc4-d343-47de-bf35-72d7c572704b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:12.033959 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 379/769] 10.222.0.71 () {56 vars in 1251 bytes} [Thu Sep 1 16:20:11 2022] GET /identity/v3/endpoints?service_id=21ff8dc8ba954d9c87b62562ba000013&interface=public®ion_id=RegionOne => generated 194 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:12.038357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825bbc4-d343-47de-bf35-72d7c572704b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.122786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a379895-9c5a-4784-b8d8-c8ae1e5153b3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:12.162103 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca964012-1b5f-4121-aad0-0512e7e66021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:12.162817 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca964012-1b5f-4121-aad0-0512e7e66021 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:12.165645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca964012-1b5f-4121-aad0-0512e7e66021 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:12.165931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca964012-1b5f-4121-aad0-0512e7e66021 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:12.166556 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca964012-1b5f-4121-aad0-0512e7e66021 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:12.168507 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca964012-1b5f-4121-aad0-0512e7e66021 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:12.171742 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:12.179052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-ca964012-1b5f-4121-aad0-0512e7e66021 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:12.179052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:12.179052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:12.179052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:12.179052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:12.179052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:12.179052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:12.179052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:12.179052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:12.179052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:12.179052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:12.179052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:12.179052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:12.179052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:12.179052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:12.179052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:12.179052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:12.180307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:12.180307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:12.180307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:12.180307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:12.180307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:12.180307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:12.180307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:12.180307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:12.180307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:12.180307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:12.180307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:12.180307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:12.180307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:12.180307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:12.180307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:12.180307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:12.181454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:12.181454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:12.181454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:12.181454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:12.181454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:12.181454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:12.181454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:12.181454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:12.181454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:12.181454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:12.181454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:12.181454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:12.181454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:12.181454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:12.184074 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 391/770] 10.222.0.71 () {56 vars in 1129 bytes} [Thu Sep 1 16:20:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:12.187173 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca964012-1b5f-4121-aad0-0512e7e66021 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.304824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca964012-1b5f-4121-aad0-0512e7e66021 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:12.344969 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0c532-e686-4a0f-ab9f-b30c11aedd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:12.345989 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0c532-e686-4a0f-ab9f-b30c11aedd67 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:12.347225 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0c532-e686-4a0f-ab9f-b30c11aedd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:12.348131 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0c532-e686-4a0f-ab9f-b30c11aedd67 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:12.348759 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0c532-e686-4a0f-ab9f-b30c11aedd67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:12.350529 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0c532-e686-4a0f-ab9f-b30c11aedd67 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:12.357855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 392/771] 10.222.0.71 () {56 vars in 1087 bytes} [Thu Sep 1 16:20:12 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:12.358738 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0c532-e686-4a0f-ab9f-b30c11aedd67 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.360469 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:12.555768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:12.591522 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825bbc4-d343-47de-bf35-72d7c572704b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:12.658489 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0c532-e686-4a0f-ab9f-b30c11aedd67 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:12.671004 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4598247-cf96-4e0f-bce8-64b3fc1eaa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:12.671642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598247-cf96-4e0f-bce8-64b3fc1eaa0f None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:12.671918 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598247-cf96-4e0f-bce8-64b3fc1eaa0f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:12.672186 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598247-cf96-4e0f-bce8-64b3fc1eaa0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:12.683576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4598247-cf96-4e0f-bce8-64b3fc1eaa0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:12.685145 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4598247-cf96-4e0f-bce8-64b3fc1eaa0f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:12.700878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0ab09-3ca0-4937-bb9c-0881266c9144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:12.701524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-a4598247-cf96-4e0f-bce8-64b3fc1eaa0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:12.701524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:12.701524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:12.701524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:12.701524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:12.701524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:12.701524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:12.701524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:12.701524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:12.701524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:12.701524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:12.701524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:12.701524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:12.701524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:12.701524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:12.701524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:12.702482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:12.702482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:12.702482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:12.702482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:12.702482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:12.702482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:12.702482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:12.702482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:12.702482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:12.702482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:12.702482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:12.702482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:12.702482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:12.702482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:12.702482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:12.702482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:12.702482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:12.703972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:12.703972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:12.703972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:12.704623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0ab09-3ca0-4937-bb9c-0881266c9144 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:12.705101 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0ab09-3ca0-4937-bb9c-0881266c9144 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:12.705567 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0ab09-3ca0-4937-bb9c-0881266c9144 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:12.706402 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0ab09-3ca0-4937-bb9c-0881266c9144 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:12.706930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0ab09-3ca0-4937-bb9c-0881266c9144 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:12.708499 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0ab09-3ca0-4937-bb9c-0881266c9144 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:12.708787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 380/772] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 674 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:12.711365 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4598247-cf96-4e0f-bce8-64b3fc1eaa0f None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.714860 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 393/773] 10.222.0.71 () {56 vars in 1124 bytes} [Thu Sep 1 16:20:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:12.720787 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0ab09-3ca0-4937-bb9c-0881266c9144 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.805547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:12.838793 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0ab09-3ca0-4937-bb9c-0881266c9144 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:12.842747 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4598247-cf96-4e0f-bce8-64b3fc1eaa0f None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:12.888890 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f0ac6-c4ea-4cf1-b64f-7b58c4b1b95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:12.889528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f0ac6-c4ea-4cf1-b64f-7b58c4b1b95d None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:12.889803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f0ac6-c4ea-4cf1-b64f-7b58c4b1b95d None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:12.890071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f0ac6-c4ea-4cf1-b64f-7b58c4b1b95d None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:12.890779 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f0ac6-c4ea-4cf1-b64f-7b58c4b1b95d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:12.891083 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f0ac6-c4ea-4cf1-b64f-7b58c4b1b95d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:12.892463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f0ac6-c4ea-4cf1-b64f-7b58c4b1b95d None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:12.906787 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:12.910908 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 381/774] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:12.916937 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f0ac6-c4ea-4cf1-b64f-7b58c4b1b95d None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.924012 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0035c7a-5496-448b-b622-30e7bf756b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:12.924786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0035c7a-5496-448b-b622-30e7bf756b13 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:12.925065 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0035c7a-5496-448b-b622-30e7bf756b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:12.925333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0035c7a-5496-448b-b622-30e7bf756b13 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:12.925975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0035c7a-5496-448b-b622-30e7bf756b13 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:12.926278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0035c7a-5496-448b-b622-30e7bf756b13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:12.927667 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0035c7a-5496-448b-b622-30e7bf756b13 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:12.941751 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 394/775] 10.222.0.71 () {56 vars in 1124 bytes} [Thu Sep 1 16:20:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:12.947789 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0035c7a-5496-448b-b622-30e7bf756b13 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:13.111176 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f0ac6-c4ea-4cf1-b64f-7b58c4b1b95d None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:13.146052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0035c7a-5496-448b-b622-30e7bf756b13 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:13.147404 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea798947-d841-4486-8bb9-299f9756156e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:13.148141 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea798947-d841-4486-8bb9-299f9756156e None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:13.148414 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea798947-d841-4486-8bb9-299f9756156e None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:13.148685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea798947-d841-4486-8bb9-299f9756156e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:13.154914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:13.160542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea798947-d841-4486-8bb9-299f9756156e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:13.162002 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea798947-d841-4486-8bb9-299f9756156e None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:13.190407 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564b81a-47ad-45aa-be18-951bef11e408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:13.191075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564b81a-47ad-45aa-be18-951bef11e408 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:13.191361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564b81a-47ad-45aa-be18-951bef11e408 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:13.191640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564b81a-47ad-45aa-be18-951bef11e408 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:13.191872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-ea798947-d841-4486-8bb9-299f9756156e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:13.191872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:13.191872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:13.191872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:13.191872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:13.191872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:13.191872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:13.191872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:13.191872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:13.191872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:13.191872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:13.191872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:13.191872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:13.191872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:13.191872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:13.192722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:13.192722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:13.192722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:13.192722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:13.192722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:13.192722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:13.192722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:13.192722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:13.192722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:13.192722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:13.192722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:13.192722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:13.192722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:13.192722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:13.192722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:13.192722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:13.192722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:13.194068 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:13.194068 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:13.194068 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:13.194068 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:13.194068 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:13.194068 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:13.194068 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:13.194068 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:13.194503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564b81a-47ad-45aa-be18-951bef11e408 None admin] RBAC: Adding query filter params (interface=public, service_id=f7821afc3d3145e08f965555f113e80e, region_id=RegionOne) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:13.194503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564b81a-47ad-45aa-be18-951bef11e408 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:13.194679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 382/776] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:13.194754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564b81a-47ad-45aa-be18-951bef11e408 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:13.203545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea798947-d841-4486-8bb9-299f9756156e None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:13.213748 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 395/777] 10.222.0.71 () {56 vars in 1251 bytes} [Thu Sep 1 16:20:12 2022] GET /identity/v3/endpoints?service_id=f7821afc3d3145e08f965555f113e80e&interface=public®ion_id=RegionOne => generated 194 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:13.222078 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564b81a-47ad-45aa-be18-951bef11e408 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:13.279530 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:13.323978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564b81a-47ad-45aa-be18-951bef11e408 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:13.391196 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ba187-bf09-4b88-8064-94cda7bf3f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:13.391736 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ba187-bf09-4b88-8064-94cda7bf3f11 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:13.392020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ba187-bf09-4b88-8064-94cda7bf3f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:13.392298 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ba187-bf09-4b88-8064-94cda7bf3f11 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:13.392921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ba187-bf09-4b88-8064-94cda7bf3f11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:13.394307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ba187-bf09-4b88-8064-94cda7bf3f11 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:13.397390 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea798947-d841-4486-8bb9-299f9756156e None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:13.411988 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 396/778] 10.222.0.71 () {56 vars in 1087 bytes} [Thu Sep 1 16:20:13 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:13.413757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff10f8a-6ed9-4376-9175-f0735c2cf391 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:13.414049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff10f8a-6ed9-4376-9175-f0735c2cf391 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:13.414321 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff10f8a-6ed9-4376-9175-f0735c2cf391 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:13.415859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 397/779] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:13.433905 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e053b6-5054-4c2f-93ac-5bc921c49ccf None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:13.434267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e053b6-5054-4c2f-93ac-5bc921c49ccf None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:13.434464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e053b6-5054-4c2f-93ac-5bc921c49ccf None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:13.436146 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 398/780] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:13.437330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe71fd9-d9fc-4c94-b4d9-330368b74ee7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:13.437608 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe71fd9-d9fc-4c94-b4d9-330368b74ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:13.437877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe71fd9-d9fc-4c94-b4d9-330368b74ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:13.445683 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c480fd-731d-4a1d-ba8b-e99cc63d6d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:13.446317 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c480fd-731d-4a1d-ba8b-e99cc63d6d1e None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:13.446602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c480fd-731d-4a1d-ba8b-e99cc63d6d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:13.447416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c480fd-731d-4a1d-ba8b-e99cc63d6d1e None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:13.448136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c480fd-731d-4a1d-ba8b-e99cc63d6d1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:13.448438 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c480fd-731d-4a1d-ba8b-e99cc63d6d1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:13.449891 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c480fd-731d-4a1d-ba8b-e99cc63d6d1e None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:13.464212 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 383/781] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:13.465430 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-abe71fd9-d9fc-4c94-b4d9-330368b74ee7 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:13.465541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83b37d-dd2f-4414-bf48-95448806983d None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:13.465779 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83b37d-dd2f-4414-bf48-95448806983d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:13.466048 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83b37d-dd2f-4414-bf48-95448806983d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:13.470839 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-abe71fd9-d9fc-4c94-b4d9-330368b74ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:13.491652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-7e83b37d-dd2f-4414-bf48-95448806983d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:13.492874 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7e83b37d-dd2f-4414-bf48-95448806983d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:13.547782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:13.558697 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 399/782] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:13.559946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe71fd9-d9fc-4c94-b4d9-330368b74ee7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:13.575559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 384/783] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:13.644189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:13.719061 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe71fd9-d9fc-4c94-b4d9-330368b74ee7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:13.762098 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d644f-410a-4cbf-8d8a-5752e808c947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:13.762721 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d644f-410a-4cbf-8d8a-5752e808c947 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:13.762998 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d644f-410a-4cbf-8d8a-5752e808c947 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:13.763264 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d644f-410a-4cbf-8d8a-5752e808c947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:13.763987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d644f-410a-4cbf-8d8a-5752e808c947 None admin] RBAC: Adding query filter params (role.id=21a27b57a72246b2ade92d82599c569d, scope.project.id=9527063094354a99a80822107d2740fb, user.id=cd0dbb2c140946f69c3f508b4184e998) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:13.764285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d644f-410a-4cbf-8d8a-5752e808c947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:13.765860 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d644f-410a-4cbf-8d8a-5752e808c947 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:13.774250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 400/784] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:13 2022] GET /identity/v3/role_assignments?user.id=cd0dbb2c140946f69c3f508b4184e998&scope.project.id=9527063094354a99a80822107d2740fb&role.id=21a27b57a72246b2ade92d82599c569d => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:13.875711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83b37d-dd2f-4414-bf48-95448806983d None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:13.920930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d644f-410a-4cbf-8d8a-5752e808c947 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:14.003897 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83b37d-dd2f-4414-bf48-95448806983d None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:14.042372 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93cd04-ebb8-4890-9d01-491ca3e02f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:14.043327 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93cd04-ebb8-4890-9d01-491ca3e02f3e None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.043602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93cd04-ebb8-4890-9d01-491ca3e02f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.043867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93cd04-ebb8-4890-9d01-491ca3e02f3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.050780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d644f-410a-4cbf-8d8a-5752e808c947 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:14.059007 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93cd04-ebb8-4890-9d01-491ca3e02f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:14.065992 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:14.066940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-4a93cd04-ebb8-4890-9d01-491ca3e02f3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:14.066940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:14.066940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:14.066940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:14.066940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:14.066940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:14.066940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:14.066940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:14.066940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:14.066940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:14.066940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:14.066940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:14.066940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:14.066940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:14.066940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:14.066940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:14.068138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:14.068138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:14.068138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:14.068138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:14.068138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:14.068138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:14.068138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:14.068138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:14.068138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:14.068138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:14.068138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:14.068138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:14.068138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:14.068138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:14.068138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:14.068138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:14.069039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:14.069039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:14.069039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:14.069039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:14.069039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:14.069039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:14.069039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:14.069039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:14.069039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:14.069039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:14.069039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:14.069039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:14.069039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 385/785] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:14.076609 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93cd04-ebb8-4890-9d01-491ca3e02f3e None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:14.104088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9981ac5-bdf0-41ec-84bc-71424665859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:14.105968 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9981ac5-bdf0-41ec-84bc-71424665859f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.107377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9981ac5-bdf0-41ec-84bc-71424665859f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.107884 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9981ac5-bdf0-41ec-84bc-71424665859f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.127360 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9981ac5-bdf0-41ec-84bc-71424665859f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:14.139090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-d9981ac5-bdf0-41ec-84bc-71424665859f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:14.139090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:14.139090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:14.139090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:14.139090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:14.139090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:14.139090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:14.139090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:14.139090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:14.139090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:14.139090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:14.139090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:14.139090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:14.139090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:14.139090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:14.139090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:14.140099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:14.140099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:14.140099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:14.140099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:14.140099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:14.140099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:14.140099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:14.140099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:14.140099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:14.140099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:14.140099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:14.140099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:14.140099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:14.140099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:14.140099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:14.140099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:14.140938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:14.140938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:14.140938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:14.140938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:14.140938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:14.140938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:14.140938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:14.140938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:14.140938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:14.140938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:14.140938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:14.140938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:14.144874 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 401/786] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:14.151642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9981ac5-bdf0-41ec-84bc-71424665859f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:14.186459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:14.272307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9981ac5-bdf0-41ec-84bc-71424665859f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:14.309235 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a43de-4c83-4c98-88f5-3bf87e5acc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:14.310319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a43de-4c83-4c98-88f5-3bf87e5acc9a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.310829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a43de-4c83-4c98-88f5-3bf87e5acc9a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.311321 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a43de-4c83-4c98-88f5-3bf87e5acc9a None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.312194 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a43de-4c83-4c98-88f5-3bf87e5acc9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:14.312704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a43de-4c83-4c98-88f5-3bf87e5acc9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:14.314329 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a43de-4c83-4c98-88f5-3bf87e5acc9a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:14.323678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 402/787] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:14.328738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93cd04-ebb8-4890-9d01-491ca3e02f3e None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:14.335479 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a43de-4c83-4c98-88f5-3bf87e5acc9a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:14.373273 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c74ad2-5518-44ea-96ae-5fb7a8e22d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:14.373889 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c74ad2-5518-44ea-96ae-5fb7a8e22d87 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.374165 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c74ad2-5518-44ea-96ae-5fb7a8e22d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.374434 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c74ad2-5518-44ea-96ae-5fb7a8e22d87 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.375132 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c74ad2-5518-44ea-96ae-5fb7a8e22d87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:14.375434 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c74ad2-5518-44ea-96ae-5fb7a8e22d87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:14.377114 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c74ad2-5518-44ea-96ae-5fb7a8e22d87 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:14.387910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 386/788] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:14.392769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c74ad2-5518-44ea-96ae-5fb7a8e22d87 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:14.400860 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:14.487000 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a43de-4c83-4c98-88f5-3bf87e5acc9a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:14.564571 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a5d5c-af0f-4bef-a576-4e7a2c26d11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:14.565197 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a5d5c-af0f-4bef-a576-4e7a2c26d11f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.565478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a5d5c-af0f-4bef-a576-4e7a2c26d11f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.565747 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a5d5c-af0f-4bef-a576-4e7a2c26d11f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.569928 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c74ad2-5518-44ea-96ae-5fb7a8e22d87 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:14.582797 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:14.590788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a5d5c-af0f-4bef-a576-4e7a2c26d11f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:14.592559 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a5d5c-af0f-4bef-a576-4e7a2c26d11f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:14.616621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-123a5d5c-af0f-4bef-a576-4e7a2c26d11f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:14.616621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:14.616621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:14.616621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:14.616621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:14.616621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:14.616621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:14.616621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:14.616621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:14.616621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:14.616621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:14.616621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:14.616621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:14.616621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:14.616621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:14.616621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:14.617698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:14.617698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:14.617698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:14.617698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:14.617698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:14.617698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:14.617698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:14.617698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:14.617698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:14.617698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:14.617698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:14.617698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:14.617698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:14.617698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:14.617698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:14.617698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:14.617698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:14.618654 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:14.618654 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:14.618654 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:14.618654 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 403/789] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:14.626597 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a5d5c-af0f-4bef-a576-4e7a2c26d11f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:14.650541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ee48d-d0ed-42c0-9673-01b7710fe9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:14.651210 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ee48d-d0ed-42c0-9673-01b7710fe9ae None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.651486 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ee48d-d0ed-42c0-9673-01b7710fe9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.653303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ee48d-d0ed-42c0-9673-01b7710fe9ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.674178 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ee48d-d0ed-42c0-9673-01b7710fe9ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:14.675652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ee48d-d0ed-42c0-9673-01b7710fe9ae None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:14.702896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-1d6ee48d-d0ed-42c0-9673-01b7710fe9ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:14.702896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:14.702896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:14.702896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:14.702896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:14.702896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:14.702896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:14.702896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:14.702896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:14.702896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:14.702896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:14.702896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:14.702896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:14.702896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:14.702896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:14.702896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:14.703900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:14.703900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:14.703900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:14.703900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:14.703900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:14.703900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:14.703900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:14.703900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:14.703900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:14.703900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:14.703900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:14.703900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:14.703900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:14.703900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:14.703900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:14.703900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:14.703900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:14.704806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:14.704806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:14.704806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:14.704806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 387/790] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:14.713634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ee48d-d0ed-42c0-9673-01b7710fe9ae None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:14.794971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:14.805029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a5d5c-af0f-4bef-a576-4e7a2c26d11f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:14.825700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ee48d-d0ed-42c0-9673-01b7710fe9ae None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:14.841591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605af2e-b985-4f29-8556-08c7c0574782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:14.842204 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605af2e-b985-4f29-8556-08c7c0574782 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.842802 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605af2e-b985-4f29-8556-08c7c0574782 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.843071 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605af2e-b985-4f29-8556-08c7c0574782 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.843724 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605af2e-b985-4f29-8556-08c7c0574782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:14.844041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605af2e-b985-4f29-8556-08c7c0574782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:14.845634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605af2e-b985-4f29-8556-08c7c0574782 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:14.860170 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 404/791] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:14.861499 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2be72-3039-4f6b-b026-b913b571dfb4 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.861785 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2be72-3039-4f6b-b026-b913b571dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.862056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2be72-3039-4f6b-b026-b913b571dfb4 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.870636 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 405/792] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:14.870636 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2be72-3039-4f6b-b026-b913b571dfb4 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:14.870858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a258bb3-f4fe-4e73-8423-d2bf7fdff705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:14.870858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a258bb3-f4fe-4e73-8423-d2bf7fdff705 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.870858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a258bb3-f4fe-4e73-8423-d2bf7fdff705 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.870858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a258bb3-f4fe-4e73-8423-d2bf7fdff705 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.871130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a258bb3-f4fe-4e73-8423-d2bf7fdff705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:14.871130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a258bb3-f4fe-4e73-8423-d2bf7fdff705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:14.872404 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a258bb3-f4fe-4e73-8423-d2bf7fdff705 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:14.886071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 388/793] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:14.887542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c5bad-2692-4276-9ef8-307919f42a5a None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.887830 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c5bad-2692-4276-9ef8-307919f42a5a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.888106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c5bad-2692-4276-9ef8-307919f42a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.911637 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-ac1c5bad-2692-4276-9ef8-307919f42a5a None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:14.912866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ac1c5bad-2692-4276-9ef8-307919f42a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:14.929439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:14.996365 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 389/794] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:14.997366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c5bad-2692-4276-9ef8-307919f42a5a None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:15.109166 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c5bad-2692-4276-9ef8-307919f42a5a None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:15.169075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f576b1a-f7a0-4e97-b39c-746f638091d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:15.169703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f576b1a-f7a0-4e97-b39c-746f638091d5 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:15.169984 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f576b1a-f7a0-4e97-b39c-746f638091d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:15.170254 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f576b1a-f7a0-4e97-b39c-746f638091d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:15.181713 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f576b1a-f7a0-4e97-b39c-746f638091d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:15.183198 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f576b1a-f7a0-4e97-b39c-746f638091d5 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:15.194137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2be72-3039-4f6b-b026-b913b571dfb4 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:15.201972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-5f576b1a-f7a0-4e97-b39c-746f638091d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:15.201972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:15.201972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:15.201972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:15.201972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:15.201972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:15.201972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:15.201972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:15.201972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:15.201972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:15.201972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:15.201972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:15.201972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:15.201972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:15.201972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:15.201972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:15.202963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:15.203902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:15.203902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:15.203902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:15.203902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:15.203902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:15.203902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:15.203902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:15.203902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:15.203902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:15.203902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:15.203902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 390/795] 10.222.0.71 () {56 vars in 1093 bytes} [Thu Sep 1 16:20:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:15.210545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f576b1a-f7a0-4e97-b39c-746f638091d5 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:15.231638 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:15.255247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba6dc0-c179-491b-b400-8c4bb417bb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:15.255877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba6dc0-c179-491b-b400-8c4bb417bb9e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:15.256154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba6dc0-c179-491b-b400-8c4bb417bb9e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:15.256420 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba6dc0-c179-491b-b400-8c4bb417bb9e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:15.274605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba6dc0-c179-491b-b400-8c4bb417bb9e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:15.276613 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba6dc0-c179-491b-b400-8c4bb417bb9e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:15.295572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-61ba6dc0-c179-491b-b400-8c4bb417bb9e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:15.295572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:15.295572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:15.295572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:15.295572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:15.295572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:15.295572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:15.295572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:15.295572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:15.295572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:15.295572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:15.295572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:15.295572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:15.295572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:15.295572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:15.295572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:15.296541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:15.297500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:15.297500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:15.297500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:15.297500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:15.297500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:15.297500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:15.297500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:15.297500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:15.297500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:15.297500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:15.298039 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 406/796] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:15.302684 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba6dc0-c179-491b-b400-8c4bb417bb9e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:15.322937 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:15.376698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f576b1a-f7a0-4e97-b39c-746f638091d5 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:15.422997 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a917d27-c29f-42a1-a74d-cf348c6614f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:15.423754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a917d27-c29f-42a1-a74d-cf348c6614f8 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:15.424036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a917d27-c29f-42a1-a74d-cf348c6614f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:15.424628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a917d27-c29f-42a1-a74d-cf348c6614f8 None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:15.425645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a917d27-c29f-42a1-a74d-cf348c6614f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:15.425948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a917d27-c29f-42a1-a74d-cf348c6614f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:15.428153 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a917d27-c29f-42a1-a74d-cf348c6614f8 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:15.433067 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba6dc0-c179-491b-b400-8c4bb417bb9e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:15.450268 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 391/797] 10.222.0.71 () {56 vars in 1133 bytes} [Thu Sep 1 16:20:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:15.455329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a917d27-c29f-42a1-a74d-cf348c6614f8 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:15.476388 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641b5f8-9190-4edf-880c-65f736888bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:15.477000 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641b5f8-9190-4edf-880c-65f736888bac None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:15.477275 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641b5f8-9190-4edf-880c-65f736888bac None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:15.477543 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641b5f8-9190-4edf-880c-65f736888bac None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:15.478856 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641b5f8-9190-4edf-880c-65f736888bac None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:15.479174 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641b5f8-9190-4edf-880c-65f736888bac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:15.481193 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641b5f8-9190-4edf-880c-65f736888bac None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:15.506700 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 407/798] 10.222.0.71 () {56 vars in 1135 bytes} [Thu Sep 1 16:20:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:15.507916 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641b5f8-9190-4edf-880c-65f736888bac None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:15.530577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:15.569450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a917d27-c29f-42a1-a74d-cf348c6614f8 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:15.597332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:15.615728 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229221d4-ed00-4376-a6fe-624322c3a015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:15.616472 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229221d4-ed00-4376-a6fe-624322c3a015 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:15.617084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229221d4-ed00-4376-a6fe-624322c3a015 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:15.617360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229221d4-ed00-4376-a6fe-624322c3a015 None admin] PATH_INFO: `/v3/services/network` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:15.618256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229221d4-ed00-4376-a6fe-624322c3a015 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:15.623222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229221d4-ed00-4376-a6fe-624322c3a015 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:15.635447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-229221d4-ed00-4376-a6fe-624322c3a015 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:15.635447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:15.635447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:15.635447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:15.635447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:15.635447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:15.635447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:15.635447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:15.635447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:15.635447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:15.635447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:15.635447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:15.635447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:15.635447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:15.635447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:15.635447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:15.635447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:15.636681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:15.636681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:15.636681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:15.636681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:15.636681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:15.636681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:15.636681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:15.636681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:15.636681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:15.636681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:15.636681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:15.636681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:15.636681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:15.636681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:15.636681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:15.636681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:15.637576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:15.637576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:15.637576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:15.637576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:15.637576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:15.637576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:15.637576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:15.637576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:15.637576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:15.637576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:15.637576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:15.637576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:15.637576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:15.637576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:15.638395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 392/799] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:15 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:15.638564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229221d4-ed00-4376-a6fe-624322c3a015 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:15.651882 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641b5f8-9190-4edf-880c-65f736888bac None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:15.688367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90c6c8-a50b-4023-83e8-c905c49eab7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:15.689296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90c6c8-a50b-4023-83e8-c905c49eab7d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:15.689767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90c6c8-a50b-4023-83e8-c905c49eab7d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:15.690176 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90c6c8-a50b-4023-83e8-c905c49eab7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:15.762955 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90c6c8-a50b-4023-83e8-c905c49eab7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:15.764660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90c6c8-a50b-4023-83e8-c905c49eab7d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:15.772755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229221d4-ed00-4376-a6fe-624322c3a015 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:15.810402 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:15.818797 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507b16e-9c8f-4654-a9c1-b27ebd5bc914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:15.819429 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507b16e-9c8f-4654-a9c1-b27ebd5bc914 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:15.819709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507b16e-9c8f-4654-a9c1-b27ebd5bc914 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:15.820003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507b16e-9c8f-4654-a9c1-b27ebd5bc914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:15.834221 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507b16e-9c8f-4654-a9c1-b27ebd5bc914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:15.834518 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:15.835886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507b16e-9c8f-4654-a9c1-b27ebd5bc914 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:15.853816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-f507b16e-9c8f-4654-a9c1-b27ebd5bc914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:15.853816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:15.853816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:15.853816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:15.853816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:15.853816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:15.853816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:15.853816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:15.853816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:15.853816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:15.853816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:15.853816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:15.853816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:15.853816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:15.853816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:15.853816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:15.854864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:15.854864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:15.854864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:15.854864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:15.854864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:15.854864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:15.854864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:15.854864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:15.854864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:15.854864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:15.854864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:15.854864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:15.854864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:15.854864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:15.854864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:15.854864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:15.854864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:15.855764 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:15.855764 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:15.855764 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:15.857980 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 393/800] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:15.859037 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507b16e-9c8f-4654-a9c1-b27ebd5bc914 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:15.886711 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 408/801] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:20:15.887746 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90c6c8-a50b-4023-83e8-c905c49eab7d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:15.969841 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507b16e-9c8f-4654-a9c1-b27ebd5bc914 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:15.990511 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90c6c8-a50b-4023-83e8-c905c49eab7d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.004061 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617f568-5f54-4667-8b88-edb0f2bb15c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.004655 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617f568-5f54-4667-8b88-edb0f2bb15c3 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.004932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617f568-5f54-4667-8b88-edb0f2bb15c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.005206 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617f568-5f54-4667-8b88-edb0f2bb15c3 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.005828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617f568-5f54-4667-8b88-edb0f2bb15c3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:16.006128 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617f568-5f54-4667-8b88-edb0f2bb15c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.007511 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617f568-5f54-4667-8b88-edb0f2bb15c3 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.011860 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 394/802] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:16.012984 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b496f-3ab2-4d3c-a7d9-a9090d38f998 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.013265 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b496f-3ab2-4d3c-a7d9-a9090d38f998 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.013537 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b496f-3ab2-4d3c-a7d9-a9090d38f998 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.014744 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 395/803] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:16.015443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b496f-3ab2-4d3c-a7d9-a9090d38f998 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.028311 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582164e7-e518-4235-9819-af57f94993bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.028908 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582164e7-e518-4235-9819-af57f94993bd None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.029180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582164e7-e518-4235-9819-af57f94993bd None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.029447 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582164e7-e518-4235-9819-af57f94993bd None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.030078 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582164e7-e518-4235-9819-af57f94993bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:16.030372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582164e7-e518-4235-9819-af57f94993bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.031740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582164e7-e518-4235-9819-af57f94993bd None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.043168 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 409/804] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:16.044319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca308e-c1ec-4f40-bfbf-922449dbb66c None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.044600 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca308e-c1ec-4f40-bfbf-922449dbb66c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.044864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca308e-c1ec-4f40-bfbf-922449dbb66c None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.046187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 410/805] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:16.046771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca308e-c1ec-4f40-bfbf-922449dbb66c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.068338 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:16.072757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:16.124132 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b496f-3ab2-4d3c-a7d9-a9090d38f998 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.144764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca308e-c1ec-4f40-bfbf-922449dbb66c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.157371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8a267-ba11-4b82-ae66-5e249b52fa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.157983 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8a267-ba11-4b82-ae66-5e249b52fa94 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.158260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8a267-ba11-4b82-ae66-5e249b52fa94 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.158524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8a267-ba11-4b82-ae66-5e249b52fa94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.169269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8a267-ba11-4b82-ae66-5e249b52fa94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.170760 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8a267-ba11-4b82-ae66-5e249b52fa94 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.177933 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27378f-9276-4bea-bd45-c09021ecd68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.178525 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27378f-9276-4bea-bd45-c09021ecd68e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.178827 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27378f-9276-4bea-bd45-c09021ecd68e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.179095 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27378f-9276-4bea-bd45-c09021ecd68e None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.179718 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27378f-9276-4bea-bd45-c09021ecd68e None admin] RBAC: Adding query filter params (type=network) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:16.180066 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27378f-9276-4bea-bd45-c09021ecd68e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.181404 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27378f-9276-4bea-bd45-c09021ecd68e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.185772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-13f8a267-ba11-4b82-ae66-5e249b52fa94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:16.185772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:16.185772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:16.185772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:16.185772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:16.185772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:16.185772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:16.185772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:16.185772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:16.185772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:16.185772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:16.185772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:16.185772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:16.185772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:16.185772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:16.185772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:16.186970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:16.186970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:16.186970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:16.186970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:16.186970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:16.186970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:16.186970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:16.186970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:16.186970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:16.186970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:16.186970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:16.186970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:16.186970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:16.186970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:16.186970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:16.186970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:16.186970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:16.188080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:16.188080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:16.188080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:16.188288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 411/806] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:16.188288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affc339-9295-4062-8b27-6d8fe7b0062e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.188288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affc339-9295-4062-8b27-6d8fe7b0062e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.188288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affc339-9295-4062-8b27-6d8fe7b0062e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.191701 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 396/807] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:16.192489 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8a267-ba11-4b82-ae66-5e249b52fa94 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.205446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-0affc339-9295-4062-8b27-6d8fe7b0062e None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:16.206666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0affc339-9295-4062-8b27-6d8fe7b0062e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:16.271510 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 412/808] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:16.272715 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de20d0-4526-46b9-b192-b8caf12576ae None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.273002 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de20d0-4526-46b9-b192-b8caf12576ae None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.273269 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de20d0-4526-46b9-b192-b8caf12576ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.285511 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:16.289199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8a267-ba11-4b82-ae66-5e249b52fa94 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.302215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-41de20d0-4526-46b9-b192-b8caf12576ae None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:16.303540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-41de20d0-4526-46b9-b192-b8caf12576ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:16.318407 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:16.326567 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d5d49-9722-4784-b322-b19ace1ccbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.327233 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d5d49-9722-4784-b322-b19ace1ccbac None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.327487 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d5d49-9722-4784-b322-b19ace1ccbac None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.327750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d5d49-9722-4784-b322-b19ace1ccbac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.335033 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d5d49-9722-4784-b322-b19ace1ccbac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.336446 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d5d49-9722-4784-b322-b19ace1ccbac None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.348371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-695d5d49-9722-4784-b322-b19ace1ccbac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:16.348371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:16.348371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:16.348371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:16.348371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:16.348371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:16.348371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:16.348371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:16.348371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:16.348371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:16.348371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:16.348371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:16.348371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:16.348371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:16.348371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:16.349351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:16.349351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:16.349351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:16.349351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:16.349351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:16.349351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:16.349351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:16.349351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:16.349351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:16.349351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:16.349351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:16.349351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:16.349351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:16.349351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:16.349351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:16.349351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:16.349351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:16.350253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:16.350253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:16.350253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:16.350253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:16.350253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:16.350253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:16.350253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:16.350253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:16.350253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 397/809] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:16.350253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d5d49-9722-4784-b322-b19ace1ccbac None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.379340 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 413/810] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:16.380111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de20d0-4526-46b9-b192-b8caf12576ae None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.484429 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d5d49-9722-4784-b322-b19ace1ccbac None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.486491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de20d0-4526-46b9-b192-b8caf12576ae None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.522439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea3a26-6576-4f55-a19e-9b74b54c7afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.523342 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea3a26-6576-4f55-a19e-9b74b54c7afc None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.523721 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea3a26-6576-4f55-a19e-9b74b54c7afc None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.524093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea3a26-6576-4f55-a19e-9b74b54c7afc None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.525423 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea3a26-6576-4f55-a19e-9b74b54c7afc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:16.525783 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea3a26-6576-4f55-a19e-9b74b54c7afc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.527272 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea3a26-6576-4f55-a19e-9b74b54c7afc None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.529425 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb51307-d21f-4a86-bd89-94a6ffec4d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.530739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb51307-d21f-4a86-bd89-94a6ffec4d1a None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.531166 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb51307-d21f-4a86-bd89-94a6ffec4d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.531590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb51307-d21f-4a86-bd89-94a6ffec4d1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.532398 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb51307-d21f-4a86-bd89-94a6ffec4d1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.533889 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb51307-d21f-4a86-bd89-94a6ffec4d1a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.546298 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 414/811] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:16.547892 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea3a26-6576-4f55-a19e-9b74b54c7afc None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.560610 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 398/812] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:20:16 2022] POST /identity/v3/endpoints => generated 337 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:16.561393 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:16.564351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb51307-d21f-4a86-bd89-94a6ffec4d1a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.590607 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:16.681613 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea3a26-6576-4f55-a19e-9b74b54c7afc None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.722482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb51307-d21f-4a86-bd89-94a6ffec4d1a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.725980 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071ca25-1621-4986-88dc-d13f0e0cdd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.726578 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071ca25-1621-4986-88dc-d13f0e0cdd4d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.727956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071ca25-1621-4986-88dc-d13f0e0cdd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.727956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071ca25-1621-4986-88dc-d13f0e0cdd4d None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.727956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071ca25-1621-4986-88dc-d13f0e0cdd4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:16.728189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071ca25-1621-4986-88dc-d13f0e0cdd4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.729507 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071ca25-1621-4986-88dc-d13f0e0cdd4d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.742729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 415/813] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:16.743920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071ca25-1621-4986-88dc-d13f0e0cdd4d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.763647 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e0ca0-0256-417a-9297-ef1f82156de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.764307 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e0ca0-0256-417a-9297-ef1f82156de4 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.764554 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e0ca0-0256-417a-9297-ef1f82156de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.764819 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e0ca0-0256-417a-9297-ef1f82156de4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.765407 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e0ca0-0256-417a-9297-ef1f82156de4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.766799 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e0ca0-0256-417a-9297-ef1f82156de4 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.776282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-525e0ca0-0256-417a-9297-ef1f82156de4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:16.776282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:16.776282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:16.776282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:16.776282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:16.776282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:16.776282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:16.776282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:16.776282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:16.776282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:16.776282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:16.776282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:16.776282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:16.776282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:16.776282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:16.776282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:16.776282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:16.777459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:16.777459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:16.777459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:16.777459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:16.777459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:16.777459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:16.777459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:16.777459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:16.777459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:16.777459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:16.777459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:16.777459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:16.777459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:16.777459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:16.777459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:16.777459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:16.778341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:16.778341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:16.778341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:16.778341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:16.778341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:16.778341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:16.778341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:16.778341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:16.778341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:16.778341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:16.778341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:16.778341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:16.778341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:16.778341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:16.778341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 399/814] 10.222.0.71 () {56 vars in 1129 bytes} [Thu Sep 1 16:20:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:16.779219 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e0ca0-0256-417a-9297-ef1f82156de4 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.825402 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:16.855405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:16.860656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071ca25-1621-4986-88dc-d13f0e0cdd4d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.883541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e0ca0-0256-417a-9297-ef1f82156de4 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.894049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb1099-78cb-480d-88cd-c2c3e94ac8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.894688 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb1099-78cb-480d-88cd-c2c3e94ac8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.894959 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb1099-78cb-480d-88cd-c2c3e94ac8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.895221 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb1099-78cb-480d-88cd-c2c3e94ac8d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.901680 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb1099-78cb-480d-88cd-c2c3e94ac8d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.903164 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb1099-78cb-480d-88cd-c2c3e94ac8d4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.913981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-7ddb1099-78cb-480d-88cd-c2c3e94ac8d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:16.913981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:16.913981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:16.913981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:16.913981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:16.913981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:16.913981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:16.913981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:16.913981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:16.913981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:16.913981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:16.913981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:16.913981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:16.913981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:16.913981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:16.914942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:16.914942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:16.914942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:16.914942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:16.914942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:16.914942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:16.914942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:16.914942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:16.914942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:16.914942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:16.914942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:16.914942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:16.914942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:16.914942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:16.914942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:16.914942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:16.914942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:16.915879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:16.915879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:16.915879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:16.915879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:16.915879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:16.915879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:16.915879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:16.915879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:16.915879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 416/815] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:16.916378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb1099-78cb-480d-88cd-c2c3e94ac8d4 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.918160 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089fe7c-3ffd-4cad-8151-aabe0d08356b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.918836 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089fe7c-3ffd-4cad-8151-aabe0d08356b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.919112 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089fe7c-3ffd-4cad-8151-aabe0d08356b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.919382 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089fe7c-3ffd-4cad-8151-aabe0d08356b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.929456 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089fe7c-3ffd-4cad-8151-aabe0d08356b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:16.935180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-1089fe7c-3ffd-4cad-8151-aabe0d08356b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:16.935180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:16.935180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:16.935180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:16.935180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:16.935180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:16.935180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:16.935180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:16.935180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:16.935180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:16.935180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:16.935180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:16.935180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:16.935180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:16.935180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:16.935180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:16.936241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:16.936241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:16.936241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:16.936241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:16.936241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:16.936241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:16.936241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:16.936241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:16.936241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:16.936241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:16.936241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:16.936241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:16.936241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:16.936241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:16.936241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:16.936241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:16.937090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:16.937090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:16.937090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:16.937090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:16.937090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:16.937090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:16.937090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:16.937090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:16.937090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:16.937090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:16.937090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:16.937090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:16.940937 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 400/816] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:16.941709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089fe7c-3ffd-4cad-8151-aabe0d08356b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:17.020430 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb1099-78cb-480d-88cd-c2c3e94ac8d4 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:17.046778 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089fe7c-3ffd-4cad-8151-aabe0d08356b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:17.055420 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:17.066044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f14f4-d70b-4c3c-ad6e-0cf0c198e437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:17.066723 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f14f4-d70b-4c3c-ad6e-0cf0c198e437 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:17.067002 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f14f4-d70b-4c3c-ad6e-0cf0c198e437 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:17.067274 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f14f4-d70b-4c3c-ad6e-0cf0c198e437 None admin] PATH_INFO: `/v3/projects/9527063094354a99a80822107d2740fb/users/9f7afa63815643f580c91df4e4c3bafc/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:17.069181 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f14f4-d70b-4c3c-ad6e-0cf0c198e437 None admin] RBAC: Authorizing `identity:create_grant(project_id=9527063094354a99a80822107d2740fb, user_id=9f7afa63815643f580c91df4e4c3bafc, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:17.070604 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f14f4-d70b-4c3c-ad6e-0cf0c198e437 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:17.084522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 417/817] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:20:16 2022] PUT /identity/v3/projects/9527063094354a99a80822107d2740fb/users/9f7afa63815643f580c91df4e4c3bafc/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:20:17.085919 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f14f4-d70b-4c3c-ad6e-0cf0c198e437 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:17.090461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ab100-56f3-49d1-a537-1a78d38a7ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:17.091328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ab100-56f3-49d1-a537-1a78d38a7ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:17.091828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ab100-56f3-49d1-a537-1a78d38a7ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:17.092208 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ab100-56f3-49d1-a537-1a78d38a7ce6 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:17.093320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ab100-56f3-49d1-a537-1a78d38a7ce6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:17.093639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ab100-56f3-49d1-a537-1a78d38a7ce6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:17.095735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ab100-56f3-49d1-a537-1a78d38a7ce6 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:17.097760 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:17.109869 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 401/818] 10.222.0.71 () {56 vars in 1124 bytes} [Thu Sep 1 16:20:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:17.111332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ab100-56f3-49d1-a537-1a78d38a7ce6 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:17.213958 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f14f4-d70b-4c3c-ad6e-0cf0c198e437 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:17.237025 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ab100-56f3-49d1-a537-1a78d38a7ce6 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:17.255921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516a4b9-2c46-4947-b350-0ccce5291b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:17.256941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516a4b9-2c46-4947-b350-0ccce5291b15 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:17.257225 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516a4b9-2c46-4947-b350-0ccce5291b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:17.257495 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516a4b9-2c46-4947-b350-0ccce5291b15 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:17.258194 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516a4b9-2c46-4947-b350-0ccce5291b15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:17.258501 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516a4b9-2c46-4947-b350-0ccce5291b15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:17.260663 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516a4b9-2c46-4947-b350-0ccce5291b15 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:17.271239 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4c195-d1d5-429d-a8be-6f16692cce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:17.271779 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4c195-d1d5-429d-a8be-6f16692cce26 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:17.272063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4c195-d1d5-429d-a8be-6f16692cce26 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:17.272348 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4c195-d1d5-429d-a8be-6f16692cce26 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:17.273005 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4c195-d1d5-429d-a8be-6f16692cce26 None admin] RBAC: Adding query filter params (name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:17.273305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4c195-d1d5-429d-a8be-6f16692cce26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:17.278706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4c195-d1d5-429d-a8be-6f16692cce26 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:17.278837 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 418/819] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:17.278837 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516a4b9-2c46-4947-b350-0ccce5291b15 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:17.283860 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 402/820] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:17.286561 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4c195-d1d5-429d-a8be-6f16692cce26 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:17.336116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:17.350788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:17.396545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516a4b9-2c46-4947-b350-0ccce5291b15 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:17.405013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4c195-d1d5-429d-a8be-6f16692cce26 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:17.434398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e5e82-75ee-49e2-9987-8df0d41f5d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:17.435035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e5e82-75ee-49e2-9987-8df0d41f5d39 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:17.435311 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e5e82-75ee-49e2-9987-8df0d41f5d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:17.435572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e5e82-75ee-49e2-9987-8df0d41f5d39 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:17.436198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e5e82-75ee-49e2-9987-8df0d41f5d39 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:17.436498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e5e82-75ee-49e2-9987-8df0d41f5d39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:17.437998 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e5e82-75ee-49e2-9987-8df0d41f5d39 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:17.441051 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f9df0-8fe5-4452-a702-d14fa62e4b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:17.441649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9df0-8fe5-4452-a702-d14fa62e4b52 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:17.441932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9df0-8fe5-4452-a702-d14fa62e4b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:17.442203 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9df0-8fe5-4452-a702-d14fa62e4b52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:17.442958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f9df0-8fe5-4452-a702-d14fa62e4b52 None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.project.id=9527063094354a99a80822107d2740fb, user.id=ed71d63cd24f4a6caf6ebba2c30d3608) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:17.447937 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f9df0-8fe5-4452-a702-d14fa62e4b52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:17.448089 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 419/821] 10.222.0.71 () {56 vars in 1124 bytes} [Thu Sep 1 16:20:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:17.448089 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e5e82-75ee-49e2-9987-8df0d41f5d39 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:17.448259 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f9df0-8fe5-4452-a702-d14fa62e4b52 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:17.458998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 403/822] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:17 2022] GET /identity/v3/role_assignments?user.id=ed71d63cd24f4a6caf6ebba2c30d3608&scope.project.id=9527063094354a99a80822107d2740fb&role.id=3cd61239237441418529e9028ef801e4 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:17.460670 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f9df0-8fe5-4452-a702-d14fa62e4b52 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:17.582329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f9df0-8fe5-4452-a702-d14fa62e4b52 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:17.588767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e5e82-75ee-49e2-9987-8df0d41f5d39 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:17.605213 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:17.623359 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:17.638539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37be594-b71c-4fe3-aca8-d9f216af70f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:17.638923 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a757d-c1da-4791-8645-e152e080ec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:17.639506 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a757d-c1da-4791-8645-e152e080ec49 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:17.639784 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a757d-c1da-4791-8645-e152e080ec49 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:17.640053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a757d-c1da-4791-8645-e152e080ec49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:17.640388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37be594-b71c-4fe3-aca8-d9f216af70f7 None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:17.640878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37be594-b71c-4fe3-aca8-d9f216af70f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:17.641347 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37be594-b71c-4fe3-aca8-d9f216af70f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:17.642287 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37be594-b71c-4fe3-aca8-d9f216af70f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:17.644130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37be594-b71c-4fe3-aca8-d9f216af70f7 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:17.652760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a757d-c1da-4791-8645-e152e080ec49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:17.654192 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a757d-c1da-4791-8645-e152e080ec49 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:17.668477 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 404/823] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:20:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:17.671725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-333a757d-c1da-4791-8645-e152e080ec49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:17.671725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:17.671725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:17.671725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:17.671725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:17.671725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:17.671725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:17.671725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:17.671725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:17.671725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:17.671725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:17.671725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:17.671725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:17.671725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:17.671725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:17.671725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:17.672713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:17.672713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:17.672713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:17.672713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:17.672713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:17.672713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:17.672713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:17.672713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:17.672713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:17.672713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:17.672713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:17.672713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:17.672713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:17.672713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:17.672713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:17.672713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:17.672713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:17.673633 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:17.673633 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:17.673633 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:17.677727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 420/824] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:17.679136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37be594-b71c-4fe3-aca8-d9f216af70f7 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:17.809159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37be594-b71c-4fe3-aca8-d9f216af70f7 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:17.848148 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270b158-4065-453b-bfd0-301e44ca8d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:17.848679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270b158-4065-453b-bfd0-301e44ca8d4b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:17.848970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270b158-4065-453b-bfd0-301e44ca8d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:17.849248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270b158-4065-453b-bfd0-301e44ca8d4b None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:17.849896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270b158-4065-453b-bfd0-301e44ca8d4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:17.850204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270b158-4065-453b-bfd0-301e44ca8d4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:17.851597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270b158-4065-453b-bfd0-301e44ca8d4b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:17.864678 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 405/825] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:17.870477 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a757d-c1da-4791-8645-e152e080ec49 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:17.979828 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a757d-c1da-4791-8645-e152e080ec49 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:18.015875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0309e-f993-4b1b-bea2-15e97b75dfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:18.016868 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0309e-f993-4b1b-bea2-15e97b75dfef None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:18.017384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0309e-f993-4b1b-bea2-15e97b75dfef None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:18.017876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0309e-f993-4b1b-bea2-15e97b75dfef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:18.026718 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0309e-f993-4b1b-bea2-15e97b75dfef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:18.028470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0309e-f993-4b1b-bea2-15e97b75dfef None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:18.040505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-95b0309e-f993-4b1b-bea2-15e97b75dfef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:18.040505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:18.040505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:18.040505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:18.040505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:18.040505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:18.040505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:18.040505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:18.040505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:18.040505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:18.040505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:18.040505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:18.040505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:18.040505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:18.040505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:18.040505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:18.041502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:18.042451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:18.042451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:18.042451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:18.042451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:18.042451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:18.042451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:18.042451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:18.042451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:18.042451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:18.042451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:18.042451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 421/826] 10.222.0.71 () {56 vars in 1117 bytes} [Thu Sep 1 16:20:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:18.047560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270b158-4065-453b-bfd0-301e44ca8d4b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:18.088042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:18.155777 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270b158-4065-453b-bfd0-301e44ca8d4b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:18.193072 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f02d7-b573-4d1a-99b7-fd3126f5395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:18.193827 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f02d7-b573-4d1a-99b7-fd3126f5395f None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:18.194221 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f02d7-b573-4d1a-99b7-fd3126f5395f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:18.194590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f02d7-b573-4d1a-99b7-fd3126f5395f None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:18.195448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f02d7-b573-4d1a-99b7-fd3126f5395f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:18.195854 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f02d7-b573-4d1a-99b7-fd3126f5395f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:18.197469 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f02d7-b573-4d1a-99b7-fd3126f5395f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:18.215715 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 406/827] 10.222.0.71 () {56 vars in 1149 bytes} [Thu Sep 1 16:20:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:18.221547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0309e-f993-4b1b-bea2-15e97b75dfef None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:18.252167 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:18.338887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0309e-f993-4b1b-bea2-15e97b75dfef None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:18.373863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef131271-0c82-4be1-a611-0aa6acbf02f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:18.374488 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef131271-0c82-4be1-a611-0aa6acbf02f4 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:18.374796 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef131271-0c82-4be1-a611-0aa6acbf02f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:18.375065 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef131271-0c82-4be1-a611-0aa6acbf02f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:18.385799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef131271-0c82-4be1-a611-0aa6acbf02f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:18.387262 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef131271-0c82-4be1-a611-0aa6acbf02f4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:18.402025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-ef131271-0c82-4be1-a611-0aa6acbf02f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:18.402025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:18.402025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:18.402025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:18.402025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:18.402025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:18.402025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:18.402025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:18.402025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:18.402025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:18.402025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:18.402025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:18.402025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:18.402025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:18.402025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:18.402025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:18.403017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:18.403017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:18.403017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:18.403017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:18.403017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:18.403017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:18.403017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:18.403017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:18.403017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:18.403017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:18.403017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:18.403017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:18.403017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:18.403017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:18.403017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:18.403017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:18.403017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:18.403922 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:18.403922 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:18.403922 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:18.403922 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 422/828] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:18.408970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f02d7-b573-4d1a-99b7-fd3126f5395f None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:18.512300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f02d7-b573-4d1a-99b7-fd3126f5395f None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:18.514569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:18.546348 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf1563-8754-4db3-b407-08036f264d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:18.546979 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf1563-8754-4db3-b407-08036f264d1a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:18.547256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf1563-8754-4db3-b407-08036f264d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:18.547530 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf1563-8754-4db3-b407-08036f264d1a None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:18.548170 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf1563-8754-4db3-b407-08036f264d1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:18.548473 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf1563-8754-4db3-b407-08036f264d1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:18.549829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf1563-8754-4db3-b407-08036f264d1a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:18.562147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 407/829] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:18.567652 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef131271-0c82-4be1-a611-0aa6acbf02f4 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:18.646401 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:18.673619 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef131271-0c82-4be1-a611-0aa6acbf02f4 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:18.708270 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8920d73-653c-4423-8e9b-697d446d8812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:18.708910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8920d73-653c-4423-8e9b-697d446d8812 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:18.709182 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8920d73-653c-4423-8e9b-697d446d8812 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:18.709447 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8920d73-653c-4423-8e9b-697d446d8812 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:18.718244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8920d73-653c-4423-8e9b-697d446d8812 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:18.719741 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8920d73-653c-4423-8e9b-697d446d8812 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:18.733516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-f8920d73-653c-4423-8e9b-697d446d8812 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:18.733516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:18.733516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:18.733516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:18.733516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:18.733516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:18.733516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:18.733516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:18.733516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:18.733516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:18.733516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:18.733516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:18.733516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:18.733516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:18.733516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:18.735533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:18.735533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:18.735533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:18.735533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:18.735533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:18.735533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:18.735533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:18.735533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:18.735533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:18.735533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:18.735533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:18.735533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:18.735533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:18.735533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:18.735533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:18.735533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:18.735533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:18.736710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:18.736710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:18.736710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:18.736710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:18.736710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:18.736710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:18.736710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:18.736710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:18.738800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 423/830] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:18.740952 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf1563-8754-4db3-b407-08036f264d1a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:18.850462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf1563-8754-4db3-b407-08036f264d1a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:18.885191 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f3148-0949-4df4-b410-866e4cfa3236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:18.885975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f3148-0949-4df4-b410-866e4cfa3236 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:18.886355 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f3148-0949-4df4-b410-866e4cfa3236 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:18.886758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f3148-0949-4df4-b410-866e4cfa3236 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:18.887573 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f3148-0949-4df4-b410-866e4cfa3236 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:18.887982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f3148-0949-4df4-b410-866e4cfa3236 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:18.889555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f3148-0949-4df4-b410-866e4cfa3236 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:18.904034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 408/831] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:18.909908 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8920d73-653c-4423-8e9b-697d446d8812 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:19.012642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8920d73-653c-4423-8e9b-697d446d8812 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:19.047369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8ec81-c008-4c24-8418-7fbd25927ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:19.048263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8ec81-c008-4c24-8418-7fbd25927ff5 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.048706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8ec81-c008-4c24-8418-7fbd25927ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.049343 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8ec81-c008-4c24-8418-7fbd25927ff5 None admin] PATH_INFO: `/v3/projects/9527063094354a99a80822107d2740fb/users/cd0dbb2c140946f69c3f508b4184e998/roles/21a27b57a72246b2ade92d82599c569d` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.052517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:19.066659 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8ec81-c008-4c24-8418-7fbd25927ff5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9527063094354a99a80822107d2740fb, user_id=cd0dbb2c140946f69c3f508b4184e998, role_id=21a27b57a72246b2ade92d82599c569d)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:19.068095 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8ec81-c008-4c24-8418-7fbd25927ff5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:19.074497 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069611b2-6409-4624-b85e-1c877dcf8803 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.075044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069611b2-6409-4624-b85e-1c877dcf8803 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.075044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069611b2-6409-4624-b85e-1c877dcf8803 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.076374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 409/832] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:19.083185 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7313b-dd0a-4c4f-9a24-2212c2e2fe0b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.083621 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7313b-dd0a-4c4f-9a24-2212c2e2fe0b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.083998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7313b-dd0a-4c4f-9a24-2212c2e2fe0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.087226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 424/833] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:20:18 2022] PUT /identity/v3/projects/9527063094354a99a80822107d2740fb/users/cd0dbb2c140946f69c3f508b4184e998/roles/21a27b57a72246b2ade92d82599c569d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:20:19.105024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-04f7313b-dd0a-4c4f-9a24-2212c2e2fe0b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:19.106417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-04f7313b-dd0a-4c4f-9a24-2212c2e2fe0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:19.123031 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:19.194440 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 410/834] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:19.471842 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8ec81-c008-4c24-8418-7fbd25927ff5 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:19.573871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8ec81-c008-4c24-8418-7fbd25927ff5 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:19.608479 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b64bc-811b-4d38-8d1c-13c0db0b4476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:19.609117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b64bc-811b-4d38-8d1c-13c0db0b4476 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.609385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b64bc-811b-4d38-8d1c-13c0db0b4476 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.609647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b64bc-811b-4d38-8d1c-13c0db0b4476 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.616374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978755fc-71e9-402b-9c42-df01524217b0 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.616656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978755fc-71e9-402b-9c42-df01524217b0 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.616923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978755fc-71e9-402b-9c42-df01524217b0 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.622995 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 411/835] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:19.624023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b64bc-811b-4d38-8d1c-13c0db0b4476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:19.624784 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2697-502a-4dc7-8261-f1f386ef3074 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.626644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2697-502a-4dc7-8261-f1f386ef3074 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.626644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2697-502a-4dc7-8261-f1f386ef3074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.629247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-7b7b64bc-811b-4d38-8d1c-13c0db0b4476 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:19.629247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:19.629247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:19.629247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:19.629247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:19.629247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:19.629247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:19.629247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:19.629247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:19.629247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:19.629247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:19.629247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:19.629247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:19.629247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:19.629247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:19.629247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:19.630152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:19.630152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:19.630152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:19.630152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:19.630152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:19.630152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:19.630152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:19.630152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:19.630152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:19.630152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:19.630152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:19.630152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:19.630152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:19.630152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:19.630152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:19.630152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:19.631044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:19.631044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:19.631044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:19.631044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:19.631044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:19.631044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:19.631044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:19.631044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:19.631044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:19.631044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:19.631044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:19.631044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:19.631044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 425/836] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:19.636856 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b64bc-811b-4d38-8d1c-13c0db0b4476 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:19.646478 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-f8bb2697-502a-4dc7-8261-f1f386ef3074 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:19.647987 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f8bb2697-502a-4dc7-8261-f1f386ef3074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:19.715065 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:19.722534 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 412/837] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:19.760090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b64bc-811b-4d38-8d1c-13c0db0b4476 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:19.778863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ffebf-0733-4002-abfd-990222149d92 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.779194 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ffebf-0733-4002-abfd-990222149d92 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.779422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ffebf-0733-4002-abfd-990222149d92 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.781030 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 413/838] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:19.785845 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f9965-9499-44c5-9973-78580f252e74 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.786129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f9965-9499-44c5-9973-78580f252e74 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.786402 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f9965-9499-44c5-9973-78580f252e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.798658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d80f7-6fe9-4dd3-afb6-f6ec111ce789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:19.799581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d80f7-6fe9-4dd3-afb6-f6ec111ce789 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.800200 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d80f7-6fe9-4dd3-afb6-f6ec111ce789 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.800536 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d80f7-6fe9-4dd3-afb6-f6ec111ce789 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.801267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d80f7-6fe9-4dd3-afb6-f6ec111ce789 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:19.801636 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d80f7-6fe9-4dd3-afb6-f6ec111ce789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:19.803111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d80f7-6fe9-4dd3-afb6-f6ec111ce789 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:19.807002 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-f12f9965-9499-44c5-9973-78580f252e74 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:19.808364 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f12f9965-9499-44c5-9973-78580f252e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:19.820970 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 426/839] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:19.823548 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d80f7-6fe9-4dd3-afb6-f6ec111ce789 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:19.897113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 414/840] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:19.928578 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d80f7-6fe9-4dd3-afb6-f6ec111ce789 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:19.936244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:19.963885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39892d3-42cc-47df-8f58-e611ae6ee7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:19.964772 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39892d3-42cc-47df-8f58-e611ae6ee7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.965233 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39892d3-42cc-47df-8f58-e611ae6ee7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.965673 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39892d3-42cc-47df-8f58-e611ae6ee7f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.976537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39892d3-42cc-47df-8f58-e611ae6ee7f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:19.978283 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39892d3-42cc-47df-8f58-e611ae6ee7f2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:19.992960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-f39892d3-42cc-47df-8f58-e611ae6ee7f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:19.992960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:19.992960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:19.992960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:19.992960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:19.992960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:19.992960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:19.992960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:19.992960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:19.992960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:19.992960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:19.992960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:19.992960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:19.992960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:19.992960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:19.992960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:19.994443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:19.994443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:19.994443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:19.994443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:19.994443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:19.994443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:19.994443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:19.994443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:19.994443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:19.994443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:19.994443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:19.994443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:19.994443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:19.994443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:19.994443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:19.994443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:19.994443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:19.995667 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:19.995667 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:19.995667 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:19.997364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 427/841] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:20.002903 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f9965-9499-44c5-9973-78580f252e74 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.007618 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:20.008454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39892d3-42cc-47df-8f58-e611ae6ee7f2 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.120125 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f9965-9499-44c5-9973-78580f252e74 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.135115 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39892d3-42cc-47df-8f58-e611ae6ee7f2 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.155666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e2074-4474-4a24-a877-4ee537dfdd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.156277 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e2074-4474-4a24-a877-4ee537dfdd6f None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.156555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e2074-4474-4a24-a877-4ee537dfdd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.156823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e2074-4474-4a24-a877-4ee537dfdd6f None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.157466 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e2074-4474-4a24-a877-4ee537dfdd6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:20.157765 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e2074-4474-4a24-a877-4ee537dfdd6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.159168 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e2074-4474-4a24-a877-4ee537dfdd6f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:20.170689 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c560ec-28d4-476f-92dd-1e733cf68df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.171322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c560ec-28d4-476f-92dd-1e733cf68df8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.171600 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c560ec-28d4-476f-92dd-1e733cf68df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.171871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c560ec-28d4-476f-92dd-1e733cf68df8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.172134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 415/842] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:20.172459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c560ec-28d4-476f-92dd-1e733cf68df8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.173808 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c560ec-28d4-476f-92dd-1e733cf68df8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:20.178750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e2074-4474-4a24-a877-4ee537dfdd6f None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.184175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-04c560ec-28d4-476f-92dd-1e733cf68df8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:20.184175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:20.184175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:20.184175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:20.184175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:20.184175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:20.184175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:20.184175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:20.184175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:20.184175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:20.184175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:20.184175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:20.184175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:20.184175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:20.184175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:20.184175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:20.185307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:20.185307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:20.185307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:20.185307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:20.185307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:20.185307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:20.185307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:20.185307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:20.185307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:20.185307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:20.185307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:20.185307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:20.185307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:20.185307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:20.185307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:20.185307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:20.185307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:20.186251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:20.186251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:20.186251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:20.186251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:20.186251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:20.186251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:20.186251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:20.186251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:20.186251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:20.186251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:20.186251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:20.186251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:20.186251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:20.186251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:20.186251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 428/843] 10.222.0.71 () {56 vars in 1132 bytes} [Thu Sep 1 16:20:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:20.191525 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c560ec-28d4-476f-92dd-1e733cf68df8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.219391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:20.252272 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:20.294886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e2074-4474-4a24-a877-4ee537dfdd6f None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.298935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c560ec-28d4-476f-92dd-1e733cf68df8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.329292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab3b54-8a4c-4186-87c8-567fcadb9bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.330065 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab3b54-8a4c-4186-87c8-567fcadb9bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.330447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab3b54-8a4c-4186-87c8-567fcadb9bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.330853 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab3b54-8a4c-4186-87c8-567fcadb9bf3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.332001 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d8bb4-bfa5-4899-a578-8f3e3550b8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.332615 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d8bb4-bfa5-4899-a578-8f3e3550b8eb None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.332881 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d8bb4-bfa5-4899-a578-8f3e3550b8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.333150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d8bb4-bfa5-4899-a578-8f3e3550b8eb None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.333770 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d8bb4-bfa5-4899-a578-8f3e3550b8eb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:20.334072 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d8bb4-bfa5-4899-a578-8f3e3550b8eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.335456 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d8bb4-bfa5-4899-a578-8f3e3550b8eb None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:20.341464 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab3b54-8a4c-4186-87c8-567fcadb9bf3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.343748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab3b54-8a4c-4186-87c8-567fcadb9bf3 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:20.347095 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 429/844] 10.222.0.71 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:20.347972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d8bb4-bfa5-4899-a578-8f3e3550b8eb None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.357323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-cdab3b54-8a4c-4186-87c8-567fcadb9bf3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:20.357323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:20.357323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:20.357323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:20.357323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:20.357323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:20.357323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:20.357323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:20.357323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:20.357323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:20.357323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:20.357323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:20.357323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:20.357323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:20.357323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:20.357323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:20.358519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:20.359865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:20.359865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:20.359865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:20.359865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:20.359865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:20.359865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:20.359865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:20.359865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:20.359865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:20.359865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:20.359865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 416/845] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:20.359865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab3b54-8a4c-4186-87c8-567fcadb9bf3 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.443833 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:20.463286 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d8bb4-bfa5-4899-a578-8f3e3550b8eb None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.468056 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab3b54-8a4c-4186-87c8-567fcadb9bf3 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.494796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:20.499294 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8759bf2-9587-4158-8ab2-81978f1f61f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.499949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8759bf2-9587-4158-8ab2-81978f1f61f4 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.500198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8759bf2-9587-4158-8ab2-81978f1f61f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.500470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8759bf2-9587-4158-8ab2-81978f1f61f4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.501055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8759bf2-9587-4158-8ab2-81978f1f61f4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.502468 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8759bf2-9587-4158-8ab2-81978f1f61f4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:20.507424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba42aa7-f11a-41f5-9369-f28fda02d433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.508034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba42aa7-f11a-41f5-9369-f28fda02d433 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.508313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba42aa7-f11a-41f5-9369-f28fda02d433 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.508587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba42aa7-f11a-41f5-9369-f28fda02d433 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.509757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba42aa7-f11a-41f5-9369-f28fda02d433 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:20.510061 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba42aa7-f11a-41f5-9369-f28fda02d433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.511436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba42aa7-f11a-41f5-9369-f28fda02d433 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:20.512277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-f8759bf2-9587-4158-8ab2-81978f1f61f4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:20.512277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:20.512277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:20.512277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:20.512277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:20.512277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:20.512277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:20.512277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:20.512277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:20.512277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:20.512277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:20.512277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:20.512277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:20.512277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:20.512277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:20.512277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:20.512277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:20.513217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:20.513217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:20.513217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:20.513217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:20.513217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:20.513217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:20.513217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:20.513217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:20.513217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:20.513217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:20.513217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:20.513217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:20.513217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:20.513217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:20.513217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:20.513217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:20.514068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:20.514068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:20.514068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:20.514068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:20.514068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:20.514068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:20.514068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:20.514068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:20.514068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:20.514068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:20.514068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:20.514068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:20.514068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:20.514068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:20.514068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 430/846] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:20.514888 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8759bf2-9587-4158-8ab2-81978f1f61f4 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.531597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 417/847] 10.222.0.71 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:20.531597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba42aa7-f11a-41f5-9369-f28fda02d433 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.652941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8759bf2-9587-4158-8ab2-81978f1f61f4 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.667911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba42aa7-f11a-41f5-9369-f28fda02d433 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.697421 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b34016-7035-4fb3-aeb5-438f334e0026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.697660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b34016-7035-4fb3-aeb5-438f334e0026 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.698041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b34016-7035-4fb3-aeb5-438f334e0026 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.698318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b34016-7035-4fb3-aeb5-438f334e0026 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.699298 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b34016-7035-4fb3-aeb5-438f334e0026 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:20.699602 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b34016-7035-4fb3-aeb5-438f334e0026 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.701809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b34016-7035-4fb3-aeb5-438f334e0026 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:20.714786 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf7b09-f14a-4fa3-9959-b52901026acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.715419 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf7b09-f14a-4fa3-9959-b52901026acc None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.715703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf7b09-f14a-4fa3-9959-b52901026acc None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.715975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf7b09-f14a-4fa3-9959-b52901026acc None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.716620 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf7b09-f14a-4fa3-9959-b52901026acc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:20.716926 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf7b09-f14a-4fa3-9959-b52901026acc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.718567 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf7b09-f14a-4fa3-9959-b52901026acc None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:20.729686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 431/848] 10.222.0.71 () {56 vars in 1135 bytes} [Thu Sep 1 16:20:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:20.729852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 418/849] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:20.731624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b34016-7035-4fb3-aeb5-438f334e0026 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.731735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf7b09-f14a-4fa3-9959-b52901026acc None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.748212 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:20.792325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:20.847111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf7b09-f14a-4fa3-9959-b52901026acc None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.872770 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b34016-7035-4fb3-aeb5-438f334e0026 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.894239 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b9436-5da7-4a3e-bb0e-c702061d064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.895542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b9436-5da7-4a3e-bb0e-c702061d064b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.896244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b9436-5da7-4a3e-bb0e-c702061d064b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.896665 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b9436-5da7-4a3e-bb0e-c702061d064b None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.897593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b9436-5da7-4a3e-bb0e-c702061d064b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:20.898139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b9436-5da7-4a3e-bb0e-c702061d064b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.900393 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b9436-5da7-4a3e-bb0e-c702061d064b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:20.906932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 419/850] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:20.916954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086da4a-727a-4db6-bccf-cbd029b83969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.917965 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086da4a-727a-4db6-bccf-cbd029b83969 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.918472 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086da4a-727a-4db6-bccf-cbd029b83969 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.918989 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086da4a-727a-4db6-bccf-cbd029b83969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.998487 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086da4a-727a-4db6-bccf-cbd029b83969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:21.000372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086da4a-727a-4db6-bccf-cbd029b83969 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:21.013774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:21.082117 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f95be-b05c-4535-ae7f-564af1246d36 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:21.082425 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f95be-b05c-4535-ae7f-564af1246d36 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:21.082594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f95be-b05c-4535-ae7f-564af1246d36 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:21.084201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 420/851] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:21.089152 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41403773-5f84-406b-a2ed-17efe1b65837 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:21.089437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41403773-5f84-406b-a2ed-17efe1b65837 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:21.089711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41403773-5f84-406b-a2ed-17efe1b65837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:21.112137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-41403773-5f84-406b-a2ed-17efe1b65837 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:21.113315 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-41403773-5f84-406b-a2ed-17efe1b65837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:21.122320 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 432/852] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:20:21.127995 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086da4a-727a-4db6-bccf-cbd029b83969 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.193862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 421/853] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:21.245053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086da4a-727a-4db6-bccf-cbd029b83969 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:21.259242 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:21.286414 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699d6e7-b701-4977-87bc-9cff356a8923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:21.287110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699d6e7-b701-4977-87bc-9cff356a8923 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:21.287385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699d6e7-b701-4977-87bc-9cff356a8923 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:21.287653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699d6e7-b701-4977-87bc-9cff356a8923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:21.298673 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699d6e7-b701-4977-87bc-9cff356a8923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:21.300160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699d6e7-b701-4977-87bc-9cff356a8923 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:21.315097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-9699d6e7-b701-4977-87bc-9cff356a8923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:21.315097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:21.315097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:21.315097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:21.315097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:21.315097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:21.315097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:21.315097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:21.315097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:21.315097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:21.315097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:21.315097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:21.315097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:21.315097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:21.315097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:21.315097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:21.316050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:21.316050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:21.316050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:21.316050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:21.316050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:21.316050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:21.316050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:21.316050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:21.316050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:21.316050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:21.316050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:21.316050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:21.316050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:21.316050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:21.316050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:21.316050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:21.316050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:21.317542 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:21.317542 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:21.317542 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:21.317542 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 433/854] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:21.321836 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41403773-5f84-406b-a2ed-17efe1b65837 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.368582 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:21.422989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41403773-5f84-406b-a2ed-17efe1b65837 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:21.460562 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de11e0-a20c-4695-9492-20946f38e601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:21.461163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de11e0-a20c-4695-9492-20946f38e601 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:21.461443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de11e0-a20c-4695-9492-20946f38e601 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:21.461714 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de11e0-a20c-4695-9492-20946f38e601 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:21.462922 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de11e0-a20c-4695-9492-20946f38e601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:21.463227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de11e0-a20c-4695-9492-20946f38e601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:21.464589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de11e0-a20c-4695-9492-20946f38e601 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:21.477144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 422/855] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:21.483692 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699d6e7-b701-4977-87bc-9cff356a8923 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.505985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de11e0-a20c-4695-9492-20946f38e601 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.609652 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699d6e7-b701-4977-87bc-9cff356a8923 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:21.632417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de11e0-a20c-4695-9492-20946f38e601 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:21.641264 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:21.655496 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5b600-c254-499b-b777-e9ecf713bf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:21.656141 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5b600-c254-499b-b777-e9ecf713bf0c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:21.656417 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5b600-c254-499b-b777-e9ecf713bf0c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:21.656686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5b600-c254-499b-b777-e9ecf713bf0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:21.667396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5b600-c254-499b-b777-e9ecf713bf0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:21.669158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5b600-c254-499b-b777-e9ecf713bf0c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:21.675776 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d578698-7109-4d05-85eb-8d21c78ce80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:21.676690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578698-7109-4d05-85eb-8d21c78ce80a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:21.677204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578698-7109-4d05-85eb-8d21c78ce80a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:21.677727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578698-7109-4d05-85eb-8d21c78ce80a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:21.683183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-34f5b600-c254-499b-b777-e9ecf713bf0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:21.683183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:21.683183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:21.683183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:21.683183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:21.683183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:21.683183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:21.683183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:21.683183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:21.683183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:21.683183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:21.683183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:21.683183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:21.683183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:21.683183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:21.684056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:21.684056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:21.684056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:21.684056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:21.684056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:21.684056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:21.684056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:21.684056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:21.684056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:21.684056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:21.684056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:21.684056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:21.684056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:21.684056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:21.684056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:21.684056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:21.684056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:21.684943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:21.684943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:21.684943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:21.684943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:21.684943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:21.684943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:21.684943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:21.684943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:21.689414 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 434/856] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:21.690694 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5b600-c254-499b-b777-e9ecf713bf0c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.693498 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d578698-7109-4d05-85eb-8d21c78ce80a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:21.699750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-2d578698-7109-4d05-85eb-8d21c78ce80a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:21.699750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:21.699750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:21.699750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:21.699750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:21.699750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:21.699750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:21.699750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:21.699750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:21.699750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:21.699750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:21.699750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:21.699750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:21.699750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:21.699750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:21.699750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:21.700709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:21.700709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:21.700709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:21.700709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:21.700709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:21.700709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:21.700709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:21.700709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:21.700709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:21.700709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:21.700709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:21.700709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:21.700709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:21.700709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:21.700709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:21.700709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:21.701539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:21.701539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:21.701539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:21.701539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:21.701539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:21.701539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:21.701539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:21.701539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:21.701539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:21.701539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:21.701539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:21.701539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:21.704373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 423/857] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:21.709873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d578698-7109-4d05-85eb-8d21c78ce80a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.721100 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:21.803439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5b600-c254-499b-b777-e9ecf713bf0c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:21.840173 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e590174-c25b-4d26-9912-1cb35a227746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:21.840862 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e590174-c25b-4d26-9912-1cb35a227746 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:21.841233 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e590174-c25b-4d26-9912-1cb35a227746 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:21.841596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e590174-c25b-4d26-9912-1cb35a227746 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:21.842641 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e590174-c25b-4d26-9912-1cb35a227746 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:21.843051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e590174-c25b-4d26-9912-1cb35a227746 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:21.844549 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e590174-c25b-4d26-9912-1cb35a227746 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:21.850124 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d578698-7109-4d05-85eb-8d21c78ce80a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:21.862522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 435/858] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:21.863796 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e590174-c25b-4d26-9912-1cb35a227746 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.892816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6576f50-1052-4c4b-942e-95292d309a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:21.893346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6576f50-1052-4c4b-942e-95292d309a8c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:21.893623 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6576f50-1052-4c4b-942e-95292d309a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:21.893887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6576f50-1052-4c4b-942e-95292d309a8c None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:21.894539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6576f50-1052-4c4b-942e-95292d309a8c None admin] RBAC: Adding query filter params (name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:21.894918 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6576f50-1052-4c4b-942e-95292d309a8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:21.896256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6576f50-1052-4c4b-942e-95292d309a8c None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:21.910537 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 424/859] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:21.911497 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6576f50-1052-4c4b-942e-95292d309a8c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.943535 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:21.963606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:21.986461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e590174-c25b-4d26-9912-1cb35a227746 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:22.026890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc9619-c445-4c2f-b98f-cc17a80b6611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:22.027918 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9619-c445-4c2f-b98f-cc17a80b6611 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:22.028396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9619-c445-4c2f-b98f-cc17a80b6611 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:22.028865 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9619-c445-4c2f-b98f-cc17a80b6611 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:22.029901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc9619-c445-4c2f-b98f-cc17a80b6611 None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.project.id=9527063094354a99a80822107d2740fb, user.id=9f7afa63815643f580c91df4e4c3bafc) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:22.030479 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc9619-c445-4c2f-b98f-cc17a80b6611 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:22.032146 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc9619-c445-4c2f-b98f-cc17a80b6611 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:22.037107 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6576f50-1052-4c4b-942e-95292d309a8c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:22.047005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 436/860] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:21 2022] GET /identity/v3/role_assignments?user.id=9f7afa63815643f580c91df4e4c3bafc&scope.project.id=9527063094354a99a80822107d2740fb&role.id=3cd61239237441418529e9028ef801e4 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:22.078134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8ac61-178d-4c66-8c4d-836d4ae3cbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:22.078857 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8ac61-178d-4c66-8c4d-836d4ae3cbaa None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:22.079137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8ac61-178d-4c66-8c4d-836d4ae3cbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:22.079410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8ac61-178d-4c66-8c4d-836d4ae3cbaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:22.091630 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8ac61-178d-4c66-8c4d-836d4ae3cbaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:22.093431 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8ac61-178d-4c66-8c4d-836d4ae3cbaa None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:22.109725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-89e8ac61-178d-4c66-8c4d-836d4ae3cbaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:22.109725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:22.109725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:22.109725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:22.109725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:22.109725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:22.109725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:22.109725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:22.109725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:22.109725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:22.109725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:22.109725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:22.109725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:22.109725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:22.109725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:22.109725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:22.110862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:22.110862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:22.110862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:22.110862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:22.110862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:22.110862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:22.110862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:22.110862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:22.110862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:22.110862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:22.110862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:22.110862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:22.110862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:22.110862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:22.110862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:22.110862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:22.110862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:22.111934 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:22.111934 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:22.111934 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:22.111934 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 425/861] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:22.116804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc9619-c445-4c2f-b98f-cc17a80b6611 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:22.232122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc9619-c445-4c2f-b98f-cc17a80b6611 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:22.269412 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e8b97-b152-42b2-baa9-6cc2d12d990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:22.270374 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e8b97-b152-42b2-baa9-6cc2d12d990d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:22.270883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e8b97-b152-42b2-baa9-6cc2d12d990d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:22.271352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e8b97-b152-42b2-baa9-6cc2d12d990d None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:22.272215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e8b97-b152-42b2-baa9-6cc2d12d990d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:22.272724 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e8b97-b152-42b2-baa9-6cc2d12d990d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:22.274321 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e8b97-b152-42b2-baa9-6cc2d12d990d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:22.287279 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 437/862] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:22.294297 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8ac61-178d-4c66-8c4d-836d4ae3cbaa None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:22.379628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:22.400575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8ac61-178d-4c66-8c4d-836d4ae3cbaa None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:22.435782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3720c-fe6e-401f-a7b1-5e2525049535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:22.436420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3720c-fe6e-401f-a7b1-5e2525049535 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:22.436693 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3720c-fe6e-401f-a7b1-5e2525049535 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:22.436960 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3720c-fe6e-401f-a7b1-5e2525049535 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:22.444816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3720c-fe6e-401f-a7b1-5e2525049535 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:22.446385 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3720c-fe6e-401f-a7b1-5e2525049535 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:22.458078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-39e3720c-fe6e-401f-a7b1-5e2525049535 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:22.458078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:22.458078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:22.458078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:22.458078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:22.458078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:22.458078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:22.458078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:22.458078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:22.458078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:22.458078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:22.458078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:22.458078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:22.458078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:22.458078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:22.458078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:22.459092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:22.460029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:22.460029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:22.460029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:22.460029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:22.460029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:22.460029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:22.460029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:22.460029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:22.460029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:22.460029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:22.460029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 426/863] 10.222.0.71 () {56 vars in 1117 bytes} [Thu Sep 1 16:20:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:22.467976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e8b97-b152-42b2-baa9-6cc2d12d990d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:22.471985 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:22.516160 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3050f-7d72-4c1c-9d4a-8213e62b4b38 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:22.516711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3050f-7d72-4c1c-9d4a-8213e62b4b38 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:22.517160 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3050f-7d72-4c1c-9d4a-8213e62b4b38 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:22.519042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 427/864] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:22.527258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ba291-21ec-4d03-a1ae-d342d4749f1a None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:22.527542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ba291-21ec-4d03-a1ae-d342d4749f1a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:22.527818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ba291-21ec-4d03-a1ae-d342d4749f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:22.547142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-377ba291-21ec-4d03-a1ae-d342d4749f1a None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:22.548346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-377ba291-21ec-4d03-a1ae-d342d4749f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:22.582401 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e8b97-b152-42b2-baa9-6cc2d12d990d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:22.630130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25913a50-43d0-4d61-9310-301f2c43668e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:22.631430 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25913a50-43d0-4d61-9310-301f2c43668e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:22.631942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25913a50-43d0-4d61-9310-301f2c43668e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:22.632524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25913a50-43d0-4d61-9310-301f2c43668e None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:22.633438 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25913a50-43d0-4d61-9310-301f2c43668e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:22.634450 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25913a50-43d0-4d61-9310-301f2c43668e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:22.636090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25913a50-43d0-4d61-9310-301f2c43668e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:22.638739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 428/865] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:22.660116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 438/866] 10.222.0.71 () {56 vars in 1149 bytes} [Thu Sep 1 16:20:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:22.666049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ba291-21ec-4d03-a1ae-d342d4749f1a None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:22.737986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:22.770628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ba291-21ec-4d03-a1ae-d342d4749f1a None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:22.806372 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f9b5c-d36f-4302-9791-dc3b6679c8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:22.807050 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f9b5c-d36f-4302-9791-dc3b6679c8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:22.807367 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f9b5c-d36f-4302-9791-dc3b6679c8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:22.807685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f9b5c-d36f-4302-9791-dc3b6679c8c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:22.882586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f9b5c-d36f-4302-9791-dc3b6679c8c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:22.884692 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f9b5c-d36f-4302-9791-dc3b6679c8c1 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:22.922625 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25913a50-43d0-4d61-9310-301f2c43668e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:22.959703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:22.990209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:22.995589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 429/867] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:22 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:20:22.996873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeb208-cd3d-4c88-8778-58a21666704d None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:22.997165 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeb208-cd3d-4c88-8778-58a21666704d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:22.997443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeb208-cd3d-4c88-8778-58a21666704d None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:22.998835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 430/868] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:23.000643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aeb208-cd3d-4c88-8778-58a21666704d None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:23.039591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25913a50-43d0-4d61-9310-301f2c43668e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:23.075193 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beb00c-7cce-4ddf-99ee-efa3ce74e52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:23.075798 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beb00c-7cce-4ddf-99ee-efa3ce74e52a None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.076077 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beb00c-7cce-4ddf-99ee-efa3ce74e52a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.076342 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beb00c-7cce-4ddf-99ee-efa3ce74e52a None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.077004 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0beb00c-7cce-4ddf-99ee-efa3ce74e52a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:23.078790 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0beb00c-7cce-4ddf-99ee-efa3ce74e52a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:23.094455 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 439/869] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Sep 1 16:20:22 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:23.105411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a780590-92bf-4cab-abc1-2644461129df None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.106695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a780590-92bf-4cab-abc1-2644461129df None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.107582 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a780590-92bf-4cab-abc1-2644461129df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.121033 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aeb208-cd3d-4c88-8778-58a21666704d None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:23.136153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4a780590-92bf-4cab-abc1-2644461129df None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:23.138751 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4a780590-92bf-4cab-abc1-2644461129df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:23.161426 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d30e5-349e-4a08-b106-9dc1f04252ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:23.162055 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d30e5-349e-4a08-b106-9dc1f04252ee None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.162329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d30e5-349e-4a08-b106-9dc1f04252ee None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.162598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d30e5-349e-4a08-b106-9dc1f04252ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.175001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d30e5-349e-4a08-b106-9dc1f04252ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:23.176432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d30e5-349e-4a08-b106-9dc1f04252ee None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:23.193329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-0d4d30e5-349e-4a08-b106-9dc1f04252ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:23.193329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:23.193329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:23.193329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:23.193329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:23.193329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:23.193329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:23.193329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:23.193329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:23.193329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:23.193329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:23.193329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:23.193329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:23.193329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:23.193329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:23.193329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:23.194396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:23.194396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:23.194396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:23.194396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:23.194396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:23.194396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:23.194396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:23.194396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:23.194396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:23.194396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:23.194396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:23.194396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:23.194396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:23.194396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:23.194396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:23.194396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:23.194396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:23.195762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:23.195762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:23.195762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:23.200017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 431/870] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:23.201057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d30e5-349e-4a08-b106-9dc1f04252ee None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:23.223345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:23.246035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 440/871] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:23 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:23.314716 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d30e5-349e-4a08-b106-9dc1f04252ee None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:23.348963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3a693-5d1a-4e96-84aa-ee3ebfcb233a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:23.349557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3a693-5d1a-4e96-84aa-ee3ebfcb233a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.349829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3a693-5d1a-4e96-84aa-ee3ebfcb233a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.350151 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3a693-5d1a-4e96-84aa-ee3ebfcb233a None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.350816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3a693-5d1a-4e96-84aa-ee3ebfcb233a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:23.351117 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3a693-5d1a-4e96-84aa-ee3ebfcb233a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:23.352464 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3a693-5d1a-4e96-84aa-ee3ebfcb233a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:23.366076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 432/872] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:23.371793 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a780590-92bf-4cab-abc1-2644461129df None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:23.426981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:23.476706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a780590-92bf-4cab-abc1-2644461129df None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:23.511895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129f242-7804-44f4-aaad-e1e3e14e2a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:23.512529 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129f242-7804-44f4-aaad-e1e3e14e2a80 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.512807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129f242-7804-44f4-aaad-e1e3e14e2a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.513075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129f242-7804-44f4-aaad-e1e3e14e2a80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.519934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129f242-7804-44f4-aaad-e1e3e14e2a80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:23.521379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129f242-7804-44f4-aaad-e1e3e14e2a80 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:23.528031 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3a693-5d1a-4e96-84aa-ee3ebfcb233a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:23.534280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-0129f242-7804-44f4-aaad-e1e3e14e2a80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:23.534280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:23.534280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:23.534280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:23.534280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:23.534280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:23.534280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:23.534280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:23.534280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:23.534280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:23.534280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:23.534280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:23.534280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:23.534280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:23.534280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:23.535289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:23.535289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:23.535289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:23.535289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:23.535289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:23.535289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:23.535289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:23.535289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:23.535289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:23.535289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:23.535289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:23.535289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:23.535289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:23.535289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:23.535289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:23.535289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:23.535289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:23.536189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:23.536189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:23.536189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:23.536189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:23.536189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:23.536189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:23.536189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:23.536189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:23.536189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 441/873] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:23.543002 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129f242-7804-44f4-aaad-e1e3e14e2a80 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:23.624634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:23.646246 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129f242-7804-44f4-aaad-e1e3e14e2a80 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:23.658093 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3a693-5d1a-4e96-84aa-ee3ebfcb233a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:23.663341 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:23.693160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8de9ab-6a98-419c-8df0-2a662933950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:23.694775 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8de9ab-6a98-419c-8df0-2a662933950c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.695424 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8de9ab-6a98-419c-8df0-2a662933950c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.695977 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8de9ab-6a98-419c-8df0-2a662933950c None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.696906 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8de9ab-6a98-419c-8df0-2a662933950c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:23.697389 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8de9ab-6a98-419c-8df0-2a662933950c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:23.699042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8de9ab-6a98-419c-8df0-2a662933950c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:23.699827 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54213105-c0e8-4195-91e7-c14ec9a5a47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:23.700511 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54213105-c0e8-4195-91e7-c14ec9a5a47f None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.700864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54213105-c0e8-4195-91e7-c14ec9a5a47f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.701213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54213105-c0e8-4195-91e7-c14ec9a5a47f None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.702138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54213105-c0e8-4195-91e7-c14ec9a5a47f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:23.704028 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54213105-c0e8-4195-91e7-c14ec9a5a47f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:23.715430 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 442/874] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:23.726654 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8de9ab-6a98-419c-8df0-2a662933950c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:23.726865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 433/875] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Sep 1 16:20:23 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:23.861345 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8de9ab-6a98-419c-8df0-2a662933950c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:23.904982 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869c911-8d03-427d-bc4f-c7af6edf87a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:23.905825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869c911-8d03-427d-bc4f-c7af6edf87a5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.906252 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869c911-8d03-427d-bc4f-c7af6edf87a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.906709 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869c911-8d03-427d-bc4f-c7af6edf87a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.907573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869c911-8d03-427d-bc4f-c7af6edf87a5 None admin] RBAC: Adding query filter params (role.id=21a27b57a72246b2ade92d82599c569d, scope.project.id=9527063094354a99a80822107d2740fb, user.id=cd0dbb2c140946f69c3f508b4184e998) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:23.908062 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869c911-8d03-427d-bc4f-c7af6edf87a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:23.909620 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869c911-8d03-427d-bc4f-c7af6edf87a5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:23.916418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 443/876] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:23 2022] GET /identity/v3/role_assignments?user.id=cd0dbb2c140946f69c3f508b4184e998&scope.project.id=9527063094354a99a80822107d2740fb&role.id=21a27b57a72246b2ade92d82599c569d => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:24.147026 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3d855-7e71-4cd5-84d2-d579a5b9eeec None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:24.147541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3d855-7e71-4cd5-84d2-d579a5b9eeec None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:24.147979 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3d855-7e71-4cd5-84d2-d579a5b9eeec None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:24.149479 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 434/877] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:24.155454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30964ba-f32d-49f6-a086-0ffe19ae11e9 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:24.155708 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30964ba-f32d-49f6-a086-0ffe19ae11e9 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:24.155932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30964ba-f32d-49f6-a086-0ffe19ae11e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:24.174848 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f30964ba-f32d-49f6-a086-0ffe19ae11e9 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:24.176040 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f30964ba-f32d-49f6-a086-0ffe19ae11e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:24.203885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:24.249134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 444/878] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:24.536031 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3d855-7e71-4cd5-84d2-d579a5b9eeec None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:24.640180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3d855-7e71-4cd5-84d2-d579a5b9eeec None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:24.675492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c27f8-5d4b-45bd-af60-8f889a568572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:24.676130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c27f8-5d4b-45bd-af60-8f889a568572 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:24.676409 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c27f8-5d4b-45bd-af60-8f889a568572 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:24.676682 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c27f8-5d4b-45bd-af60-8f889a568572 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:24.677268 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c27f8-5d4b-45bd-af60-8f889a568572 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:24.678658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c27f8-5d4b-45bd-af60-8f889a568572 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:24.688443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-2c3c27f8-5d4b-45bd-af60-8f889a568572 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:24.688443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:24.688443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:24.688443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:24.688443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:24.688443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:24.688443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:24.688443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:24.688443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:24.688443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:24.688443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:24.688443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:24.688443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:24.688443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:24.688443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:24.688443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:24.688443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:24.689441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:24.689441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:24.689441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:24.689441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:24.689441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:24.689441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:24.689441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:24.689441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:24.689441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:24.689441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:24.689441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:24.689441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:24.689441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:24.689441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:24.689441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:24.689441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:24.690313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:24.690313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:24.690313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:24.690313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:24.690313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:24.690313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:24.690313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:24.690313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:24.690313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:24.690313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:24.690313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:24.690313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:24.690313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:24.690313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:24.690313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 435/879] 10.222.0.71 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:24.695691 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30964ba-f32d-49f6-a086-0ffe19ae11e9 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:24.797580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30964ba-f32d-49f6-a086-0ffe19ae11e9 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:24.832757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf517ce-0d5c-4579-a916-44912837ea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:24.833365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf517ce-0d5c-4579-a916-44912837ea57 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:24.833641 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf517ce-0d5c-4579-a916-44912837ea57 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:24.833911 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf517ce-0d5c-4579-a916-44912837ea57 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:24.834539 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf517ce-0d5c-4579-a916-44912837ea57 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:24.834873 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf517ce-0d5c-4579-a916-44912837ea57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:24.836295 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf517ce-0d5c-4579-a916-44912837ea57 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:24.841419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 445/880] 10.222.0.71 () {56 vars in 1122 bytes} [Thu Sep 1 16:20:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:24.847525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c27f8-5d4b-45bd-af60-8f889a568572 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:24.850321 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:24.960243 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c27f8-5d4b-45bd-af60-8f889a568572 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:24.994697 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52fa15-0c3c-4636-9f42-0d01ec316e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:24.995289 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52fa15-0c3c-4636-9f42-0d01ec316e04 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:24.995562 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52fa15-0c3c-4636-9f42-0d01ec316e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:24.995825 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52fa15-0c3c-4636-9f42-0d01ec316e04 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:24.996445 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52fa15-0c3c-4636-9f42-0d01ec316e04 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:24.996740 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52fa15-0c3c-4636-9f42-0d01ec316e04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:24.998150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52fa15-0c3c-4636-9f42-0d01ec316e04 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:25.003049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 436/881] 10.222.0.71 () {56 vars in 1122 bytes} [Thu Sep 1 16:20:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:25.202282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d23c3-ea3e-40e0-8fd9-e91b60677d07 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.202648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d23c3-ea3e-40e0-8fd9-e91b60677d07 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.202791 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d23c3-ea3e-40e0-8fd9-e91b60677d07 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.204367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 446/882] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:25.209576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35848906-028a-4080-ae7c-ad3c3971bd5a None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.210094 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35848906-028a-4080-ae7c-ad3c3971bd5a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.210564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35848906-028a-4080-ae7c-ad3c3971bd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.230408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-35848906-028a-4080-ae7c-ad3c3971bd5a None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:25.231948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-35848906-028a-4080-ae7c-ad3c3971bd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:25.293344 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:25.306840 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 437/883] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:25.566476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d23c3-ea3e-40e0-8fd9-e91b60677d07 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:25.595060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:25.675320 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d23c3-ea3e-40e0-8fd9-e91b60677d07 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:25.710918 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c9570-4469-4756-a83e-bb981cb9f08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:25.711546 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c9570-4469-4756-a83e-bb981cb9f08d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.711833 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c9570-4469-4756-a83e-bb981cb9f08d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.712136 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c9570-4469-4756-a83e-bb981cb9f08d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.712724 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c9570-4469-4756-a83e-bb981cb9f08d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:25.714292 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c9570-4469-4756-a83e-bb981cb9f08d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:25.723661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-e68c9570-4469-4756-a83e-bb981cb9f08d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:25.723661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:25.723661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:25.723661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:25.723661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:25.723661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:25.723661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:25.723661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:25.723661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:25.723661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:25.723661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:25.723661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:25.723661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:25.723661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:25.723661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:25.723661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:25.724596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:25.724596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:25.724596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:25.724596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:25.724596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:25.724596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:25.724596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:25.724596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:25.724596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:25.724596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:25.724596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:25.724596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:25.724596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:25.724596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:25.724596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:25.724596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:25.724596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:25.725484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:25.725484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:25.725484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:25.725484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:25.725484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:25.725484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:25.725484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:25.725484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:25.725484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:25.725484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:25.725484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:25.725484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:25.725484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:25.725484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:25.725484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 447/884] 10.222.0.71 () {56 vars in 1132 bytes} [Thu Sep 1 16:20:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:25.731286 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35848906-028a-4080-ae7c-ad3c3971bd5a None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:25.747397 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7594a64-e191-42e7-b78b-dd4d82992674 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.747671 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7594a64-e191-42e7-b78b-dd4d82992674 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.747927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7594a64-e191-42e7-b78b-dd4d82992674 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.749502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 448/885] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:25.754591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac5e0a-7709-41af-bb73-1538261e74fd None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.754899 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac5e0a-7709-41af-bb73-1538261e74fd None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.755171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac5e0a-7709-41af-bb73-1538261e74fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.773763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2fac5e0a-7709-41af-bb73-1538261e74fd None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:25.775699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2fac5e0a-7709-41af-bb73-1538261e74fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:25.832740 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35848906-028a-4080-ae7c-ad3c3971bd5a None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:25.846875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 449/886] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:25.868398 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5f05d-d1e6-4e07-ac19-a16b190e75fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:25.868995 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5f05d-d1e6-4e07-ac19-a16b190e75fe None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.869270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5f05d-d1e6-4e07-ac19-a16b190e75fe None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.869538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5f05d-d1e6-4e07-ac19-a16b190e75fe None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.870167 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5f05d-d1e6-4e07-ac19-a16b190e75fe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:25.870462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5f05d-d1e6-4e07-ac19-a16b190e75fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:25.871853 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5f05d-d1e6-4e07-ac19-a16b190e75fe None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:25.881141 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 438/887] 10.222.0.71 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:25.887699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac5e0a-7709-41af-bb73-1538261e74fd None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:25.909926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:25.990212 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac5e0a-7709-41af-bb73-1538261e74fd None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.019961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf27f4-e89e-4fef-958e-fc26977db29a None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.020288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf27f4-e89e-4fef-958e-fc26977db29a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.020519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf27f4-e89e-4fef-958e-fc26977db29a None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.022209 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 439/888] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:26.025617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94595c2b-65a6-4da5-8490-b24b3c718c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.026165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94595c2b-65a6-4da5-8490-b24b3c718c30 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.026441 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94595c2b-65a6-4da5-8490-b24b3c718c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.026730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94595c2b-65a6-4da5-8490-b24b3c718c30 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.027104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2ede6-7375-4a14-8693-692dc08fd5d9 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.027359 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94595c2b-65a6-4da5-8490-b24b3c718c30 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:26.027461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2ede6-7375-4a14-8693-692dc08fd5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.027646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2ede6-7375-4a14-8693-692dc08fd5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.027750 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94595c2b-65a6-4da5-8490-b24b3c718c30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:26.028991 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94595c2b-65a6-4da5-8490-b24b3c718c30 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:26.034721 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 450/889] 10.222.0.71 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:26.042123 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94595c2b-65a6-4da5-8490-b24b3c718c30 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.046851 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-d9c2ede6-7375-4a14-8693-692dc08fd5d9 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:26.048053 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d9c2ede6-7375-4a14-8693-692dc08fd5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:26.109074 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:26.123144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 440/890] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:26.146360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2ede6-7375-4a14-8693-692dc08fd5d9 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.148936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:26.166006 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94595c2b-65a6-4da5-8490-b24b3c718c30 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.200439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e73b7-d430-4228-a7e8-cd3c8c48238f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.201068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e73b7-d430-4228-a7e8-cd3c8c48238f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.201310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e73b7-d430-4228-a7e8-cd3c8c48238f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.201587 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e73b7-d430-4228-a7e8-cd3c8c48238f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.202276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e73b7-d430-4228-a7e8-cd3c8c48238f None admin] RBAC: Adding query filter params (interface=public, service_id=591ffd4460744a3e8911d9064566d51c, region_id=RegionOne) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:26.202580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e73b7-d430-4228-a7e8-cd3c8c48238f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:26.204027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e73b7-d430-4228-a7e8-cd3c8c48238f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:26.213481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 451/891] 10.222.0.71 () {56 vars in 1251 bytes} [Thu Sep 1 16:20:26 2022] GET /identity/v3/endpoints?service_id=591ffd4460744a3e8911d9064566d51c&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:26.215804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e73b7-d430-4228-a7e8-cd3c8c48238f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.270303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2ede6-7375-4a14-8693-692dc08fd5d9 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.315331 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54678d7e-d123-4397-b378-abd07ed32b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.316179 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54678d7e-d123-4397-b378-abd07ed32b74 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.316617 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54678d7e-d123-4397-b378-abd07ed32b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.317024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54678d7e-d123-4397-b378-abd07ed32b74 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.317859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54678d7e-d123-4397-b378-abd07ed32b74 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:26.319491 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54678d7e-d123-4397-b378-abd07ed32b74 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:26.329685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-54678d7e-d123-4397-b378-abd07ed32b74 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:26.329685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:26.329685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:26.329685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:26.329685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:26.329685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:26.329685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:26.329685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:26.329685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:26.329685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:26.329685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:26.329685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:26.329685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:26.329685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:26.329685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:26.329685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:26.329685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:26.330968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:26.330968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:26.330968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:26.330968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:26.330968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:26.330968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:26.330968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:26.330968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:26.330968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:26.330968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:26.330968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:26.330968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:26.330968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:26.330968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:26.330968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:26.330968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:26.332003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:26.332003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:26.332003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:26.332003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:26.332003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:26.332003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:26.332003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:26.332003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:26.332003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:26.332003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:26.332003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:26.332003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:26.332003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:26.332003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:26.339662 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 441/892] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:26.340970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54678d7e-d123-4397-b378-abd07ed32b74 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.341178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e73b7-d430-4228-a7e8-cd3c8c48238f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.376922 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5899f-fee8-4517-ab24-0c4e60a4d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.377608 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5899f-fee8-4517-ab24-0c4e60a4d64a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.377981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5899f-fee8-4517-ab24-0c4e60a4d64a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.378350 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5899f-fee8-4517-ab24-0c4e60a4d64a None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.379090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5899f-fee8-4517-ab24-0c4e60a4d64a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:26.380598 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5899f-fee8-4517-ab24-0c4e60a4d64a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:26.391761 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 452/893] 10.222.0.71 () {56 vars in 1087 bytes} [Thu Sep 1 16:20:26 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:20:26.394717 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5899f-fee8-4517-ab24-0c4e60a4d64a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.412652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:26.418223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:26.471035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54678d7e-d123-4397-b378-abd07ed32b74 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.509922 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56294d-f3b5-42e5-9dd3-bf1facb5fbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.510592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56294d-f3b5-42e5-9dd3-bf1facb5fbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.510899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56294d-f3b5-42e5-9dd3-bf1facb5fbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.511171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56294d-f3b5-42e5-9dd3-bf1facb5fbb0 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.511820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56294d-f3b5-42e5-9dd3-bf1facb5fbb0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:26.512125 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56294d-f3b5-42e5-9dd3-bf1facb5fbb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:26.513528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56294d-f3b5-42e5-9dd3-bf1facb5fbb0 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:26.519224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 442/894] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:26.529793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56294d-f3b5-42e5-9dd3-bf1facb5fbb0 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.538077 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5899f-fee8-4517-ab24-0c4e60a4d64a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.576326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d09485-3ab0-4720-aa8b-f932465b087c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.576952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d09485-3ab0-4720-aa8b-f932465b087c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.577226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d09485-3ab0-4720-aa8b-f932465b087c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.577491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d09485-3ab0-4720-aa8b-f932465b087c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.592922 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d09485-3ab0-4720-aa8b-f932465b087c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:26.597843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-e5d09485-3ab0-4720-aa8b-f932465b087c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:20:26.597843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:26.597843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:26.597843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:26.597843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:26.597843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:26.597843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:26.597843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:26.597843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:26.597843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:26.597843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:26.597843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:26.597843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:26.597843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:26.597843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:26.597843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:26.598807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:26.598807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:26.598807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:26.598807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:26.598807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:26.598807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:26.598807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:26.598807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:26.598807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:26.598807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:26.598807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:26.598807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:26.598807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:26.598807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:26.598807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:26.598807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:26.599847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:26.599847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:26.599847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:26.599847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:26.599847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:26.599847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:26.599847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:26.599847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:26.599847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:26.599847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:26.599847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:20:26.599847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:26.599847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 453/895] 10.222.0.71 () {56 vars in 1120 bytes} [Thu Sep 1 16:20:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:26.605173 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d09485-3ab0-4720-aa8b-f932465b087c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.663926 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56294d-f3b5-42e5-9dd3-bf1facb5fbb0 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.682510 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:26.699116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:26.701942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1bf071-bcb4-4fea-b54e-3c209b4751ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.702821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bf071-bcb4-4fea-b54e-3c209b4751ef None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.703098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bf071-bcb4-4fea-b54e-3c209b4751ef None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.703368 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bf071-bcb4-4fea-b54e-3c209b4751ef None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.704004 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1bf071-bcb4-4fea-b54e-3c209b4751ef None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:26.704305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1bf071-bcb4-4fea-b54e-3c209b4751ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:26.705720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1bf071-bcb4-4fea-b54e-3c209b4751ef None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:26.712994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 443/896] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:26.721128 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1bf071-bcb4-4fea-b54e-3c209b4751ef None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.743127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d09485-3ab0-4720-aa8b-f932465b087c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.787141 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47b0ce-a3f7-4428-a18f-e292edbb72a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.788327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47b0ce-a3f7-4428-a18f-e292edbb72a5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.788748 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47b0ce-a3f7-4428-a18f-e292edbb72a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.789154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47b0ce-a3f7-4428-a18f-e292edbb72a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.790019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47b0ce-a3f7-4428-a18f-e292edbb72a5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:26.790457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47b0ce-a3f7-4428-a18f-e292edbb72a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:26.792678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47b0ce-a3f7-4428-a18f-e292edbb72a5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:26.803921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 454/897] 10.222.0.71 () {56 vars in 1115 bytes} [Thu Sep 1 16:20:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:26.810080 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47b0ce-a3f7-4428-a18f-e292edbb72a5 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.849208 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1bf071-bcb4-4fea-b54e-3c209b4751ef None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.887551 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4978086-fba8-435a-aab8-6fa99e768a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.888101 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4978086-fba8-435a-aab8-6fa99e768a24 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.888474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4978086-fba8-435a-aab8-6fa99e768a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.888647 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4978086-fba8-435a-aab8-6fa99e768a24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.889352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4978086-fba8-435a-aab8-6fa99e768a24 None admin] RBAC: Adding query filter params (interface=public, service_id=865c44ebd7574d64973a03b6719aa112, region_id=RegionOne) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:26.889658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4978086-fba8-435a-aab8-6fa99e768a24 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:26.891161 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4978086-fba8-435a-aab8-6fa99e768a24 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:26.898658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 444/898] 10.222.0.71 () {56 vars in 1251 bytes} [Thu Sep 1 16:20:26 2022] GET /identity/v3/endpoints?service_id=865c44ebd7574d64973a03b6719aa112&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:26.902393 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4978086-fba8-435a-aab8-6fa99e768a24 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.929510 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47b0ce-a3f7-4428-a18f-e292edbb72a5 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.955702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:26.969176 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5469b-09a8-4465-89bc-c0ac27440e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.970144 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5469b-09a8-4465-89bc-c0ac27440e7a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.970571 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5469b-09a8-4465-89bc-c0ac27440e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.971138 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5469b-09a8-4465-89bc-c0ac27440e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.973293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:26.983890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5469b-09a8-4465-89bc-c0ac27440e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:26.985695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5469b-09a8-4465-89bc-c0ac27440e7a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:27.001364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-80e5469b-09a8-4465-89bc-c0ac27440e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:27.001364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:27.001364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:27.001364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:27.001364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:27.001364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:27.001364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:27.001364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:27.001364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:27.001364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:27.001364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:27.001364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:27.001364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:27.001364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:27.001364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:27.001364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:27.002572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:27.002572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:27.002572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:27.002572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:27.002572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:27.002572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:27.002572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:27.002572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:27.002572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:27.002572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:27.002572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:27.002572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:27.002572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:27.002572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:27.002572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:27.002572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:27.002572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:27.003612 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:27.003612 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:27.003612 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:27.005598 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 455/899] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:27.011664 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5469b-09a8-4465-89bc-c0ac27440e7a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:27.021929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4978086-fba8-435a-aab8-6fa99e768a24 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:27.056564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10efad3-bc72-4119-9a43-f6e8200918c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:27.057530 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10efad3-bc72-4119-9a43-f6e8200918c0 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:27.058004 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10efad3-bc72-4119-9a43-f6e8200918c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:27.058482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10efad3-bc72-4119-9a43-f6e8200918c0 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:27.059312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10efad3-bc72-4119-9a43-f6e8200918c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:27.060856 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10efad3-bc72-4119-9a43-f6e8200918c0 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:27.068110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 445/900] 10.222.0.71 () {56 vars in 1087 bytes} [Thu Sep 1 16:20:26 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:20:27.069693 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966f041-57bf-4b76-8ad4-94ea40d45b30 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:27.070062 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966f041-57bf-4b76-8ad4-94ea40d45b30 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:27.070422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966f041-57bf-4b76-8ad4-94ea40d45b30 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:27.077098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 446/901] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:27.079078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79bf59-21e0-4ee6-b8e9-62c21ea0b770 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:27.079360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79bf59-21e0-4ee6-b8e9-62c21ea0b770 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:27.079633 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79bf59-21e0-4ee6-b8e9-62c21ea0b770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:27.099900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-df79bf59-21e0-4ee6-b8e9-62c21ea0b770 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:27.101216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-df79bf59-21e0-4ee6-b8e9-62c21ea0b770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:27.125240 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5469b-09a8-4465-89bc-c0ac27440e7a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:27.163870 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe876c6-d0f3-43c7-a384-30989ee2a6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:27.165823 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe876c6-d0f3-43c7-a384-30989ee2a6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:27.166292 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe876c6-d0f3-43c7-a384-30989ee2a6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:27.167028 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe876c6-d0f3-43c7-a384-30989ee2a6f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:27.168051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe876c6-d0f3-43c7-a384-30989ee2a6f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:27.168536 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe876c6-d0f3-43c7-a384-30989ee2a6f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:27.170726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe876c6-d0f3-43c7-a384-30989ee2a6f2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:27.181663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 447/902] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:27.188019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 456/903] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:27.193356 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79bf59-21e0-4ee6-b8e9-62c21ea0b770 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:27.239352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:27.306205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79bf59-21e0-4ee6-b8e9-62c21ea0b770 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:27.341816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683ad55-ee65-4ec8-b05a-d91a96338214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:27.342732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683ad55-ee65-4ec8-b05a-d91a96338214 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:27.343013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683ad55-ee65-4ec8-b05a-d91a96338214 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:27.343287 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683ad55-ee65-4ec8-b05a-d91a96338214 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:27.350571 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683ad55-ee65-4ec8-b05a-d91a96338214 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:27.352028 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683ad55-ee65-4ec8-b05a-d91a96338214 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:27.363916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-8683ad55-ee65-4ec8-b05a-d91a96338214 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:27.363916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:27.363916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:27.363916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:27.363916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:27.363916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:27.363916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:27.363916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:27.363916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:27.363916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:27.363916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:27.363916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:27.363916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:27.363916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:27.363916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:27.363916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:27.364878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:27.365815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:27.365815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:27.365815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:27.365815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:27.365815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:27.365815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:27.365815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:27.365815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:27.365815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:27.365815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:27.365815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 448/904] 10.222.0.71 () {56 vars in 1117 bytes} [Thu Sep 1 16:20:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:27.371732 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe876c6-d0f3-43c7-a384-30989ee2a6f2 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:27.423624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:27.471690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683ad55-ee65-4ec8-b05a-d91a96338214 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:27.481447 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe876c6-d0f3-43c7-a384-30989ee2a6f2 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:27.523413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ecfc3-6223-451d-b7cb-0a78800236a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:27.524033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ecfc3-6223-451d-b7cb-0a78800236a6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:27.524601 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ecfc3-6223-451d-b7cb-0a78800236a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:27.524886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ecfc3-6223-451d-b7cb-0a78800236a6 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:27.526221 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ecfc3-6223-451d-b7cb-0a78800236a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:27.526533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ecfc3-6223-451d-b7cb-0a78800236a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:27.528642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ecfc3-6223-451d-b7cb-0a78800236a6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:27.558314 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 457/905] 10.222.0.71 () {56 vars in 1149 bytes} [Thu Sep 1 16:20:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:27.567072 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ecfc3-6223-451d-b7cb-0a78800236a6 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:27.595711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:27.599339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683ad55-ee65-4ec8-b05a-d91a96338214 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:27.651087 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c4d36-a4cf-43ef-8f2d-9df83802cd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:27.652258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c4d36-a4cf-43ef-8f2d-9df83802cd74 None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:27.652814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c4d36-a4cf-43ef-8f2d-9df83802cd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:27.653251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c4d36-a4cf-43ef-8f2d-9df83802cd74 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:27.654056 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c4d36-a4cf-43ef-8f2d-9df83802cd74 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:27.656453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c4d36-a4cf-43ef-8f2d-9df83802cd74 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:27.676887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 449/906] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Sep 1 16:20:27 2022] POST /identity/v3/services => generated 241 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:20:27.699495 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ecfc3-6223-451d-b7cb-0a78800236a6 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:27.702910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:27.749646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8c8dd-229b-4380-98ca-88988d117de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:27.750992 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8c8dd-229b-4380-98ca-88988d117de7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:27.751483 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8c8dd-229b-4380-98ca-88988d117de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:27.751901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8c8dd-229b-4380-98ca-88988d117de7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:27.830984 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8c8dd-229b-4380-98ca-88988d117de7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:27.832693 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8c8dd-229b-4380-98ca-88988d117de7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:27.939694 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:27.943992 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 458/907] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:27 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:20:27.950119 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c4d36-a4cf-43ef-8f2d-9df83802cd74 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:28.058916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c4d36-a4cf-43ef-8f2d-9df83802cd74 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:28.095159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dde36-55d6-4ae5-ac56-270b6cdbff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:28.095786 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dde36-55d6-4ae5-ac56-270b6cdbff7c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.096069 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dde36-55d6-4ae5-ac56-270b6cdbff7c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.096337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dde36-55d6-4ae5-ac56-270b6cdbff7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.107224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dde36-55d6-4ae5-ac56-270b6cdbff7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:28.108649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dde36-55d6-4ae5-ac56-270b6cdbff7c None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:28.123492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-180dde36-55d6-4ae5-ac56-270b6cdbff7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:28.123492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:28.123492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:28.123492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:28.123492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:28.123492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:28.123492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:28.123492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:28.123492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:28.123492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:28.123492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:28.123492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:28.123492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:28.123492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:28.123492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:28.123492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:28.124463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:28.124463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:28.124463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:28.124463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:28.124463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:28.124463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:28.124463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:28.124463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:28.124463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:28.124463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:28.124463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:28.124463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:28.124463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:28.124463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:28.124463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:28.124463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:28.124463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:28.125366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:28.125366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:28.125366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:28.125366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 450/908] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:28.130582 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8c8dd-229b-4380-98ca-88988d117de7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:28.239565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8c8dd-229b-4380-98ca-88988d117de7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:28.274813 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa2899-bd41-48dd-a27b-d40c09aec074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:28.275416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa2899-bd41-48dd-a27b-d40c09aec074 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.275693 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa2899-bd41-48dd-a27b-d40c09aec074 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.275961 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa2899-bd41-48dd-a27b-d40c09aec074 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.276603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa2899-bd41-48dd-a27b-d40c09aec074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:28.276960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa2899-bd41-48dd-a27b-d40c09aec074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:28.278323 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa2899-bd41-48dd-a27b-d40c09aec074 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:28.290035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 459/909] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:28.295617 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dde36-55d6-4ae5-ac56-270b6cdbff7c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:28.313361 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:28.394063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d97ff-e0f4-4aa0-8775-a4af0821f319 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.394398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d97ff-e0f4-4aa0-8775-a4af0821f319 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.394605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d97ff-e0f4-4aa0-8775-a4af0821f319 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.396079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 460/910] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:28.401161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02f20-de51-4ba9-ac65-3fad8c907685 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.401658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02f20-de51-4ba9-ac65-3fad8c907685 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.402156 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02f20-de51-4ba9-ac65-3fad8c907685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.407059 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dde36-55d6-4ae5-ac56-270b6cdbff7c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:28.421029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2bb02f20-de51-4ba9-ac65-3fad8c907685 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:28.422510 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2bb02f20-de51-4ba9-ac65-3fad8c907685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:28.444121 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b8a1c-78f4-40b2-ad81-b528fb284b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:28.444748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b8a1c-78f4-40b2-ad81-b528fb284b6b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.445029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b8a1c-78f4-40b2-ad81-b528fb284b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.445303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b8a1c-78f4-40b2-ad81-b528fb284b6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.452834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b8a1c-78f4-40b2-ad81-b528fb284b6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:28.454246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b8a1c-78f4-40b2-ad81-b528fb284b6b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:28.466140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-6f9b8a1c-78f4-40b2-ad81-b528fb284b6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:28.466140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:28.466140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:28.466140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:28.466140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:28.466140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:28.466140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:28.466140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:28.466140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:28.466140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:28.466140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:28.466140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:28.466140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:28.466140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:28.466140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:28.467099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:28.467099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:28.467099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:28.467099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:28.467099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:28.467099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:28.467099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:28.467099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:28.467099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:28.467099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:28.467099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:28.467099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:28.467099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:28.467099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:28.467099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:28.467099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:28.467099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:28.468246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:28.468246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:28.468246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:28.468246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:28.468246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:28.468246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:28.468246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:28.468246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:28.468246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 451/911] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:28.474072 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b8a1c-78f4-40b2-ad81-b528fb284b6b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:28.493071 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:28.510888 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 461/912] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:28.545511 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:28.576285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b8a1c-78f4-40b2-ad81-b528fb284b6b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:28.616859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa60308-c572-45e1-b301-7899264b49e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:28.617551 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa60308-c572-45e1-b301-7899264b49e1 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.618293 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa60308-c572-45e1-b301-7899264b49e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.618293 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa60308-c572-45e1-b301-7899264b49e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.620359 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa60308-c572-45e1-b301-7899264b49e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:28.620359 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa60308-c572-45e1-b301-7899264b49e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:28.626641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa60308-c572-45e1-b301-7899264b49e1 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:28.635049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 452/913] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:28.642851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb02f20-de51-4ba9-ac65-3fad8c907685 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:28.743017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb02f20-de51-4ba9-ac65-3fad8c907685 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:28.780828 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ef4f1-e8ef-47b9-8c63-64ed6c17a6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:28.781426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ef4f1-e8ef-47b9-8c63-64ed6c17a6da None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.781688 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ef4f1-e8ef-47b9-8c63-64ed6c17a6da None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.781952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ef4f1-e8ef-47b9-8c63-64ed6c17a6da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.782768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ef4f1-e8ef-47b9-8c63-64ed6c17a6da None admin] RBAC: Adding query filter params (role.id=0d6c0de77625409c8fe68e983df3a394, scope.project.id=9527063094354a99a80822107d2740fb, user.id=cd0dbb2c140946f69c3f508b4184e998) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:28.783073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ef4f1-e8ef-47b9-8c63-64ed6c17a6da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:28.784495 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ef4f1-e8ef-47b9-8c63-64ed6c17a6da None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:28.790487 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 462/914] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:28 2022] GET /identity/v3/role_assignments?user.id=cd0dbb2c140946f69c3f508b4184e998&scope.project.id=9527063094354a99a80822107d2740fb&role.id=0d6c0de77625409c8fe68e983df3a394 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:28.809946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa60308-c572-45e1-b301-7899264b49e1 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:28.933648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa60308-c572-45e1-b301-7899264b49e1 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:28.966409 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:28.972287 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbeafec-5f8a-464f-a69c-60dc225d2e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:28.973038 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeafec-5f8a-464f-a69c-60dc225d2e52 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.973707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeafec-5f8a-464f-a69c-60dc225d2e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.973984 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeafec-5f8a-464f-a69c-60dc225d2e52 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.974578 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbeafec-5f8a-464f-a69c-60dc225d2e52 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:28.975974 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbeafec-5f8a-464f-a69c-60dc225d2e52 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:28.985226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-bbbeafec-5f8a-464f-a69c-60dc225d2e52 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:28.985226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:28.985226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:28.985226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:28.985226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:28.985226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:28.985226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:28.985226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:28.985226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:28.985226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:28.985226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:28.985226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:28.985226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:28.985226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:28.985226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:28.985226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:28.986156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:28.986156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:28.986156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:28.986156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:28.986156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:28.986156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:28.986156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:28.986156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:28.986156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:28.986156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:28.986156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:28.986156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:28.986156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:28.986156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:28.986156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:28.986156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:28.986156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:28.987115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:28.987115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:28.987115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:28.987115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:28.987115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:28.987115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:28.987115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:28.987115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:28.987115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:28.987115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:28.987115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:28.987115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:28.987115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:28.987115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:28.987115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 453/915] 10.222.0.71 () {56 vars in 1132 bytes} [Thu Sep 1 16:20:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:28.994968 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ef4f1-e8ef-47b9-8c63-64ed6c17a6da None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:29.059070 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:29.104240 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ef4f1-e8ef-47b9-8c63-64ed6c17a6da None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:29.139160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6e427-db67-4067-9376-43d453f4d998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:29.139762 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6e427-db67-4067-9376-43d453f4d998 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.140033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6e427-db67-4067-9376-43d453f4d998 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.140297 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6e427-db67-4067-9376-43d453f4d998 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.140924 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6e427-db67-4067-9376-43d453f4d998 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:29.141220 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6e427-db67-4067-9376-43d453f4d998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:29.142571 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6e427-db67-4067-9376-43d453f4d998 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:29.147659 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 463/916] 10.222.0.71 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:29.153278 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbeafec-5f8a-464f-a69c-60dc225d2e52 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:29.210638 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e32bc-e771-4389-89b5-b375730c29ed None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.210968 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e32bc-e771-4389-89b5-b375730c29ed None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.211188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e32bc-e771-4389-89b5-b375730c29ed None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.212542 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 464/917] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:29.219088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace506e-d524-4a97-888a-26f0d083b016 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.219373 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace506e-d524-4a97-888a-26f0d083b016 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.219650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace506e-d524-4a97-888a-26f0d083b016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.239188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2ace506e-d524-4a97-888a-26f0d083b016 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:29.240384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2ace506e-d524-4a97-888a-26f0d083b016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:29.264581 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbeafec-5f8a-464f-a69c-60dc225d2e52 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:29.301443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be832bbe-d175-44ea-9174-360f9592d827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:29.302479 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be832bbe-d175-44ea-9174-360f9592d827 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.303048 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be832bbe-d175-44ea-9174-360f9592d827 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.303327 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be832bbe-d175-44ea-9174-360f9592d827 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.303988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be832bbe-d175-44ea-9174-360f9592d827 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:29.304508 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be832bbe-d175-44ea-9174-360f9592d827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:29.306642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be832bbe-d175-44ea-9174-360f9592d827 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:29.313016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 454/918] 10.222.0.71 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:29.313159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 465/919] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:29.323755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be832bbe-d175-44ea-9174-360f9592d827 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:29.384503 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:29.425630 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be832bbe-d175-44ea-9174-360f9592d827 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:29.460550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb6f01-b420-455d-9229-0c79e48fcc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:29.461207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb6f01-b420-455d-9229-0c79e48fcc9d None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.461489 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb6f01-b420-455d-9229-0c79e48fcc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.462320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb6f01-b420-455d-9229-0c79e48fcc9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.463037 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb6f01-b420-455d-9229-0c79e48fcc9d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:29.464455 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb6f01-b420-455d-9229-0c79e48fcc9d None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:29.487213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 455/920] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:20:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:29.611725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace506e-d524-4a97-888a-26f0d083b016 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:29.674009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:29.728948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c98b8-c4e0-4050-a553-a0a1370ea297 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.729267 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c98b8-c4e0-4050-a553-a0a1370ea297 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.729502 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c98b8-c4e0-4050-a553-a0a1370ea297 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.730739 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace506e-d524-4a97-888a-26f0d083b016 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:29.731125 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 456/921] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:29.736115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0934e95-5b6b-4aa1-abe3-d7450fbe9b5a None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.736397 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0934e95-5b6b-4aa1-abe3-d7450fbe9b5a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.736671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0934e95-5b6b-4aa1-abe3-d7450fbe9b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.755152 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-b0934e95-5b6b-4aa1-abe3-d7450fbe9b5a None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:29.756339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b0934e95-5b6b-4aa1-abe3-d7450fbe9b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:29.779857 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277a936-5a11-4bd0-9069-51ad3fb41913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:29.781119 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277a936-5a11-4bd0-9069-51ad3fb41913 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.782418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277a936-5a11-4bd0-9069-51ad3fb41913 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.783201 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277a936-5a11-4bd0-9069-51ad3fb41913 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.783971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277a936-5a11-4bd0-9069-51ad3fb41913 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:29.786410 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277a936-5a11-4bd0-9069-51ad3fb41913 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:29.798147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-2277a936-5a11-4bd0-9069-51ad3fb41913 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:29.798147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:29.798147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:29.798147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:29.798147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:29.798147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:29.798147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:29.798147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:29.798147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:29.798147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:29.798147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:29.798147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:29.798147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:29.798147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:29.798147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:29.798147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:29.798147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:29.799346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:29.799346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:29.799346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:29.799346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:29.799346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:29.799346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:29.799346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:29.799346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:29.799346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:29.799346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:29.799346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:29.799346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:29.799346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:29.799346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:29.799346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:29.799346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:29.800195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:29.800195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:29.800195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:29.800195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:29.800195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:29.800195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:29.800195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:29.800195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:29.800195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:29.800195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:29.800195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:29.800195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:29.800195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:29.800195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:29.800195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 466/922] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:29.807797 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277a936-5a11-4bd0-9069-51ad3fb41913 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:29.839740 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 457/923] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:29.924720 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277a936-5a11-4bd0-9069-51ad3fb41913 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:29.946997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:29.963934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc4270-793b-4de1-a704-dcc0317fe2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:29.964543 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc4270-793b-4de1-a704-dcc0317fe2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.964822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc4270-793b-4de1-a704-dcc0317fe2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.965092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc4270-793b-4de1-a704-dcc0317fe2e2 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.965728 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc4270-793b-4de1-a704-dcc0317fe2e2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:29.966028 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc4270-793b-4de1-a704-dcc0317fe2e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:29.967835 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc4270-793b-4de1-a704-dcc0317fe2e2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:29.972928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 467/924] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:29.979117 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0934e95-5b6b-4aa1-abe3-d7450fbe9b5a None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:30.028060 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:30.084784 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0934e95-5b6b-4aa1-abe3-d7450fbe9b5a None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:30.116999 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc4270-793b-4de1-a704-dcc0317fe2e2 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:30.120509 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc8e34-0736-4deb-940c-9ee788e0da33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:30.121963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc8e34-0736-4deb-940c-9ee788e0da33 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.122244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc8e34-0736-4deb-940c-9ee788e0da33 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.122521 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc8e34-0736-4deb-940c-9ee788e0da33 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.123200 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc8e34-0736-4deb-940c-9ee788e0da33 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:30.123507 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc8e34-0736-4deb-940c-9ee788e0da33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:30.124883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc8e34-0736-4deb-940c-9ee788e0da33 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:30.134114 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 458/925] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:30.140362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc8e34-0736-4deb-940c-9ee788e0da33 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:30.232770 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc4270-793b-4de1-a704-dcc0317fe2e2 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:30.273097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ea565-5fb7-473a-884f-aef1ddaa3594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:30.273911 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ea565-5fb7-473a-884f-aef1ddaa3594 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.274041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ea565-5fb7-473a-884f-aef1ddaa3594 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.274389 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ea565-5fb7-473a-884f-aef1ddaa3594 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.275158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ea565-5fb7-473a-884f-aef1ddaa3594 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:30.276528 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ea565-5fb7-473a-884f-aef1ddaa3594 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:30.277880 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc8e34-0736-4deb-940c-9ee788e0da33 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:30.285678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-424ea565-5fb7-473a-884f-aef1ddaa3594 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:30.285678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:30.285678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:30.285678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:30.285678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:30.285678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:30.285678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:30.285678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:30.285678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:30.285678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:30.285678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:30.285678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:30.285678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:30.285678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:30.285678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:30.285678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:30.285678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:30.286765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:30.286765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:30.286765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:30.286765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:30.286765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:30.286765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:30.286765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:30.286765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:30.286765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:30.286765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:30.286765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:30.286765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:30.286765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:30.286765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:30.286765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:30.286765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:30.287624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:30.287624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:30.287624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:30.287624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:30.287624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:30.287624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:30.287624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:30.287624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:30.287624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:30.287624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:30.287624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:30.287624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:30.287624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:30.287624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:30.291888 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 468/926] 10.222.0.71 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:30.292737 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ea565-5fb7-473a-884f-aef1ddaa3594 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:30.319180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:30.329071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c39eb-b72f-4af7-8038-810b8c3cffb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:30.330023 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c39eb-b72f-4af7-8038-810b8c3cffb6 None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.330584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c39eb-b72f-4af7-8038-810b8c3cffb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.331315 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c39eb-b72f-4af7-8038-810b8c3cffb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.332891 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:30.334474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c39eb-b72f-4af7-8038-810b8c3cffb6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:30.336655 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c39eb-b72f-4af7-8038-810b8c3cffb6 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:30.371052 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 459/927] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:20:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:30.415055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ea565-5fb7-473a-884f-aef1ddaa3594 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:30.463840 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87420d-6504-464c-9275-5523312dd821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:30.464836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87420d-6504-464c-9275-5523312dd821 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.465320 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87420d-6504-464c-9275-5523312dd821 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.465821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87420d-6504-464c-9275-5523312dd821 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.466698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87420d-6504-464c-9275-5523312dd821 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:30.467496 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87420d-6504-464c-9275-5523312dd821 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:30.469103 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87420d-6504-464c-9275-5523312dd821 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:30.475630 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 469/928] 10.222.0.71 () {56 vars in 1122 bytes} [Thu Sep 1 16:20:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:30.484072 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c39eb-b72f-4af7-8038-810b8c3cffb6 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:30.589325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c39eb-b72f-4af7-8038-810b8c3cffb6 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:30.628707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241333d0-02f8-41cd-958c-740b078e78f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:30.629327 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241333d0-02f8-41cd-958c-740b078e78f1 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.629605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241333d0-02f8-41cd-958c-740b078e78f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.629875 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241333d0-02f8-41cd-958c-740b078e78f1 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.630562 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241333d0-02f8-41cd-958c-740b078e78f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:30.630895 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241333d0-02f8-41cd-958c-740b078e78f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:30.632288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241333d0-02f8-41cd-958c-740b078e78f1 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:30.638271 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 460/929] 10.222.0.71 () {56 vars in 1122 bytes} [Thu Sep 1 16:20:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:30.644006 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87420d-6504-464c-9275-5523312dd821 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:30.762543 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:30.769184 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87420d-6504-464c-9275-5523312dd821 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:30.805117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87b4ce-f484-4f7e-ad08-54725e3041a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:30.806327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87b4ce-f484-4f7e-ad08-54725e3041a9 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.806557 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87b4ce-f484-4f7e-ad08-54725e3041a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.806865 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87b4ce-f484-4f7e-ad08-54725e3041a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.807557 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87b4ce-f484-4f7e-ad08-54725e3041a9 None admin] RBAC: Adding query filter params (interface=public, service_id=6c83c3f82f6f4b66a1cc883ffd447965, region_id=RegionOne) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:30.807864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87b4ce-f484-4f7e-ad08-54725e3041a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:30.809210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87b4ce-f484-4f7e-ad08-54725e3041a9 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:30.814670 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 470/930] 10.222.0.71 () {56 vars in 1251 bytes} [Thu Sep 1 16:20:30 2022] GET /identity/v3/endpoints?service_id=6c83c3f82f6f4b66a1cc883ffd447965&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:30.820338 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241333d0-02f8-41cd-958c-740b078e78f1 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:30.822254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172753bc-9a95-4c60-9d3c-71b6ffeccf79 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.822535 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172753bc-9a95-4c60-9d3c-71b6ffeccf79 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.822840 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172753bc-9a95-4c60-9d3c-71b6ffeccf79 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.824461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 471/931] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:30.829497 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767f63f-4b52-4cec-b8ab-d08caecea690 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.829781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767f63f-4b52-4cec-b8ab-d08caecea690 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.830053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767f63f-4b52-4cec-b8ab-d08caecea690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.849752 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f767f63f-4b52-4cec-b8ab-d08caecea690 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:30.851057 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f767f63f-4b52-4cec-b8ab-d08caecea690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:30.859372 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:30.934803 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 472/932] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:30.956615 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241333d0-02f8-41cd-958c-740b078e78f1 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:30.992311 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327f40e-736c-4015-9228-63db70ef0240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:30.992986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327f40e-736c-4015-9228-63db70ef0240 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.993264 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327f40e-736c-4015-9228-63db70ef0240 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.993539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327f40e-736c-4015-9228-63db70ef0240 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.994142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327f40e-736c-4015-9228-63db70ef0240 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:30.995526 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327f40e-736c-4015-9228-63db70ef0240 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:31.001905 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 461/933] 10.222.0.71 () {56 vars in 1087 bytes} [Thu Sep 1 16:20:30 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:20:31.214400 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767f63f-4b52-4cec-b8ab-d08caecea690 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:31.310429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:31.320662 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767f63f-4b52-4cec-b8ab-d08caecea690 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:31.356512 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5182271-4443-4be3-9e36-4a85a63ec3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:31.357506 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5182271-4443-4be3-9e36-4a85a63ec3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:31.357980 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5182271-4443-4be3-9e36-4a85a63ec3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:31.358445 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5182271-4443-4be3-9e36-4a85a63ec3a1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:31.369375 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5182271-4443-4be3-9e36-4a85a63ec3a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:31.374478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-a5182271-4443-4be3-9e36-4a85a63ec3a1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:20:31.374478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:31.374478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:31.374478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:31.374478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:31.374478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:31.374478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:31.374478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:31.374478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:31.374478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:31.374478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:31.374478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:31.374478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:31.374478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:31.374478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:31.374478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:31.375425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:31.375425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:31.375425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:31.375425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:31.375425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:31.375425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:31.375425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:31.375425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:31.375425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:31.375425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:31.375425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:31.375425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:31.375425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:31.375425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:31.375425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:31.375425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:31.376344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:31.376344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:31.376344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:31.376344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:31.376344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:31.376344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:31.376344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:31.376344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:31.376344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:31.376344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:31.376344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:20:31.376344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:31.382976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 473/934] 10.222.0.71 () {56 vars in 1120 bytes} [Thu Sep 1 16:20:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:31.385550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327f40e-736c-4015-9228-63db70ef0240 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:31.482038 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:31.489319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327f40e-736c-4015-9228-63db70ef0240 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:31.523461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2813c-a9a1-407b-8b84-6b0a8e120d99 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:31.524158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2813c-a9a1-407b-8b84-6b0a8e120d99 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:31.524640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2813c-a9a1-407b-8b84-6b0a8e120d99 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:31.525432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6e547-f39b-4862-8f9f-d995edd47433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:31.526207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6e547-f39b-4862-8f9f-d995edd47433 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:31.526677 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6e547-f39b-4862-8f9f-d995edd47433 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:31.527128 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6e547-f39b-4862-8f9f-d995edd47433 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:31.527276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 474/935] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:31.528081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6e547-f39b-4862-8f9f-d995edd47433 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:31.528391 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6e547-f39b-4862-8f9f-d995edd47433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:31.529756 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6e547-f39b-4862-8f9f-d995edd47433 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:31.536438 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644cf84-57f5-48fd-bae6-578ddb7c68b4 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:31.536965 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644cf84-57f5-48fd-bae6-578ddb7c68b4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:31.537429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644cf84-57f5-48fd-bae6-578ddb7c68b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:31.542662 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 462/936] 10.222.0.71 () {56 vars in 1115 bytes} [Thu Sep 1 16:20:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:31.548000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6e547-f39b-4862-8f9f-d995edd47433 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:31.565214 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-6644cf84-57f5-48fd-bae6-578ddb7c68b4 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:31.567534 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6644cf84-57f5-48fd-bae6-578ddb7c68b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:31.657717 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6e547-f39b-4862-8f9f-d995edd47433 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:31.670813 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 475/937] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:31.696441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0814d-bb96-43f4-bbab-fcac81abbaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:31.697364 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0814d-bb96-43f4-bbab-fcac81abbaa7 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:31.697826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0814d-bb96-43f4-bbab-fcac81abbaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:31.698281 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0814d-bb96-43f4-bbab-fcac81abbaa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:31.709466 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0814d-bb96-43f4-bbab-fcac81abbaa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:31.711545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0814d-bb96-43f4-bbab-fcac81abbaa7 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:31.730337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-6da0814d-bb96-43f4-bbab-fcac81abbaa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:31.730337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:31.730337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:31.730337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:31.730337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:31.730337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:31.730337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:31.730337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:31.730337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:31.730337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:31.730337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:31.730337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:31.730337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:31.730337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:31.730337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:31.730337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:31.731494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:31.731494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:31.731494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:31.731494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:31.731494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:31.731494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:31.731494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:31.731494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:31.731494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:31.731494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:31.731494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:31.731494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:31.731494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:31.731494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:31.731494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:31.731494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:31.731494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:31.732672 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:31.732672 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:31.732672 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:31.736361 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 463/938] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:31.743794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644cf84-57f5-48fd-bae6-578ddb7c68b4 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:31.826442 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:31.846782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644cf84-57f5-48fd-bae6-578ddb7c68b4 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:31.881704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56eb219-5004-4cac-b776-59abba9b9bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:31.882312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56eb219-5004-4cac-b776-59abba9b9bff None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:31.882587 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56eb219-5004-4cac-b776-59abba9b9bff None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:31.882881 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56eb219-5004-4cac-b776-59abba9b9bff None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:31.884076 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56eb219-5004-4cac-b776-59abba9b9bff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:31.884387 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56eb219-5004-4cac-b776-59abba9b9bff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:31.885862 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56eb219-5004-4cac-b776-59abba9b9bff None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:31.901529 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 476/939] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:31.904047 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0814d-bb96-43f4-bbab-fcac81abbaa7 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:31.918125 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:31.957139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56eb219-5004-4cac-b776-59abba9b9bff None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:32.022542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0814d-bb96-43f4-bbab-fcac81abbaa7 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:32.068342 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56eb219-5004-4cac-b776-59abba9b9bff None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:32.074478 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfd3f3-9af5-4c12-a4ee-3348aaa31ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:32.075301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfd3f3-9af5-4c12-a4ee-3348aaa31ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:32.075722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfd3f3-9af5-4c12-a4ee-3348aaa31ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:32.076130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfd3f3-9af5-4c12-a4ee-3348aaa31ed8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:32.085774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbfd3f3-9af5-4c12-a4ee-3348aaa31ed8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:32.087581 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbfd3f3-9af5-4c12-a4ee-3348aaa31ed8 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:32.102514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-7dbfd3f3-9af5-4c12-a4ee-3348aaa31ed8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:32.102514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:32.102514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:32.102514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:32.102514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:32.102514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:32.102514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:32.102514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:32.102514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:32.102514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:32.102514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:32.102514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:32.102514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:32.102514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:32.102514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:32.102514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:32.103711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:32.104838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:32.104838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:32.104838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:32.104838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:32.104838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:32.104838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:32.104838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:32.104838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:32.104838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:32.104838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:32.106657 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 464/940] 10.222.0.71 () {56 vars in 1117 bytes} [Thu Sep 1 16:20:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:32.112366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfd3f3-9af5-4c12-a4ee-3348aaa31ed8 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:32.115529 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b8b8f-ed3a-45b6-aa37-fb40a1aa144f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:32.116164 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b8b8f-ed3a-45b6-aa37-fb40a1aa144f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:32.116466 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b8b8f-ed3a-45b6-aa37-fb40a1aa144f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:32.116813 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b8b8f-ed3a-45b6-aa37-fb40a1aa144f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:32.117403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b8b8f-ed3a-45b6-aa37-fb40a1aa144f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:32.119324 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b8b8f-ed3a-45b6-aa37-fb40a1aa144f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:32.128941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-b48b8b8f-ed3a-45b6-aa37-fb40a1aa144f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:20:32.128941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:32.128941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:32.128941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:32.128941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:32.128941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:32.128941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:32.128941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:32.128941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:20:32.128941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:32.128941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:32.128941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:32.128941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:32.128941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:32.128941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:32.128941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:32.128941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:32.129962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:32.129962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:32.129962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:32.129962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:32.129962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:32.129962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:32.129962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:32.129962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:32.129962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:32.129962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:32.129962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:32.129962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:32.129962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:32.129962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:32.129962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:32.129962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:32.130834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:32.130834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:32.130834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:32.130834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:32.130834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:32.130834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:32.130834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:32.130834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:32.130834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:32.130834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:32.130834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:32.130834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:32.130834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:20:32.130834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:32.130834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 477/941] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:32.138052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b8b8f-ed3a-45b6-aa37-fb40a1aa144f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:32.142870 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:32.198476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:32.233651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfd3f3-9af5-4c12-a4ee-3348aaa31ed8 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:32.265622 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b8b8f-ed3a-45b6-aa37-fb40a1aa144f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:32.268478 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafabb2-8995-4c5c-a392-68e3fb5925cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:32.269415 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafabb2-8995-4c5c-a392-68e3fb5925cc None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:32.269908 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafabb2-8995-4c5c-a392-68e3fb5925cc None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:32.270380 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafabb2-8995-4c5c-a392-68e3fb5925cc None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:32.271362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafabb2-8995-4c5c-a392-68e3fb5925cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:32.271890 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafabb2-8995-4c5c-a392-68e3fb5925cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:32.273647 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafabb2-8995-4c5c-a392-68e3fb5925cc None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:32.292531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 465/942] 10.222.0.71 () {56 vars in 1149 bytes} [Thu Sep 1 16:20:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:32.299727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafabb2-8995-4c5c-a392-68e3fb5925cc None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:32.315028 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770dac2-8711-4b12-a120-50cadb3f693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:32.315907 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770dac2-8711-4b12-a120-50cadb3f693c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:32.316580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770dac2-8711-4b12-a120-50cadb3f693c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:32.317461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770dac2-8711-4b12-a120-50cadb3f693c None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:32.318528 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770dac2-8711-4b12-a120-50cadb3f693c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:32.319040 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770dac2-8711-4b12-a120-50cadb3f693c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:32.321275 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770dac2-8711-4b12-a120-50cadb3f693c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:32.328040 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 478/943] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:32.332786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770dac2-8711-4b12-a120-50cadb3f693c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:32.401603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:32.433834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafabb2-8995-4c5c-a392-68e3fb5925cc None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:32.437670 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770dac2-8711-4b12-a120-50cadb3f693c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:32.461018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:32.471102 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b19ad-7a61-47bf-9c4e-708f6cb398de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:32.471839 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b19ad-7a61-47bf-9c4e-708f6cb398de None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:32.472137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b19ad-7a61-47bf-9c4e-708f6cb398de None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:32.472407 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b19ad-7a61-47bf-9c4e-708f6cb398de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:32.476489 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3331d-7280-4c21-8c4b-4a691b96d7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:32.477366 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3331d-7280-4c21-8c4b-4a691b96d7da None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:32.477821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3331d-7280-4c21-8c4b-4a691b96d7da None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:32.478267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3331d-7280-4c21-8c4b-4a691b96d7da None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:32.479227 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3331d-7280-4c21-8c4b-4a691b96d7da None admin] RBAC: Adding query filter params (type=compute) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:32.479533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3331d-7280-4c21-8c4b-4a691b96d7da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:32.480998 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3331d-7280-4c21-8c4b-4a691b96d7da None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:32.483318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b19ad-7a61-47bf-9c4e-708f6cb398de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:32.484746 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b19ad-7a61-47bf-9c4e-708f6cb398de None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:32.486301 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 479/944] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:32.487795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6bfed-d245-4c42-ad4f-dfa9ac29544f None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:32.488078 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6bfed-d245-4c42-ad4f-dfa9ac29544f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:32.488347 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6bfed-d245-4c42-ad4f-dfa9ac29544f None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:32.490673 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 480/945] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:32.495457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d037d-6c42-45bf-b933-bf4a3fa9b24e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:32.495947 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d037d-6c42-45bf-b933-bf4a3fa9b24e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:32.496396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d037d-6c42-45bf-b933-bf4a3fa9b24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:32.509629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-be4b19ad-7a61-47bf-9c4e-708f6cb398de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:32.509629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:32.509629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:32.509629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:32.509629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:32.509629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:32.509629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:32.509629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:32.509629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:32.509629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:32.509629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:32.509629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:32.509629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:32.509629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:32.509629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:32.509629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:32.510929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:32.510929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:32.510929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:32.510929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:32.510929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:32.510929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:32.510929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:32.510929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:32.510929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:32.510929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:32.510929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:32.510929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:32.510929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:32.510929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:32.510929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:32.510929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:32.510929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:32.512044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:32.512044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:32.512044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:32.518179 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 466/946] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:32.519170 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b19ad-7a61-47bf-9c4e-708f6cb398de None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:32.521673 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-517d037d-6c42-45bf-b933-bf4a3fa9b24e None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:32.523412 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-517d037d-6c42-45bf-b933-bf4a3fa9b24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:32.618698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 481/947] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:32.648697 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b19ad-7a61-47bf-9c4e-708f6cb398de None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:32.691350 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55263729-8d05-4e53-ba1f-98d3e551965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:32.691960 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55263729-8d05-4e53-ba1f-98d3e551965a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:32.692240 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55263729-8d05-4e53-ba1f-98d3e551965a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:32.692511 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55263729-8d05-4e53-ba1f-98d3e551965a None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:32.693160 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55263729-8d05-4e53-ba1f-98d3e551965a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:32.693462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55263729-8d05-4e53-ba1f-98d3e551965a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:32.694927 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55263729-8d05-4e53-ba1f-98d3e551965a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:32.707653 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 467/948] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:32.714152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d037d-6c42-45bf-b933-bf4a3fa9b24e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:32.787016 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:32.825521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d037d-6c42-45bf-b933-bf4a3fa9b24e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:32.861743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb4507-b3e1-4d0b-a3bd-acb82a368728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:32.862364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb4507-b3e1-4d0b-a3bd-acb82a368728 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:32.862644 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb4507-b3e1-4d0b-a3bd-acb82a368728 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:32.863002 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb4507-b3e1-4d0b-a3bd-acb82a368728 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:32.870092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb4507-b3e1-4d0b-a3bd-acb82a368728 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:32.871489 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb4507-b3e1-4d0b-a3bd-acb82a368728 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:32.882878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-94fb4507-b3e1-4d0b-a3bd-acb82a368728 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:32.882878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:32.882878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:32.882878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:32.882878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:32.882878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:32.882878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:32.882878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:32.882878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:32.882878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:32.882878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:32.882878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:32.882878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:32.882878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:32.882878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:32.884353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:32.884353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:32.884353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:32.884353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:32.884353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:32.884353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:32.884353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:32.884353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:32.884353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:32.884353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:32.884353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:32.884353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:32.884353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:32.884353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:32.884353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:32.884353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:32.884353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:32.885278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:32.885278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:32.885278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:32.885278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:32.885278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:32.885278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:32.885278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:32.885278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:32.885278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 482/949] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:32.890528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55263729-8d05-4e53-ba1f-98d3e551965a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:32.913443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb4507-b3e1-4d0b-a3bd-acb82a368728 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:32.938891 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:33.022079 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55263729-8d05-4e53-ba1f-98d3e551965a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:33.022310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb4507-b3e1-4d0b-a3bd-acb82a368728 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:33.048730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:33.058905 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d2bf9-8767-4c45-a58a-da456a0bc185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:33.059506 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2bf9-8767-4c45-a58a-da456a0bc185 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.059785 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2bf9-8767-4c45-a58a-da456a0bc185 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.060058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2bf9-8767-4c45-a58a-da456a0bc185 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.060761 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d2bf9-8767-4c45-a58a-da456a0bc185 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:33.061049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d2bf9-8767-4c45-a58a-da456a0bc185 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:33.062472 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d2bf9-8767-4c45-a58a-da456a0bc185 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:33.064302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4fb80-4336-4b64-ad33-39391f03482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:33.065199 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4fb80-4336-4b64-ad33-39391f03482e None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.065671 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4fb80-4336-4b64-ad33-39391f03482e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.066114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4fb80-4336-4b64-ad33-39391f03482e None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.066969 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4fb80-4336-4b64-ad33-39391f03482e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:33.068533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4fb80-4336-4b64-ad33-39391f03482e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:33.071587 dv-cinder-852208-16-smb devstack@keystone.service[81497]: WARNING keystone.server.flask.common [None req-51f4fb80-4336-4b64-ad33-39391f03482e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 16:20:33.073916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 468/950] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:33.075154 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f3a15-a0ed-4a94-87e9-fdc8fd8ac9b4 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.075440 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f3a15-a0ed-4a94-87e9-fdc8fd8ac9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.075714 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f3a15-a0ed-4a94-87e9-fdc8fd8ac9b4 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.077095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 469/951] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:33.079895 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f3a15-a0ed-4a94-87e9-fdc8fd8ac9b4 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:33.098105 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.sql.core [None req-51f4fb80-4336-4b64-ad33-39391f03482e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 16:20:33.098105 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 16:20:33.098105 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [parameters: {'id': 'c8f4884863db4e588eec612f39df2568', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 16:20:33.098105 dv-cinder-852208-16-smb devstack@keystone.service[81497]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81497) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 16:20:33.108459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-51f4fb80-4336-4b64-ad33-39391f03482e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c8f4884863db4e588eec612f39df2568.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c8f4884863db4e588eec612f39df2568. Sep 01 16:20:33.108459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:33.108459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:20:33.108459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:20:33.108459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:20:33.108459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:20:33.108459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:20:33.108459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:20:33.108459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:20:33.108459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:20:33.108459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:20:33.108459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:20:33.108459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application result.read() Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 01 16:20:33.109245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 01 16:20:33.110209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:20:33.110209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:20:33.110209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 16:20:33.110209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application yield resource Sep 01 16:20:33.110209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:20:33.110209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:20:33.110209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 16:20:33.110209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 16:20:33.110209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 16:20:33.110209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 16:20:33.110209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 16:20:33.110209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise self.value Sep 01 16:20:33.110209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 16:20:33.110209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 16:20:33.110209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 16:20:33.110209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application session.commit() Sep 01 16:20:33.110209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 16:20:33.111171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 16:20:33.111171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 16:20:33.111171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 16:20:33.111171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 16:20:33.111171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.session.flush() Sep 01 16:20:33.111171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 16:20:33.111171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 16:20:33.111171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 16:20:33.111171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 16:20:33.111171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 16:20:33.111171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application compat.raise_( Sep 01 16:20:33.111171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:20:33.111171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception Sep 01 16:20:33.111171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 16:20:33.111171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 16:20:33.111171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 16:20:33.111171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 16:20:33.113050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 16:20:33.113050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 16:20:33.113050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 16:20:33.113050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 16:20:33.113050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 16:20:33.113050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 16:20:33.113050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 16:20:33.113050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 16:20:33.113050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 16:20:33.113050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 16:20:33.113050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 16:20:33.113050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 16:20:33.113050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 16:20:33.113050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 16:20:33.113050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 16:20:33.114964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 16:20:33.114964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:20:33.114964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception Sep 01 16:20:33.114964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:20:33.114964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:20:33.114964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:20:33.114964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:20:33.114964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:20:33.114964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:20:33.114964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:20:33.114964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:20:33.114964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:20:33.114964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:20:33.114964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:20:33.114964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application result.read() Sep 01 16:20:33.114964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:20:33.114964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:20:33.117142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:20:33.117142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:20:33.117142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:20:33.117142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:20:33.117142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:20:33.117142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:20:33.117142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 16:20:33.117142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 16:20:33.117142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [parameters: {'id': 'c8f4884863db4e588eec612f39df2568', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 16:20:33.117142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 16:20:33.117142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:33.117142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:33.117142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:33.117142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:33.117142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 01 16:20:33.119621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 01 16:20:33.119621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 16:20:33.119621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 16:20:33.119621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 01 16:20:33.119621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:33.119621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:33.119621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:33.119621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:33.119621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:33.119621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:33.119621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:33.119621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:33.119621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:33.119621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:33.119621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:33.119621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:33.119621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:33.121946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:33.121946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 01 16:20:33.121946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 01 16:20:33.121946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:33.121946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:33.121946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 01 16:20:33.121946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 01 16:20:33.121946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c8f4884863db4e588eec612f39df2568. Sep 01 16:20:33.121946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:33.121946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 483/952] 10.222.0.71 () {60 vars in 1140 bytes} [Thu Sep 1 16:20:32 2022] POST /identity/v3/projects => generated 262 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:33.121946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0da7f-f702-4f7e-97cd-b6a4c4635d92 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.121946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0da7f-f702-4f7e-97cd-b6a4c4635d92 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.123566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0da7f-f702-4f7e-97cd-b6a4c4635d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.141195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8eb0da7f-f702-4f7e-97cd-b6a4c4635d92 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:33.142785 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8eb0da7f-f702-4f7e-97cd-b6a4c4635d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:33.186890 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:33.192468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f3a15-a0ed-4a94-87e9-fdc8fd8ac9b4 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:33.217960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 484/953] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:33.228049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0da7f-f702-4f7e-97cd-b6a4c4635d92 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:33.228523 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b4839-74ef-4074-812c-814e6cb0b067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:33.229176 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b4839-74ef-4074-812c-814e6cb0b067 None admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.229461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b4839-74ef-4074-812c-814e6cb0b067 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.229735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b4839-74ef-4074-812c-814e6cb0b067 None admin] PATH_INFO: `/v3/projects/9527063094354a99a80822107d2740fb/users/cd0dbb2c140946f69c3f508b4184e998/roles/0d6c0de77625409c8fe68e983df3a394` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.231944 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b4839-74ef-4074-812c-814e6cb0b067 None admin] RBAC: Authorizing `identity:create_grant(project_id=9527063094354a99a80822107d2740fb, user_id=cd0dbb2c140946f69c3f508b4184e998, role_id=0d6c0de77625409c8fe68e983df3a394)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:33.233356 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b4839-74ef-4074-812c-814e6cb0b067 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:33.257903 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 470/954] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:20:33 2022] PUT /identity/v3/projects/9527063094354a99a80822107d2740fb/users/cd0dbb2c140946f69c3f508b4184e998/roles/0d6c0de77625409c8fe68e983df3a394 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:20:33.348116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0da7f-f702-4f7e-97cd-b6a4c4635d92 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:33.359361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:33.389411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9596b4-6ad0-4eff-8164-9f5d01c2cc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:33.390397 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9596b4-6ad0-4eff-8164-9f5d01c2cc82 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.390907 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9596b4-6ad0-4eff-8164-9f5d01c2cc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.391504 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9596b4-6ad0-4eff-8164-9f5d01c2cc82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.399079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9596b4-6ad0-4eff-8164-9f5d01c2cc82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:33.400970 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9596b4-6ad0-4eff-8164-9f5d01c2cc82 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:33.412474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-5c9596b4-6ad0-4eff-8164-9f5d01c2cc82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:33.412474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:33.412474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:33.412474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:33.412474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:33.412474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:33.412474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:33.412474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:33.412474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:33.412474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:33.412474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:33.412474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:33.412474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:33.412474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:33.412474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:33.413435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:33.413435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:33.413435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:33.413435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:33.413435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:33.413435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:33.413435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:33.413435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:33.413435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:33.413435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:33.413435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:33.413435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:33.413435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:33.413435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:33.413435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:33.413435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:33.413435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:33.414391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:33.414391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:33.414391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:33.414391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:33.414391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:33.414391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:33.414391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:33.414391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:33.416834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 485/955] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:33.422893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b4839-74ef-4074-812c-814e6cb0b067 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:33.497789 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9596b4-6ad0-4eff-8164-9f5d01c2cc82 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:33.536030 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b4839-74ef-4074-812c-814e6cb0b067 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:33.572108 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6688c5-1f89-4742-b405-32e1f6f26dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:33.572720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6688c5-1f89-4742-b405-32e1f6f26dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.573059 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6688c5-1f89-4742-b405-32e1f6f26dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.573331 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6688c5-1f89-4742-b405-32e1f6f26dc7 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.574150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6688c5-1f89-4742-b405-32e1f6f26dc7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:33.574455 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6688c5-1f89-4742-b405-32e1f6f26dc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:33.576028 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6688c5-1f89-4742-b405-32e1f6f26dc7 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:33.595784 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 471/956] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:33.618928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9596b4-6ad0-4eff-8164-9f5d01c2cc82 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:33.659997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10739d77-59e4-42d1-8a53-6fa6ffeeb1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:33.660566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10739d77-59e4-42d1-8a53-6fa6ffeeb1de None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.660845 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10739d77-59e4-42d1-8a53-6fa6ffeeb1de None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.661117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10739d77-59e4-42d1-8a53-6fa6ffeeb1de None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.661721 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10739d77-59e4-42d1-8a53-6fa6ffeeb1de None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:33.663165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10739d77-59e4-42d1-8a53-6fa6ffeeb1de None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:33.673864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-10739d77-59e4-42d1-8a53-6fa6ffeeb1de None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:33.673864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:33.673864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:33.673864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:33.673864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:33.673864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:33.673864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:33.673864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:33.673864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:33.673864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:33.673864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:33.673864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:33.673864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:33.673864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:33.673864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:33.673864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:33.673864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:33.675044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:33.675044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:33.675044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:33.675044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:33.675044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:33.675044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:33.675044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:33.675044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:33.675044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:33.675044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:33.675044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:33.675044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:33.675044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:33.675044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:33.675044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:33.675044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:33.676786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:33.676786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:33.676786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:33.676786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:33.676786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:33.676786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:33.676786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:33.676786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:33.676786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:33.676786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:33.676786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:33.676786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:33.676786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:33.676786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:33.676786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 486/957] 10.222.0.71 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:33.681696 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6688c5-1f89-4742-b405-32e1f6f26dc7 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:33.708233 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:33.802025 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6688c5-1f89-4742-b405-32e1f6f26dc7 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:33.839694 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acdfe5-5674-4073-816b-1c7e9597441a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:33.840562 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acdfe5-5674-4073-816b-1c7e9597441a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.840980 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acdfe5-5674-4073-816b-1c7e9597441a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.841392 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acdfe5-5674-4073-816b-1c7e9597441a None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.842423 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acdfe5-5674-4073-816b-1c7e9597441a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:33.842918 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acdfe5-5674-4073-816b-1c7e9597441a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:33.844417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acdfe5-5674-4073-816b-1c7e9597441a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:33.850043 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 472/958] 10.222.0.71 () {56 vars in 1122 bytes} [Thu Sep 1 16:20:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:33.858244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10739d77-59e4-42d1-8a53-6fa6ffeeb1de None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:33.894538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:33.973601 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10739d77-59e4-42d1-8a53-6fa6ffeeb1de None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:34.012303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31ee80-f3f7-420c-8b11-ccba99319a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:34.013257 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31ee80-f3f7-420c-8b11-ccba99319a30 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:34.013741 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31ee80-f3f7-420c-8b11-ccba99319a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:34.014226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31ee80-f3f7-420c-8b11-ccba99319a30 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:34.015083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31ee80-f3f7-420c-8b11-ccba99319a30 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:34.015653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31ee80-f3f7-420c-8b11-ccba99319a30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:34.017191 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31ee80-f3f7-420c-8b11-ccba99319a30 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:34.026264 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 487/959] 10.222.0.71 () {56 vars in 1122 bytes} [Thu Sep 1 16:20:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:34.035665 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acdfe5-5674-4073-816b-1c7e9597441a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:34.122679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:34.141205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acdfe5-5674-4073-816b-1c7e9597441a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:34.176159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838be83-60b2-451e-8589-96bbc6075a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:34.176770 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838be83-60b2-451e-8589-96bbc6075a24 None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:34.177048 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838be83-60b2-451e-8589-96bbc6075a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:34.177320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838be83-60b2-451e-8589-96bbc6075a24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:34.177992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838be83-60b2-451e-8589-96bbc6075a24 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:34.179376 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838be83-60b2-451e-8589-96bbc6075a24 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:34.202050 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 473/960] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:20:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:34.517026 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8e1a6-6dee-4060-a3c9-a3f187c98581 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:34.517421 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8e1a6-6dee-4060-a3c9-a3f187c98581 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:34.517626 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8e1a6-6dee-4060-a3c9-a3f187c98581 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:34.519215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 488/961] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:34.524399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844f23b-6b01-467f-a4c8-dda307025cfc None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:34.524693 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844f23b-6b01-467f-a4c8-dda307025cfc None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:34.524970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844f23b-6b01-467f-a4c8-dda307025cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:34.543893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-2844f23b-6b01-467f-a4c8-dda307025cfc None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:34.545080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2844f23b-6b01-467f-a4c8-dda307025cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:34.632768 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 474/962] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:34.920745 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8e1a6-6dee-4060-a3c9-a3f187c98581 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:35.023544 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:35.032161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8e1a6-6dee-4060-a3c9-a3f187c98581 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:35.067753 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af390d2-8377-45ff-8cb6-ee56f700726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:35.068361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af390d2-8377-45ff-8cb6-ee56f700726a None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:35.068639 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af390d2-8377-45ff-8cb6-ee56f700726a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:35.068909 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af390d2-8377-45ff-8cb6-ee56f700726a None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:35.069562 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af390d2-8377-45ff-8cb6-ee56f700726a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:35.071481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af390d2-8377-45ff-8cb6-ee56f700726a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:35.087760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 489/963] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Sep 1 16:20:34 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:35.280429 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752afcb1-421f-47ac-bc11-60bc47019e9f None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:35.281247 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752afcb1-421f-47ac-bc11-60bc47019e9f None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:35.281780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752afcb1-421f-47ac-bc11-60bc47019e9f None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:35.283605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 475/964] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:35.292046 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c91fb7-e76f-4563-b8c0-f5002e0abe0c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:35.292332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c91fb7-e76f-4563-b8c0-f5002e0abe0c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:35.292609 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c91fb7-e76f-4563-b8c0-f5002e0abe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:35.315002 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-56c91fb7-e76f-4563-b8c0-f5002e0abe0c None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:35.316703 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-56c91fb7-e76f-4563-b8c0-f5002e0abe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:35.399426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 490/965] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:35.667753 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752afcb1-421f-47ac-bc11-60bc47019e9f None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:35.738267 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:35.779312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752afcb1-421f-47ac-bc11-60bc47019e9f None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:35.804098 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f007dc7-e987-4fb9-ad38-c945efaccee6 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:35.804422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f007dc7-e987-4fb9-ad38-c945efaccee6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:35.804719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f007dc7-e987-4fb9-ad38-c945efaccee6 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:35.806357 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 491/966] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:35.811114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192490a-7d13-4d39-941b-fb132983186c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:35.811517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192490a-7d13-4d39-941b-fb132983186c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:35.811890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192490a-7d13-4d39-941b-fb132983186c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:35.814783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77e5bb-40f7-466f-97c9-d26243dda2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:35.815411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77e5bb-40f7-466f-97c9-d26243dda2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:35.815690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77e5bb-40f7-466f-97c9-d26243dda2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:35.815961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77e5bb-40f7-466f-97c9-d26243dda2f7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:35.828286 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77e5bb-40f7-466f-97c9-d26243dda2f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:35.830455 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2192490a-7d13-4d39-941b-fb132983186c None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:35.831674 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2192490a-7d13-4d39-941b-fb132983186c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:35.833193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-8a77e5bb-40f7-466f-97c9-d26243dda2f7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:20:35.833193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:35.833193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:35.833193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:35.833193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:35.833193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:35.833193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:35.833193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:35.833193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:35.833193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:35.833193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:35.833193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:35.833193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:35.833193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:35.833193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:35.833193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:35.834220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:35.834220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:35.834220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:35.834220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:35.834220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:35.834220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:35.834220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:35.834220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:35.834220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:35.834220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:35.834220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:35.834220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:35.834220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:35.834220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:35.834220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:35.834220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:35.835199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:35.835199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:35.835199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:35.835199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:35.835199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:35.835199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:35.835199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:35.835199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:35.835199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:35.835199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:35.835199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:20:35.835199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:35.835199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 476/967] 10.222.0.71 () {56 vars in 1120 bytes} [Thu Sep 1 16:20:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:35.840771 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77e5bb-40f7-466f-97c9-d26243dda2f7 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:35.931357 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 492/968] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:35.957389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77e5bb-40f7-466f-97c9-d26243dda2f7 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:35.982957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:35.994218 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d6b9b-34c1-423c-8a93-dc342dd03c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:35.994894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d6b9b-34c1-423c-8a93-dc342dd03c20 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:35.995175 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d6b9b-34c1-423c-8a93-dc342dd03c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:35.995500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d6b9b-34c1-423c-8a93-dc342dd03c20 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:35.996224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d6b9b-34c1-423c-8a93-dc342dd03c20 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:35.996533 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d6b9b-34c1-423c-8a93-dc342dd03c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:35.997908 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d6b9b-34c1-423c-8a93-dc342dd03c20 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:36.006549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 477/969] 10.222.0.71 () {56 vars in 1115 bytes} [Thu Sep 1 16:20:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:36.012281 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192490a-7d13-4d39-941b-fb132983186c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:36.031780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:36.120500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192490a-7d13-4d39-941b-fb132983186c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:36.156199 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8693c4-44a7-410e-9ba1-35b7eceae276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:36.157161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8693c4-44a7-410e-9ba1-35b7eceae276 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:36.157599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8693c4-44a7-410e-9ba1-35b7eceae276 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:36.158037 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8693c4-44a7-410e-9ba1-35b7eceae276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:36.168435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8693c4-44a7-410e-9ba1-35b7eceae276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:36.170117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8693c4-44a7-410e-9ba1-35b7eceae276 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:36.180603 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01ef9a-002c-4905-a7c4-6c25bc4aa6a7 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:36.180889 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01ef9a-002c-4905-a7c4-6c25bc4aa6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:36.181164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01ef9a-002c-4905-a7c4-6c25bc4aa6a7 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:36.182839 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 478/970] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:36.185926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-0f8693c4-44a7-410e-9ba1-35b7eceae276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:36.185926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:36.185926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:36.185926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:36.185926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:36.185926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:36.185926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:36.185926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:36.185926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:36.185926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:36.185926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:36.185926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:36.185926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:36.185926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:36.185926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:36.185926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:36.187127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:36.187127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:36.187127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:36.187127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:36.187127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:36.187127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:36.187127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:36.187127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:36.187127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:36.187127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:36.187127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:36.187127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:36.187127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:36.187127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:36.187127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:36.187127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:36.187127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:36.188244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:36.188244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:36.188244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:36.188463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349ee5b-c896-460b-bc58-07429a03b4e4 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:36.188463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349ee5b-c896-460b-bc58-07429a03b4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:36.188463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349ee5b-c896-460b-bc58-07429a03b4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:36.190158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 493/971] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:36.196422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8693c4-44a7-410e-9ba1-35b7eceae276 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:36.209156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-6349ee5b-c896-460b-bc58-07429a03b4e4 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:36.211056 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6349ee5b-c896-460b-bc58-07429a03b4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:36.267925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:36.289449 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 479/972] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:36.290912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349ee5b-c896-460b-bc58-07429a03b4e4 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:36.314725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8693c4-44a7-410e-9ba1-35b7eceae276 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:36.352058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82f07a-80fc-4515-8cae-c08114fae2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:36.352822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82f07a-80fc-4515-8cae-c08114fae2ae None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:36.353165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82f07a-80fc-4515-8cae-c08114fae2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:36.353507 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82f07a-80fc-4515-8cae-c08114fae2ae None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:36.354370 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82f07a-80fc-4515-8cae-c08114fae2ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:36.354769 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82f07a-80fc-4515-8cae-c08114fae2ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:36.356310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82f07a-80fc-4515-8cae-c08114fae2ae None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:36.374310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 494/973] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:36.375278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82f07a-80fc-4515-8cae-c08114fae2ae None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:36.417689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349ee5b-c896-460b-bc58-07429a03b4e4 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:36.436921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:36.456954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caec986-7c3b-49b7-a5e0-8ee7cfc0fc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:36.457418 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec986-7c3b-49b7-a5e0-8ee7cfc0fc04 None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:36.457699 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec986-7c3b-49b7-a5e0-8ee7cfc0fc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:36.457967 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec986-7c3b-49b7-a5e0-8ee7cfc0fc04 None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:36.458624 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caec986-7c3b-49b7-a5e0-8ee7cfc0fc04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:36.460080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caec986-7c3b-49b7-a5e0-8ee7cfc0fc04 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:36.462753 dv-cinder-852208-16-smb devstack@keystone.service[81498]: WARNING keystone.server.flask.common [None req-2caec986-7c3b-49b7-a5e0-8ee7cfc0fc04 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 16:20:36.476078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.sql.core [None req-2caec986-7c3b-49b7-a5e0-8ee7cfc0fc04 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 16:20:36.476078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 16:20:36.476078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [parameters: {'user_id': '16e54d62b9764b3c98204d6af2e35c06', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 16:20:36.476078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81498) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 16:20:36.489576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82f07a-80fc-4515-8cae-c08114fae2ae None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:36.494408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-2caec986-7c3b-49b7-a5e0-8ee7cfc0fc04 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 16:20:36.494408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:36.494408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:20:36.494408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:20:36.494408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:20:36.494408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:20:36.494408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:20:36.494408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:20:36.494408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:20:36.494408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:20:36.494408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:20:36.494408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:20:36.494408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:20:36.494408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application result.read() Sep 01 16:20:36.494408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:20:36.495525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:20:36.496748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 16:20:36.496748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application yield resource Sep 01 16:20:36.496748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:20:36.496748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:20:36.496748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 16:20:36.496748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 16:20:36.496748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 16:20:36.496748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 16:20:36.496748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 16:20:36.496748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise self.value Sep 01 16:20:36.496748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 16:20:36.496748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 16:20:36.496748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 16:20:36.496748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application session.commit() Sep 01 16:20:36.496748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 16:20:36.496748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 16:20:36.496748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 16:20:36.497687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 16:20:36.497687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 16:20:36.497687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self.session.flush() Sep 01 16:20:36.497687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 16:20:36.497687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 16:20:36.497687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 16:20:36.497687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 16:20:36.497687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 16:20:36.497687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application compat.raise_( Sep 01 16:20:36.497687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:20:36.497687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception Sep 01 16:20:36.497687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 16:20:36.497687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 16:20:36.497687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 16:20:36.497687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 16:20:36.497687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 16:20:36.497687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 16:20:36.498873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 16:20:36.498873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 16:20:36.498873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 16:20:36.498873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 01 16:20:36.498873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 16:20:36.498873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 16:20:36.498873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 16:20:36.498873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 16:20:36.498873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 16:20:36.498873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 16:20:36.498873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 16:20:36.498873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 16:20:36.498873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 16:20:36.498873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 16:20:36.498873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:20:36.498873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception Sep 01 16:20:36.499750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:20:36.499750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:20:36.499750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:20:36.499750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:20:36.499750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:20:36.499750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:20:36.499750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:20:36.499750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:20:36.499750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:20:36.499750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:20:36.499750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:20:36.499750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application result.read() Sep 01 16:20:36.499750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:20:36.499750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:20:36.499750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:20:36.499750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:20:36.500671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:20:36.500671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:20:36.500671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:20:36.500671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:20:36.500671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 16:20:36.500671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 16:20:36.500671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [parameters: {'user_id': '16e54d62b9764b3c98204d6af2e35c06', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 16:20:36.500671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 16:20:36.500671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:36.500671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:36.500671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:36.500671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:36.500671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:36.500671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:36.500671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:36.501685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:36.501685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:36.501685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:36.501685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:36.501685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:36.501685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:36.501685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:36.501685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 01 16:20:36.501685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 01 16:20:36.501685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:36.501685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:36.501685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:36.501685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:36.501685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:36.501685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:36.501685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 01 16:20:36.501685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 01 16:20:36.503205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 01 16:20:36.503205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 01 16:20:36.503205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 16:20:36.503205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 16:20:36.503205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 16:20:36.503205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:36.503205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 480/974] 10.222.0.71 () {60 vars in 1131 bytes} [Thu Sep 1 16:20:36 2022] POST /identity/v3/users => generated 160 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:36.503205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caec986-7c3b-49b7-a5e0-8ee7cfc0fc04 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:36.526603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:36.541291 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78b557-53d0-47ca-8512-ec71150ecb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:36.545671 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78b557-53d0-47ca-8512-ec71150ecb37 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:36.547087 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78b557-53d0-47ca-8512-ec71150ecb37 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:36.547525 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78b557-53d0-47ca-8512-ec71150ecb37 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:36.556549 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78b557-53d0-47ca-8512-ec71150ecb37 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:36.558347 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78b557-53d0-47ca-8512-ec71150ecb37 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:36.572819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-1f78b557-53d0-47ca-8512-ec71150ecb37 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:36.572819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:36.572819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:36.572819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:36.572819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:36.572819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:36.572819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:36.572819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:36.572819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:36.572819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:36.572819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:36.572819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:36.572819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:36.572819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:36.572819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:36.572819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:36.574014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:36.575120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:36.575120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:36.575120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:36.575120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:36.575120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:36.575120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:36.575120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:36.575120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:36.575120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:36.575120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:36.581749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 495/975] 10.222.0.71 () {56 vars in 1117 bytes} [Thu Sep 1 16:20:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:36.583054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78b557-53d0-47ca-8512-ec71150ecb37 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:36.619542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caec986-7c3b-49b7-a5e0-8ee7cfc0fc04 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:36.654374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f750c2c-3d27-4776-a33f-a673a9526c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:36.655297 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f750c2c-3d27-4776-a33f-a673a9526c2a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:36.655577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f750c2c-3d27-4776-a33f-a673a9526c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:36.655838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f750c2c-3d27-4776-a33f-a673a9526c2a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:36.663215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f750c2c-3d27-4776-a33f-a673a9526c2a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:36.665361 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f750c2c-3d27-4776-a33f-a673a9526c2a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:36.677228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-8f750c2c-3d27-4776-a33f-a673a9526c2a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:20:36.677228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:36.677228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:36.677228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:36.677228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:36.677228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:36.677228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:36.677228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:36.677228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:36.677228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:36.677228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:36.677228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:36.677228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:36.677228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:36.677228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:36.677228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:36.678270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:36.679266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:36.679266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:36.679266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:36.679266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:36.679266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:36.679266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:36.679266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:36.679266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:36.679266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:20:36.679266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:36.679266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 481/976] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:36.684022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f750c2c-3d27-4776-a33f-a673a9526c2a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:36.695931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78b557-53d0-47ca-8512-ec71150ecb37 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:36.725314 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:36.731262 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633c2e6-6a29-4d9e-93b9-81940736e641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:36.731869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633c2e6-6a29-4d9e-93b9-81940736e641 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:36.732143 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633c2e6-6a29-4d9e-93b9-81940736e641 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:36.732413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633c2e6-6a29-4d9e-93b9-81940736e641 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:36.733146 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633c2e6-6a29-4d9e-93b9-81940736e641 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:36.733440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633c2e6-6a29-4d9e-93b9-81940736e641 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:36.734887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633c2e6-6a29-4d9e-93b9-81940736e641 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:36.757456 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 496/977] 10.222.0.71 () {56 vars in 1149 bytes} [Thu Sep 1 16:20:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:36.758111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633c2e6-6a29-4d9e-93b9-81940736e641 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:36.796299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f750c2c-3d27-4776-a33f-a673a9526c2a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:36.805374 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:36.831828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb82b8-d93d-4b04-9dcb-2015015eeb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:36.832453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb82b8-d93d-4b04-9dcb-2015015eeb74 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:36.832727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb82b8-d93d-4b04-9dcb-2015015eeb74 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:36.832995 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb82b8-d93d-4b04-9dcb-2015015eeb74 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:36.833581 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb82b8-d93d-4b04-9dcb-2015015eeb74 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:36.834974 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb82b8-d93d-4b04-9dcb-2015015eeb74 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:36.844910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-f9cb82b8-d93d-4b04-9dcb-2015015eeb74 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:36.844910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:36.844910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:36.844910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:36.844910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:36.844910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:36.844910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:36.844910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:36.844910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:36.844910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:36.844910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:36.844910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:36.844910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:36.844910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:36.844910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:36.844910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:36.844910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:36.845954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:36.845954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:36.845954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:36.845954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:36.845954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:36.845954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:36.845954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:36.845954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:36.845954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:36.845954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:36.845954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:36.845954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:36.845954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:36.845954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:36.845954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:36.845954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:36.846867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:36.846867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:36.846867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:36.846867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:36.846867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:36.846867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:36.846867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:36.846867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:36.846867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:36.846867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:36.846867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:36.846867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:36.846867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:36.846867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:36.846867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 482/978] 10.222.0.71 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:36.847674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb82b8-d93d-4b04-9dcb-2015015eeb74 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:36.870198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633c2e6-6a29-4d9e-93b9-81940736e641 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:36.910995 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3513a88-a5b5-443c-8291-b2ed6e8a9b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:36.911742 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3513a88-a5b5-443c-8291-b2ed6e8a9b92 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:36.912017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3513a88-a5b5-443c-8291-b2ed6e8a9b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:36.912284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3513a88-a5b5-443c-8291-b2ed6e8a9b92 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:36.912971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3513a88-a5b5-443c-8291-b2ed6e8a9b92 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:36.913267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3513a88-a5b5-443c-8291-b2ed6e8a9b92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:36.914726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3513a88-a5b5-443c-8291-b2ed6e8a9b92 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:36.955398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 497/979] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Sep 1 16:20:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:36.956162 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb82b8-d93d-4b04-9dcb-2015015eeb74 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:36.956336 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3513a88-a5b5-443c-8291-b2ed6e8a9b92 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:36.971780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:37.000189 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9315f-564b-4cf7-b33d-dfffdba40794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:37.000803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9315f-564b-4cf7-b33d-dfffdba40794 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.001083 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9315f-564b-4cf7-b33d-dfffdba40794 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.001358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9315f-564b-4cf7-b33d-dfffdba40794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.091866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9315f-564b-4cf7-b33d-dfffdba40794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:37.092627 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:37.093953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9315f-564b-4cf7-b33d-dfffdba40794 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:37.096702 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3513a88-a5b5-443c-8291-b2ed6e8a9b92 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:37.144010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d71be-8691-4c5d-bfc2-6c048a9181b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:37.144623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d71be-8691-4c5d-bfc2-6c048a9181b2 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.144904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d71be-8691-4c5d-bfc2-6c048a9181b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.145176 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d71be-8691-4c5d-bfc2-6c048a9181b2 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.145815 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d71be-8691-4c5d-bfc2-6c048a9181b2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:37.146666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d71be-8691-4c5d-bfc2-6c048a9181b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:37.147505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d71be-8691-4c5d-bfc2-6c048a9181b2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:37.154021 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 498/980] 10.222.0.71 () {56 vars in 1122 bytes} [Thu Sep 1 16:20:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:37.155626 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50fa2-ed8f-4e4e-9750-30d7d58ad91c None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.156167 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50fa2-ed8f-4e4e-9750-30d7d58ad91c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.156600 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50fa2-ed8f-4e4e-9750-30d7d58ad91c None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.158310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 499/981] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:37.160059 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f50fa2-ed8f-4e4e-9750-30d7d58ad91c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:37.212421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 483/982] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:36 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:20:37.213700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172446c6-5cab-41ce-8b5a-27334f4edd9e None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.213988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172446c6-5cab-41ce-8b5a-27334f4edd9e None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.214262 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172446c6-5cab-41ce-8b5a-27334f4edd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.220605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:37.233633 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-172446c6-5cab-41ce-8b5a-27334f4edd9e None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:37.235186 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-172446c6-5cab-41ce-8b5a-27334f4edd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:37.267317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f50fa2-ed8f-4e4e-9750-30d7d58ad91c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:37.300681 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2afab8-d513-4e4e-acc6-d0b79f4878f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:37.301250 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 484/983] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:37.301708 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2afab8-d513-4e4e-acc6-d0b79f4878f9 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.301708 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2afab8-d513-4e4e-acc6-d0b79f4878f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.301849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2afab8-d513-4e4e-acc6-d0b79f4878f9 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.302075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172446c6-5cab-41ce-8b5a-27334f4edd9e None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:37.302482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2afab8-d513-4e4e-acc6-d0b79f4878f9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:37.302819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2afab8-d513-4e4e-acc6-d0b79f4878f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:37.304163 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2afab8-d513-4e4e-acc6-d0b79f4878f9 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:37.309524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 500/984] 10.222.0.71 () {56 vars in 1122 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:37.315264 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2afab8-d513-4e4e-acc6-d0b79f4878f9 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:37.345044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:37.413149 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172446c6-5cab-41ce-8b5a-27334f4edd9e None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:37.423433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2afab8-d513-4e4e-acc6-d0b79f4878f9 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:37.444691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:37.450110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec4b82-afdc-46da-ab31-ec0df91f8ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:37.450844 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec4b82-afdc-46da-ab31-ec0df91f8ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.451127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec4b82-afdc-46da-ab31-ec0df91f8ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.451407 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec4b82-afdc-46da-ab31-ec0df91f8ad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.460216 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50db17f-3300-447c-b800-f9cf46f5a3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:37.460875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50db17f-3300-447c-b800-f9cf46f5a3ba None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.461123 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50db17f-3300-447c-b800-f9cf46f5a3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.461413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50db17f-3300-447c-b800-f9cf46f5a3ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.461797 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec4b82-afdc-46da-ab31-ec0df91f8ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:37.462116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50db17f-3300-447c-b800-f9cf46f5a3ba None admin] RBAC: Adding query filter params (interface=admin, service_id=6c83c3f82f6f4b66a1cc883ffd447965, region_id=RegionOne) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:37.462477 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50db17f-3300-447c-b800-f9cf46f5a3ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:37.463267 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec4b82-afdc-46da-ab31-ec0df91f8ad4 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:37.463831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50db17f-3300-447c-b800-f9cf46f5a3ba None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:37.469317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 501/985] 10.222.0.71 () {56 vars in 1249 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/endpoints?service_id=6c83c3f82f6f4b66a1cc883ffd447965&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:37.474553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50db17f-3300-447c-b800-f9cf46f5a3ba None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:37.478921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-b7ec4b82-afdc-46da-ab31-ec0df91f8ad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:37.478921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:37.478921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:37.478921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:37.478921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:37.478921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:37.478921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:37.478921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:37.478921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:37.478921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:37.478921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:37.478921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:37.478921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:37.478921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:37.478921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:37.478921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:37.479914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:37.479914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:37.479914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:37.479914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:37.479914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:37.479914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:37.479914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:37.479914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:37.479914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:37.479914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:37.479914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:37.479914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:37.479914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:37.479914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:37.479914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:37.479914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:37.479914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:37.480841 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:37.480841 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:37.480841 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:37.480841 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 485/986] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:37.485431 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec4b82-afdc-46da-ab31-ec0df91f8ad4 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:37.576237 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:37.585479 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50db17f-3300-447c-b800-f9cf46f5a3ba None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:37.587959 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec4b82-afdc-46da-ab31-ec0df91f8ad4 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:37.620152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7353b-f425-43c9-b847-ec1f96868d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:37.620754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7353b-f425-43c9-b847-ec1f96868d2d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.621032 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7353b-f425-43c9-b847-ec1f96868d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.621302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7353b-f425-43c9-b847-ec1f96868d2d None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.621904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7353b-f425-43c9-b847-ec1f96868d2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:37.623304 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7353b-f425-43c9-b847-ec1f96868d2d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:37.623916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f06d3-b0bf-4f3a-aa79-2fcfa035c87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:37.624519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f06d3-b0bf-4f3a-aa79-2fcfa035c87c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.624825 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f06d3-b0bf-4f3a-aa79-2fcfa035c87c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.625071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f06d3-b0bf-4f3a-aa79-2fcfa035c87c None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.625719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f06d3-b0bf-4f3a-aa79-2fcfa035c87c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:37.626017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f06d3-b0bf-4f3a-aa79-2fcfa035c87c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:37.627388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f06d3-b0bf-4f3a-aa79-2fcfa035c87c None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:37.630037 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 502/987] 10.222.0.71 () {56 vars in 1087 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:20:37.630480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7353b-f425-43c9-b847-ec1f96868d2d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:37.651230 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 486/988] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:37.653008 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f06d3-b0bf-4f3a-aa79-2fcfa035c87c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:37.713472 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:37.746306 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7353b-f425-43c9-b847-ec1f96868d2d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:37.777080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f06d3-b0bf-4f3a-aa79-2fcfa035c87c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:37.784936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31264ca-3b28-46a2-8e66-5d1b5463e270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:37.785568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31264ca-3b28-46a2-8e66-5d1b5463e270 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.785849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31264ca-3b28-46a2-8e66-5d1b5463e270 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.786120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31264ca-3b28-46a2-8e66-5d1b5463e270 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.786757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31264ca-3b28-46a2-8e66-5d1b5463e270 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:37.788106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31264ca-3b28-46a2-8e66-5d1b5463e270 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:37.800330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-f31264ca-3b28-46a2-8e66-5d1b5463e270 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:20:37.800330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:37.800330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:37.800330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:37.800330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:37.800330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:37.800330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:37.800330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:37.800330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:20:37.800330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:37.800330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:37.800330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:37.800330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:37.800330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:37.800330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:37.800330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:37.800330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:37.802987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:37.802987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:37.802987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:37.802987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:37.802987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:37.802987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:37.802987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:37.802987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:37.802987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:37.802987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:37.802987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:37.802987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:37.802987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:37.802987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:37.802987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:37.802987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:37.803872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:37.803872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:37.803872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:37.803872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:37.803872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:37.803872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:37.803872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:37.803872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:37.803872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:37.803872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:37.803872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:37.803872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:37.803872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:20:37.803872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:37.803872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 503/989] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:37.807683 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31264ca-3b28-46a2-8e66-5d1b5463e270 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:37.821282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad29ce-5fc3-42c1-bc61-c3aa3ea75287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:37.821914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad29ce-5fc3-42c1-bc61-c3aa3ea75287 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.822194 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad29ce-5fc3-42c1-bc61-c3aa3ea75287 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.822474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad29ce-5fc3-42c1-bc61-c3aa3ea75287 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.829394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad29ce-5fc3-42c1-bc61-c3aa3ea75287 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:37.830574 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:37.830849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad29ce-5fc3-42c1-bc61-c3aa3ea75287 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:37.843330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-55ad29ce-5fc3-42c1-bc61-c3aa3ea75287 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:37.843330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:37.843330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:37.843330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:37.843330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:37.843330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:37.843330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:37.843330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:37.843330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:37.843330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:37.843330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:37.843330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:37.843330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:37.843330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:37.843330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:37.844461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:37.844461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:37.844461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:37.844461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:37.844461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:37.844461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:37.844461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:37.844461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:37.844461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:37.844461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:37.844461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:37.844461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:37.844461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:37.844461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:37.844461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:37.844461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:37.844461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:37.845743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:37.845743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:37.845743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:37.845743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:37.845743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:37.845743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:37.845743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:37.845743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:37.845743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 487/990] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:37.850091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad29ce-5fc3-42c1-bc61-c3aa3ea75287 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:37.916597 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31264ca-3b28-46a2-8e66-5d1b5463e270 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:37.953770 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b890293-6d94-46a6-89fb-6adb4a08876e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:37.954576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890293-6d94-46a6-89fb-6adb4a08876e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.954990 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890293-6d94-46a6-89fb-6adb4a08876e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.955383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890293-6d94-46a6-89fb-6adb4a08876e None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.956124 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b890293-6d94-46a6-89fb-6adb4a08876e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:37.956662 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b890293-6d94-46a6-89fb-6adb4a08876e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:37.957737 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad29ce-5fc3-42c1-bc61-c3aa3ea75287 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:37.958045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b890293-6d94-46a6-89fb-6adb4a08876e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:37.962401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:37.963864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 504/991] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:37.971641 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b890293-6d94-46a6-89fb-6adb4a08876e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:37.999892 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633951d5-eb62-4e07-ab0a-3f1a2fc205c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:38.000822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633951d5-eb62-4e07-ab0a-3f1a2fc205c5 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.001296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633951d5-eb62-4e07-ab0a-3f1a2fc205c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.001741 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633951d5-eb62-4e07-ab0a-3f1a2fc205c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.002631 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633951d5-eb62-4e07-ab0a-3f1a2fc205c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:38.003017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633951d5-eb62-4e07-ab0a-3f1a2fc205c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:38.004437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633951d5-eb62-4e07-ab0a-3f1a2fc205c5 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:38.016521 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 488/992] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:38.022261 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633951d5-eb62-4e07-ab0a-3f1a2fc205c5 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:38.065853 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:38.083856 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b890293-6d94-46a6-89fb-6adb4a08876e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:38.122448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bf4f9-b241-44e1-9f03-d5f8fe20d3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:38.123101 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bf4f9-b241-44e1-9f03-d5f8fe20d3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.123376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bf4f9-b241-44e1-9f03-d5f8fe20d3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.123641 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bf4f9-b241-44e1-9f03-d5f8fe20d3d7 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.124266 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bf4f9-b241-44e1-9f03-d5f8fe20d3d7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:38.124571 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bf4f9-b241-44e1-9f03-d5f8fe20d3d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:38.125922 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bf4f9-b241-44e1-9f03-d5f8fe20d3d7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:38.129449 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633951d5-eb62-4e07-ab0a-3f1a2fc205c5 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:38.130826 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 505/993] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:38.136921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bf4f9-b241-44e1-9f03-d5f8fe20d3d7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:38.166824 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ad104-6425-4957-96c3-48cee875204d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:38.167421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ad104-6425-4957-96c3-48cee875204d None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.167698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ad104-6425-4957-96c3-48cee875204d None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.167968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ad104-6425-4957-96c3-48cee875204d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.168690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ad104-6425-4957-96c3-48cee875204d None admin] RBAC: Adding query filter params (role.id=0d6c0de77625409c8fe68e983df3a394, scope.project.id=9527063094354a99a80822107d2740fb, user.id=cd0dbb2c140946f69c3f508b4184e998) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:38.168997 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ad104-6425-4957-96c3-48cee875204d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:38.170409 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ad104-6425-4957-96c3-48cee875204d None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:38.186643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 489/994] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:38 2022] GET /identity/v3/role_assignments?user.id=cd0dbb2c140946f69c3f508b4184e998&scope.project.id=9527063094354a99a80822107d2740fb&role.id=0d6c0de77625409c8fe68e983df3a394 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:38.255725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bf4f9-b241-44e1-9f03-d5f8fe20d3d7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:38.292998 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd54d6b-6dd4-4202-9eac-e786c296af6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:38.293620 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd54d6b-6dd4-4202-9eac-e786c296af6b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.293897 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd54d6b-6dd4-4202-9eac-e786c296af6b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.294165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd54d6b-6dd4-4202-9eac-e786c296af6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.294902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd54d6b-6dd4-4202-9eac-e786c296af6b None admin] RBAC: Adding query filter params (interface=public, service_id=8a04f98b047e4724b2c19436922a2c1a, region_id=RegionOne) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:38.295210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd54d6b-6dd4-4202-9eac-e786c296af6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:38.296590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd54d6b-6dd4-4202-9eac-e786c296af6b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:38.307047 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 506/995] 10.222.0.71 () {56 vars in 1251 bytes} [Thu Sep 1 16:20:38 2022] GET /identity/v3/endpoints?service_id=8a04f98b047e4724b2c19436922a2c1a&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:38.308594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ad104-6425-4957-96c3-48cee875204d None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:38.339064 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:38.415245 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ad104-6425-4957-96c3-48cee875204d None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:38.449153 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da471391-e322-4671-a609-f3536e446ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:38.449890 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da471391-e322-4671-a609-f3536e446ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.450270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da471391-e322-4671-a609-f3536e446ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.450660 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da471391-e322-4671-a609-f3536e446ff8 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.451370 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da471391-e322-4671-a609-f3536e446ff8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:38.452832 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da471391-e322-4671-a609-f3536e446ff8 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:38.459361 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 490/996] 10.222.0.71 () {56 vars in 1087 bytes} [Thu Sep 1 16:20:38 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:20:39.558013 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28ef47-f0f3-4616-ad35-c8bffb4276ae None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:39.558540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28ef47-f0f3-4616-ad35-c8bffb4276ae None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:39.558540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28ef47-f0f3-4616-ad35-c8bffb4276ae None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:39.559941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 507/997] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:39.564989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8451f-1de6-4961-a9cf-f4382d3b7c53 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:39.565403 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8451f-1de6-4961-a9cf-f4382d3b7c53 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:39.565545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8451f-1de6-4961-a9cf-f4382d3b7c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:39.584632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-9aa8451f-1de6-4961-a9cf-f4382d3b7c53 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:39.585812 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-9aa8451f-1de6-4961-a9cf-f4382d3b7c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:39.662652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 491/998] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:39.933352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28ef47-f0f3-4616-ad35-c8bffb4276ae None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:39.949649 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:40.038018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28ef47-f0f3-4616-ad35-c8bffb4276ae None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:40.071094 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69826f9e-3211-41ce-b9b9-1bd1b6de921f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:40.071716 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69826f9e-3211-41ce-b9b9-1bd1b6de921f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:40.071987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69826f9e-3211-41ce-b9b9-1bd1b6de921f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:40.072251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69826f9e-3211-41ce-b9b9-1bd1b6de921f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:40.072834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69826f9e-3211-41ce-b9b9-1bd1b6de921f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:40.074180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69826f9e-3211-41ce-b9b9-1bd1b6de921f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:40.083202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-69826f9e-3211-41ce-b9b9-1bd1b6de921f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:40.083202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:40.083202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:40.083202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:40.083202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:40.083202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:40.083202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:40.083202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:40.083202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:40.083202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:40.083202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:40.083202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:40.083202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:40.083202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:40.083202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:40.083202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:40.083202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:40.084190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:40.084190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:40.084190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:40.084190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:40.084190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:40.084190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:40.084190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:40.084190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:40.084190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:40.084190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:40.084190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:40.084190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:40.084190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:40.084190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:40.084190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:40.084190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:40.085054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:40.085054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:40.085054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:40.085054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:40.085054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:40.085054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:40.085054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:40.085054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:40.085054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:40.085054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:40.085054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:40.085054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:40.085054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:40.085054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:40.089847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 508/999] 10.222.0.71 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:40.091145 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8451f-1de6-4961-a9cf-f4382d3b7c53 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:40.116327 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:40.133870 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6aaa9-4730-4631-ab48-3e697dafab73 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:40.134248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6aaa9-4730-4631-ab48-3e697dafab73 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:40.134459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6aaa9-4730-4631-ab48-3e697dafab73 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:40.135934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 509/1000] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:40.142267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19f435-042f-4b4e-9793-487ea4d68d5d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:40.142547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19f435-042f-4b4e-9793-487ea4d68d5d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:40.142850 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19f435-042f-4b4e-9793-487ea4d68d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:40.161947 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7e19f435-042f-4b4e-9793-487ea4d68d5d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:40.163219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7e19f435-042f-4b4e-9793-487ea4d68d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:40.203892 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8451f-1de6-4961-a9cf-f4382d3b7c53 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:40.236633 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 510/1001] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:40.242469 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5828f-fbb2-42b2-b664-30cf4db72d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:40.243118 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5828f-fbb2-42b2-b664-30cf4db72d00 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:40.243397 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5828f-fbb2-42b2-b664-30cf4db72d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:40.243668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5828f-fbb2-42b2-b664-30cf4db72d00 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:40.244307 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5828f-fbb2-42b2-b664-30cf4db72d00 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:40.244610 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5828f-fbb2-42b2-b664-30cf4db72d00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:40.245963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5828f-fbb2-42b2-b664-30cf4db72d00 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:40.250914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 492/1002] 10.222.0.71 () {56 vars in 1122 bytes} [Thu Sep 1 16:20:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:40.259935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19f435-042f-4b4e-9793-487ea4d68d5d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:40.268491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:40.361106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19f435-042f-4b4e-9793-487ea4d68d5d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:40.395063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18fdd5-5261-48f4-a6e2-8806559998bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:40.395668 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18fdd5-5261-48f4-a6e2-8806559998bf None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:40.395943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18fdd5-5261-48f4-a6e2-8806559998bf None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:40.396208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18fdd5-5261-48f4-a6e2-8806559998bf None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:40.396831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18fdd5-5261-48f4-a6e2-8806559998bf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:40.397127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18fdd5-5261-48f4-a6e2-8806559998bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:40.398472 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18fdd5-5261-48f4-a6e2-8806559998bf None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:40.403959 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 511/1003] 10.222.0.71 () {56 vars in 1122 bytes} [Thu Sep 1 16:20:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:40.408693 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a17b3-dae5-4c84-a317-00a965231d59 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:40.408986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a17b3-dae5-4c84-a317-00a965231d59 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:40.409264 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a17b3-dae5-4c84-a317-00a965231d59 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:40.409363 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18fdd5-5261-48f4-a6e2-8806559998bf None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:40.410759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 493/1004] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:40.415561 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3a6c4-20b7-4b3f-af5a-72b8a4d832b8 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:40.415847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3a6c4-20b7-4b3f-af5a-72b8a4d832b8 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:40.416121 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3a6c4-20b7-4b3f-af5a-72b8a4d832b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:40.433777 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-c7b3a6c4-20b7-4b3f-af5a-72b8a4d832b8 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:40.434977 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c7b3a6c4-20b7-4b3f-af5a-72b8a4d832b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:40.481807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:40.507637 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 494/1005] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:40.510971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3a6c4-20b7-4b3f-af5a-72b8a4d832b8 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:40.513393 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18fdd5-5261-48f4-a6e2-8806559998bf None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:40.530025 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:40.550328 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1eed0-628a-442e-8e7a-90b3a03b47ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:40.550960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1eed0-628a-442e-8e7a-90b3a03b47ae None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:40.551237 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1eed0-628a-442e-8e7a-90b3a03b47ae None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:40.551508 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1eed0-628a-442e-8e7a-90b3a03b47ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:40.552166 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1eed0-628a-442e-8e7a-90b3a03b47ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:40.553519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1eed0-628a-442e-8e7a-90b3a03b47ae None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:40.574670 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 512/1006] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:20:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:20:40.638043 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3a6c4-20b7-4b3f-af5a-72b8a4d832b8 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:40.682088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59b999-8e7c-4d9a-a963-685130b39d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:40.682917 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59b999-8e7c-4d9a-a963-685130b39d77 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:40.683190 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59b999-8e7c-4d9a-a963-685130b39d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:40.683451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59b999-8e7c-4d9a-a963-685130b39d77 None admin] PATH_INFO: `/v3/services/image` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:40.684037 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59b999-8e7c-4d9a-a963-685130b39d77 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:40.685408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59b999-8e7c-4d9a-a963-685130b39d77 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:40.695084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-ff59b999-8e7c-4d9a-a963-685130b39d77 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:20:40.695084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:40.695084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:40.695084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:40.695084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:40.695084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:40.695084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:40.695084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:40.695084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:20:40.695084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:40.695084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:40.695084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:40.695084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:40.695084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:40.695084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:40.695084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:40.695084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:40.696698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:40.696698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:40.696698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:40.696698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:40.696698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:40.696698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:40.696698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:40.696698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:40.696698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:40.696698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:40.696698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:40.696698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:40.696698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:40.696698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:40.696698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:40.696698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:40.697538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:40.697538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:40.697538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:40.697538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:40.697538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:40.697538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:40.697538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:40.697538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:40.697538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:40.697538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:40.697538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:40.697538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:40.697538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:20:40.697538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:40.697538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 495/1007] 10.222.0.71 () {56 vars in 1105 bytes} [Thu Sep 1 16:20:40 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:40.704392 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1eed0-628a-442e-8e7a-90b3a03b47ae None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:40.776167 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59b999-8e7c-4d9a-a963-685130b39d77 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:40.812064 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1eed0-628a-442e-8e7a-90b3a03b47ae None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:40.844121 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:40.851018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29bef9-d5a2-48fd-ba7a-c81221edefb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:40.851925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29bef9-d5a2-48fd-ba7a-c81221edefb2 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:40.852538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29bef9-d5a2-48fd-ba7a-c81221edefb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:40.853000 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29bef9-d5a2-48fd-ba7a-c81221edefb2 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:40.853636 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29bef9-d5a2-48fd-ba7a-c81221edefb2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:40.853941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29bef9-d5a2-48fd-ba7a-c81221edefb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:40.855336 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29bef9-d5a2-48fd-ba7a-c81221edefb2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:40.860629 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 513/1008] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:40.863152 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:40.866474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29bef9-d5a2-48fd-ba7a-c81221edefb2 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:40.889411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59b999-8e7c-4d9a-a963-685130b39d77 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:40.929024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c599db5-f7e0-4732-9c11-fd947fa6009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:40.929712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c599db5-f7e0-4732-9c11-fd947fa6009a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:40.930579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c599db5-f7e0-4732-9c11-fd947fa6009a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:40.930882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c599db5-f7e0-4732-9c11-fd947fa6009a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:40.931466 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c599db5-f7e0-4732-9c11-fd947fa6009a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:40.932828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c599db5-f7e0-4732-9c11-fd947fa6009a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:40.942642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-6c599db5-f7e0-4732-9c11-fd947fa6009a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:20:40.942642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:40.942642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:40.942642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:40.942642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:40.942642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:40.942642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:40.942642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:40.942642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:20:40.942642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:40.942642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:40.942642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:40.942642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:40.942642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:40.942642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:40.942642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:40.942642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:40.943668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:40.943668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:40.943668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:40.943668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:40.943668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:40.943668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:40.943668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:40.943668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:40.943668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:40.943668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:40.943668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:40.943668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:40.943668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:40.943668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:40.943668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:40.943668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:40.944528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:40.944528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:40.944528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:40.944528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:40.944528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:40.944528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:40.944528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:40.944528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:40.944528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:40.944528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:40.944528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:40.944528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:40.944528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:20:40.944528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:40.949148 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 496/1009] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:40.950228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c599db5-f7e0-4732-9c11-fd947fa6009a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:40.974973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29bef9-d5a2-48fd-ba7a-c81221edefb2 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:41.017251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc2cf8-5472-4ebb-bcbd-25594bcd11cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:41.018835 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc2cf8-5472-4ebb-bcbd-25594bcd11cf None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:41.019344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc2cf8-5472-4ebb-bcbd-25594bcd11cf None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:41.019846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc2cf8-5472-4ebb-bcbd-25594bcd11cf None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:41.020679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc2cf8-5472-4ebb-bcbd-25594bcd11cf None admin] RBAC: Adding query filter params (type=image) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:41.021436 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc2cf8-5472-4ebb-bcbd-25594bcd11cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:41.024415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc2cf8-5472-4ebb-bcbd-25594bcd11cf None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:41.038753 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 514/1010] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:41.060785 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c599db5-f7e0-4732-9c11-fd947fa6009a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:41.100145 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6db1b-07b6-4769-ad7b-9632aa0abb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:41.100755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6db1b-07b6-4769-ad7b-9632aa0abb1a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:41.101035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6db1b-07b6-4769-ad7b-9632aa0abb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:41.101306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6db1b-07b6-4769-ad7b-9632aa0abb1a None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:41.102533 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6db1b-07b6-4769-ad7b-9632aa0abb1a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:41.102868 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6db1b-07b6-4769-ad7b-9632aa0abb1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:41.104250 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6db1b-07b6-4769-ad7b-9632aa0abb1a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:41.109670 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 497/1011] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:41.115804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc2cf8-5472-4ebb-bcbd-25594bcd11cf None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:41.182451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:41.225528 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc2cf8-5472-4ebb-bcbd-25594bcd11cf None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:41.260404 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a7e31-7e94-4161-b0aa-e1e67e6e0336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:41.261016 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a7e31-7e94-4161-b0aa-e1e67e6e0336 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:41.261291 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a7e31-7e94-4161-b0aa-e1e67e6e0336 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:41.261560 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a7e31-7e94-4161-b0aa-e1e67e6e0336 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:41.262188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a7e31-7e94-4161-b0aa-e1e67e6e0336 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:41.262547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a7e31-7e94-4161-b0aa-e1e67e6e0336 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:41.263958 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a7e31-7e94-4161-b0aa-e1e67e6e0336 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:41.269085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 515/1012] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:41.274814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6db1b-07b6-4769-ad7b-9632aa0abb1a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:41.278703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:41.376973 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6db1b-07b6-4769-ad7b-9632aa0abb1a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:41.409706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a00cd1-94c0-4ee2-b429-bded5d49b92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:41.410385 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a00cd1-94c0-4ee2-b429-bded5d49b92f None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:41.410762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a00cd1-94c0-4ee2-b429-bded5d49b92f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:41.411100 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a00cd1-94c0-4ee2-b429-bded5d49b92f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:41.411844 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a00cd1-94c0-4ee2-b429-bded5d49b92f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:41.413255 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a00cd1-94c0-4ee2-b429-bded5d49b92f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:41.442653 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 498/1013] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:20:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:42.533520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c9585-11f3-4501-b3f8-7ecc863ed325 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:42.534158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c9585-11f3-4501-b3f8-7ecc863ed325 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:42.534158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c9585-11f3-4501-b3f8-7ecc863ed325 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:42.535475 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 516/1014] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:42.541200 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f328d-795f-4dda-a7e2-e8bacffb48f6 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:42.541589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f328d-795f-4dda-a7e2-e8bacffb48f6 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:42.541770 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f328d-795f-4dda-a7e2-e8bacffb48f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:42.559913 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-2e4f328d-795f-4dda-a7e2-e8bacffb48f6 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:42.561108 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2e4f328d-795f-4dda-a7e2-e8bacffb48f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:42.628927 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:42.649544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 499/1015] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:42 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:42.946166 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c9585-11f3-4501-b3f8-7ecc863ed325 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:42.970027 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aeb35b-bb10-4fbd-9534-d77d7f1b4550 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:42.970312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aeb35b-bb10-4fbd-9534-d77d7f1b4550 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:42.970589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aeb35b-bb10-4fbd-9534-d77d7f1b4550 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:42.972095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 500/1016] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:42.977037 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18acc80-b4d0-4451-97fd-15b428919937 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:42.977322 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18acc80-b4d0-4451-97fd-15b428919937 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:42.977599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18acc80-b4d0-4451-97fd-15b428919937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:42.996970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-b18acc80-b4d0-4451-97fd-15b428919937 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:42.998169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b18acc80-b4d0-4451-97fd-15b428919937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:43.070521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c9585-11f3-4501-b3f8-7ecc863ed325 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:43.071705 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 501/1017] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:42 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:43.098245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:43.111462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e67e0f-0d4b-4202-b62f-b58431e38551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:43.112397 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e67e0f-0d4b-4202-b62f-b58431e38551 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:43.112931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e67e0f-0d4b-4202-b62f-b58431e38551 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:43.113405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e67e0f-0d4b-4202-b62f-b58431e38551 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:43.114764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e67e0f-0d4b-4202-b62f-b58431e38551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:43.116423 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e67e0f-0d4b-4202-b62f-b58431e38551 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:43.119090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 517/1018] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:43.124611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18acc80-b4d0-4451-97fd-15b428919937 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:43.226294 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18acc80-b4d0-4451-97fd-15b428919937 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:43.243396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:43.263418 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6cd20-818f-4876-a96b-b32c6f4c7d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:43.264069 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6cd20-818f-4876-a96b-b32c6f4c7d3d None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:43.264343 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6cd20-818f-4876-a96b-b32c6f4c7d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:43.264619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6cd20-818f-4876-a96b-b32c6f4c7d3d None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:43.265325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6cd20-818f-4876-a96b-b32c6f4c7d3d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:43.266781 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6cd20-818f-4876-a96b-b32c6f4c7d3d None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:43.298663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 502/1019] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Sep 1 16:20:43 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:43.350277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e67e0f-0d4b-4202-b62f-b58431e38551 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:43.457546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74c6dd-d988-4187-b5a9-55ad27fe5059 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:43.457829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74c6dd-d988-4187-b5a9-55ad27fe5059 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:43.458101 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74c6dd-d988-4187-b5a9-55ad27fe5059 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:43.460209 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 503/1020] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:43.462198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e67e0f-0d4b-4202-b62f-b58431e38551 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:43.468132 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd781044-d993-4587-a877-09052b05392b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:43.468412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd781044-d993-4587-a877-09052b05392b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:43.469444 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd781044-d993-4587-a877-09052b05392b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:43.489858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-bd781044-d993-4587-a877-09052b05392b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:43.491051 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-bd781044-d993-4587-a877-09052b05392b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:43.504148 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c1f5d-e7eb-4bf5-a4eb-9aa2a896ef47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:43.504762 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c1f5d-e7eb-4bf5-a4eb-9aa2a896ef47 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:43.505043 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c1f5d-e7eb-4bf5-a4eb-9aa2a896ef47 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:43.505317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c1f5d-e7eb-4bf5-a4eb-9aa2a896ef47 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:43.506006 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c1f5d-e7eb-4bf5-a4eb-9aa2a896ef47 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:43.507403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c1f5d-e7eb-4bf5-a4eb-9aa2a896ef47 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:43.525969 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 518/1021] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Sep 1 16:20:43 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:43.592423 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 504/1022] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:43.862543 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c1f5d-e7eb-4bf5-a4eb-9aa2a896ef47 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:43.915283 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:43.968344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c1f5d-e7eb-4bf5-a4eb-9aa2a896ef47 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:44.001131 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd0b8e-c64f-414a-a4dc-192e3e69272e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:44.001757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd0b8e-c64f-414a-a4dc-192e3e69272e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:44.002030 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd0b8e-c64f-414a-a4dc-192e3e69272e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:44.002917 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd0b8e-c64f-414a-a4dc-192e3e69272e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:44.013275 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd0b8e-c64f-414a-a4dc-192e3e69272e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:44.018097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-61dd0b8e-c64f-414a-a4dc-192e3e69272e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:20:44.018097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:44.018097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:44.018097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:44.018097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:44.018097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:44.018097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:44.018097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:44.018097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:44.018097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:44.018097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:44.018097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:44.018097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:44.018097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:44.018097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:44.018097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:44.019339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:44.019339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:44.019339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:44.019339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:44.019339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:44.019339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:44.019339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:44.019339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:44.019339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:44.019339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:44.019339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:44.019339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:44.019339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:44.019339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:44.019339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:44.019339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:44.020521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:44.020521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:44.020521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:44.020521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:44.020521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:44.020521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:44.020521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:44.020521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:44.020521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:44.020521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:44.020521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:20:44.020521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:44.021490 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 519/1023] 10.222.0.71 () {56 vars in 1120 bytes} [Thu Sep 1 16:20:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:44.025628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd781044-d993-4587-a877-09052b05392b None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:44.120279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:44.128654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd781044-d993-4587-a877-09052b05392b None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:44.162940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16876b82-7639-4343-9140-ab71157c4e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:44.163544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16876b82-7639-4343-9140-ab71157c4e8c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:44.163824 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16876b82-7639-4343-9140-ab71157c4e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:44.164115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16876b82-7639-4343-9140-ab71157c4e8c None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:44.164774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16876b82-7639-4343-9140-ab71157c4e8c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:44.165075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16876b82-7639-4343-9140-ab71157c4e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:44.166422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16876b82-7639-4343-9140-ab71157c4e8c None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:44.178646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 505/1024] 10.222.0.71 () {56 vars in 1115 bytes} [Thu Sep 1 16:20:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:44.180809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd0b8e-c64f-414a-a4dc-192e3e69272e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:44.290148 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd0b8e-c64f-414a-a4dc-192e3e69272e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:44.300494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:44.325336 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4badd-203c-4683-a925-7f8601d55995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:44.325949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4badd-203c-4683-a925-7f8601d55995 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:44.326277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4badd-203c-4683-a925-7f8601d55995 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:44.326547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4badd-203c-4683-a925-7f8601d55995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:44.338409 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4badd-203c-4683-a925-7f8601d55995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:44.339853 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4badd-203c-4683-a925-7f8601d55995 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:44.353935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-9dc4badd-203c-4683-a925-7f8601d55995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:44.353935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:44.353935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:44.353935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:44.353935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:44.353935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:44.353935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:44.353935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:44.353935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:44.353935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:44.353935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:44.353935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:44.353935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:44.353935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:44.353935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:44.353935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:44.354973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:44.354973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:44.354973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:44.354973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:44.354973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:44.354973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:44.354973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:44.354973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:44.354973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:44.354973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:44.354973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:44.354973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:44.354973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:44.354973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:44.354973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:44.354973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:44.354973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:44.355913 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:44.355913 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:44.355913 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:44.356765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 520/1025] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:44.360965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16876b82-7639-4343-9140-ab71157c4e8c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:44.460585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16876b82-7639-4343-9140-ab71157c4e8c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:44.494433 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf20b8-d2d6-40d5-b0f1-c9fa5ed10788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:44.495086 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf20b8-d2d6-40d5-b0f1-c9fa5ed10788 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:44.495363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf20b8-d2d6-40d5-b0f1-c9fa5ed10788 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:44.495628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf20b8-d2d6-40d5-b0f1-c9fa5ed10788 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:44.496296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf20b8-d2d6-40d5-b0f1-c9fa5ed10788 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:44.496597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf20b8-d2d6-40d5-b0f1-c9fa5ed10788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:44.497970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf20b8-d2d6-40d5-b0f1-c9fa5ed10788 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:44.511187 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 506/1026] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:44.516566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4badd-203c-4683-a925-7f8601d55995 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:44.618393 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4badd-203c-4683-a925-7f8601d55995 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:44.659417 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb855cc9-d9d0-411f-839b-7fc9a414a69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:44.660042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb855cc9-d9d0-411f-839b-7fc9a414a69f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:44.660321 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb855cc9-d9d0-411f-839b-7fc9a414a69f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:44.660589 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb855cc9-d9d0-411f-839b-7fc9a414a69f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:44.668183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb855cc9-d9d0-411f-839b-7fc9a414a69f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:44.669604 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb855cc9-d9d0-411f-839b-7fc9a414a69f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:44.681085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-eb855cc9-d9d0-411f-839b-7fc9a414a69f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:44.681085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:44.681085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:44.681085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:44.681085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:44.681085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:44.681085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:44.681085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:44.681085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:44.681085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:44.681085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:44.681085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:44.681085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:44.681085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:44.681085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:44.681085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:44.682038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:44.687704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:44.687704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:44.687704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:44.687704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:44.687704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:44.687704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:44.687704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:44.687704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:44.687704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:44.687704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:44.687704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 521/1027] 10.222.0.71 () {56 vars in 1093 bytes} [Thu Sep 1 16:20:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:44.689643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf20b8-d2d6-40d5-b0f1-c9fa5ed10788 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:44.708864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:44.793346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf20b8-d2d6-40d5-b0f1-c9fa5ed10788 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:44.827631 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4bfaa-ab87-4f11-83e3-01006fb5908c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:44.828240 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4bfaa-ab87-4f11-83e3-01006fb5908c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:44.828520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4bfaa-ab87-4f11-83e3-01006fb5908c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:44.828793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4bfaa-ab87-4f11-83e3-01006fb5908c None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:44.829530 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4bfaa-ab87-4f11-83e3-01006fb5908c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:44.829864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4bfaa-ab87-4f11-83e3-01006fb5908c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:44.831319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4bfaa-ab87-4f11-83e3-01006fb5908c None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:44.853105 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 507/1028] 10.222.0.71 () {56 vars in 1133 bytes} [Thu Sep 1 16:20:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:44.854398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb855cc9-d9d0-411f-839b-7fc9a414a69f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:44.879538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:44.958482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb855cc9-d9d0-411f-839b-7fc9a414a69f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:44.992852 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c4334-0c74-498e-9b3f-5366dcc7c1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:44.993457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c4334-0c74-498e-9b3f-5366dcc7c1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:44.993735 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c4334-0c74-498e-9b3f-5366dcc7c1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:44.994006 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c4334-0c74-498e-9b3f-5366dcc7c1b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:45.060793 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c4334-0c74-498e-9b3f-5366dcc7c1b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:45.062140 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c4334-0c74-498e-9b3f-5366dcc7c1b0 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:45.084784 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:45.165519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 522/1029] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:44 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:20:45.167292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4bfaa-ab87-4f11-83e3-01006fb5908c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:45.244774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:45.271104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4bfaa-ab87-4f11-83e3-01006fb5908c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:45.305479 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2cdac-d33d-46f0-a84a-f9909620daef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:45.306102 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2cdac-d33d-46f0-a84a-f9909620daef None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:45.306377 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2cdac-d33d-46f0-a84a-f9909620daef None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:45.306666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2cdac-d33d-46f0-a84a-f9909620daef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:45.317025 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2cdac-d33d-46f0-a84a-f9909620daef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:45.318390 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2cdac-d33d-46f0-a84a-f9909620daef None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:45.333302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-82c2cdac-d33d-46f0-a84a-f9909620daef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:45.333302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:45.333302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:45.333302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:45.333302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:45.333302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:45.333302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:45.333302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:45.333302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:45.333302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:45.333302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:45.333302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:45.333302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:45.333302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:45.333302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:45.333302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:45.334329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:45.334329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:45.334329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:45.334329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:45.334329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:45.334329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:45.334329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:45.334329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:45.334329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:45.334329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:45.334329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:45.334329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:45.334329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:45.334329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:45.334329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:45.334329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:45.334329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:45.335871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:45.335871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:45.335871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:45.338969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 508/1030] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:45.341080 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d83232-49e9-4207-95da-704d62631ee7 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:45.341367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d83232-49e9-4207-95da-704d62631ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:45.341643 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d83232-49e9-4207-95da-704d62631ee7 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:45.343317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 523/1031] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:45.343549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2cdac-d33d-46f0-a84a-f9909620daef None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:45.349075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f7a6f-38b0-4c84-9189-e6aa820e0f72 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:45.349358 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f7a6f-38b0-4c84-9189-e6aa820e0f72 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:45.349634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f7a6f-38b0-4c84-9189-e6aa820e0f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:45.369291 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-034f7a6f-38b0-4c84-9189-e6aa820e0f72 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:45.370484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-034f7a6f-38b0-4c84-9189-e6aa820e0f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:45.443429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 524/1032] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:45.450902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2cdac-d33d-46f0-a84a-f9909620daef None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:45.470285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164aad-794c-4b5c-8ba5-4ee01633bc93 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:45.470646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164aad-794c-4b5c-8ba5-4ee01633bc93 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:45.470870 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164aad-794c-4b5c-8ba5-4ee01633bc93 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:45.472200 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 525/1033] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:45.477433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc6803-7f3d-4a85-bb4a-4431a78fcec1 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:45.477715 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc6803-7f3d-4a85-bb4a-4431a78fcec1 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:45.477987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc6803-7f3d-4a85-bb4a-4431a78fcec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:45.478501 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:45.487964 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325c751-c68e-4973-9005-f404f76caeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:45.488563 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325c751-c68e-4973-9005-f404f76caeb5 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:45.488843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325c751-c68e-4973-9005-f404f76caeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:45.489114 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325c751-c68e-4973-9005-f404f76caeb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:45.489758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325c751-c68e-4973-9005-f404f76caeb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:45.490062 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325c751-c68e-4973-9005-f404f76caeb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:45.491443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325c751-c68e-4973-9005-f404f76caeb5 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:45.496777 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2cdc6803-7f3d-4a85-bb4a-4431a78fcec1 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:45.497955 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2cdc6803-7f3d-4a85-bb4a-4431a78fcec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:45.504900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 509/1034] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:45.510204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325c751-c68e-4973-9005-f404f76caeb5 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:45.548236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:45.571454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 526/1035] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:45.626024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325c751-c68e-4973-9005-f404f76caeb5 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:45.660539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab25cb-1353-4edb-bc73-fe63fe4a8263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:45.661158 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab25cb-1353-4edb-bc73-fe63fe4a8263 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:45.661432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab25cb-1353-4edb-bc73-fe63fe4a8263 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:45.661700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab25cb-1353-4edb-bc73-fe63fe4a8263 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:45.668895 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab25cb-1353-4edb-bc73-fe63fe4a8263 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:45.670308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab25cb-1353-4edb-bc73-fe63fe4a8263 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:45.682080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-15ab25cb-1353-4edb-bc73-fe63fe4a8263 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:45.682080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:45.682080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:45.682080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:45.682080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:45.682080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:45.682080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:45.682080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:45.682080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:45.682080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:45.682080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:45.682080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:45.682080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:45.682080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:45.682080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:45.683034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:45.683034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:45.683034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:45.683034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:45.683034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:45.683034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:45.683034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:45.683034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:45.683034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:45.683034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:45.683034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:45.683034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:45.683034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:45.683034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:45.683034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:45.683034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:45.683034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:45.683948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:45.683948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:45.683948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:45.683948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:45.683948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:45.683948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:45.683948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:45.683948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:45.684938 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 510/1036] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:45.688967 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc6803-7f3d-4a85-bb4a-4431a78fcec1 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:45.713056 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab25cb-1353-4edb-bc73-fe63fe4a8263 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:45.760012 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:45.797459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc6803-7f3d-4a85-bb4a-4431a78fcec1 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:45.812688 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab25cb-1353-4edb-bc73-fe63fe4a8263 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:45.832647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737940e6-dce7-4202-ac86-3e095419d839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:45.833179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737940e6-dce7-4202-ac86-3e095419d839 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:45.833459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737940e6-dce7-4202-ac86-3e095419d839 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:45.833727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737940e6-dce7-4202-ac86-3e095419d839 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:45.834515 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737940e6-dce7-4202-ac86-3e095419d839 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:45.834890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737940e6-dce7-4202-ac86-3e095419d839 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:45.836485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737940e6-dce7-4202-ac86-3e095419d839 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:45.846293 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b5da9-d8f7-4cd2-a294-60fe7f59b61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:45.846943 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5da9-d8f7-4cd2-a294-60fe7f59b61f None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:45.847226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5da9-d8f7-4cd2-a294-60fe7f59b61f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:45.847499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5da9-d8f7-4cd2-a294-60fe7f59b61f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:45.848618 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b5da9-d8f7-4cd2-a294-60fe7f59b61f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:45.848725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 527/1037] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:45.849438 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737940e6-dce7-4202-ac86-3e095419d839 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:45.850035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b5da9-d8f7-4cd2-a294-60fe7f59b61f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:45.854668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 511/1038] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:45.856235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b5da9-d8f7-4cd2-a294-60fe7f59b61f None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:45.893863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:45.950857 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737940e6-dce7-4202-ac86-3e095419d839 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:45.959403 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b5da9-d8f7-4cd2-a294-60fe7f59b61f None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:45.973369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:45.984905 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf38602-5fbb-42ca-ab18-34d44065fc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:45.985521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf38602-5fbb-42ca-ab18-34d44065fc8e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:45.985799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf38602-5fbb-42ca-ab18-34d44065fc8e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:45.986064 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf38602-5fbb-42ca-ab18-34d44065fc8e None admin] PATH_INFO: `/v3/services/image` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:45.986660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf38602-5fbb-42ca-ab18-34d44065fc8e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:45.988004 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf38602-5fbb-42ca-ab18-34d44065fc8e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:45.994552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dfb5d-2ccf-431e-9e49-57c189b2ebc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:45.995172 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dfb5d-2ccf-431e-9e49-57c189b2ebc4 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:45.995452 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dfb5d-2ccf-431e-9e49-57c189b2ebc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:45.995722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dfb5d-2ccf-431e-9e49-57c189b2ebc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:45.996439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4dfb5d-2ccf-431e-9e49-57c189b2ebc4 None admin] RBAC: Adding query filter params (role.id=0d6c0de77625409c8fe68e983df3a394, scope.project.id=9527063094354a99a80822107d2740fb, user.id=ed71d63cd24f4a6caf6ebba2c30d3608) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:45.996748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4dfb5d-2ccf-431e-9e49-57c189b2ebc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:45.997494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-6bf38602-5fbb-42ca-ab18-34d44065fc8e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:20:45.997494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:45.997494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:45.997494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:45.997494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:45.997494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:45.997494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:45.997494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:45.997494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:20:45.997494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:45.997494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:45.997494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:45.997494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:45.997494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:45.997494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:45.997494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:45.997494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:45.998651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:45.998651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:45.998651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:45.998651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:45.998651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:45.998651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:45.998651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:45.998651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:45.998651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:45.998651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:45.998651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:45.998651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:45.998651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:45.998651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:45.998651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:45.998651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:45.999524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:45.999524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:45.999524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:45.999524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:45.999524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:45.999524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:45.999524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:45.999524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:45.999524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:45.999524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:45.999524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:45.999524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:45.999524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:20:45.999524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:46.000262 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4dfb5d-2ccf-431e-9e49-57c189b2ebc4 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:46.000333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 528/1039] 10.222.0.71 () {56 vars in 1105 bytes} [Thu Sep 1 16:20:45 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:46.000333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf38602-5fbb-42ca-ab18-34d44065fc8e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:46.015137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 512/1040] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:45 2022] GET /identity/v3/role_assignments?user.id=ed71d63cd24f4a6caf6ebba2c30d3608&scope.project.id=9527063094354a99a80822107d2740fb&role.id=0d6c0de77625409c8fe68e983df3a394 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:46.015137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dfb5d-2ccf-431e-9e49-57c189b2ebc4 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:46.119382 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dfb5d-2ccf-431e-9e49-57c189b2ebc4 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:46.119701 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf38602-5fbb-42ca-ab18-34d44065fc8e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:46.127749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:46.157539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbe415-2084-408a-8cd2-2a1ac10dd795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:46.158145 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbe415-2084-408a-8cd2-2a1ac10dd795 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:46.158423 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbe415-2084-408a-8cd2-2a1ac10dd795 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:46.158746 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbe415-2084-408a-8cd2-2a1ac10dd795 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:46.159376 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbe415-2084-408a-8cd2-2a1ac10dd795 None admin] RBAC: Adding query filter params (name=image) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:46.159618 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0dc53-dc60-4019-86b5-89fcd42f793f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:46.159733 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbe415-2084-408a-8cd2-2a1ac10dd795 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:46.160225 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0dc53-dc60-4019-86b5-89fcd42f793f None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:46.160504 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0dc53-dc60-4019-86b5-89fcd42f793f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:46.160776 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0dc53-dc60-4019-86b5-89fcd42f793f None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:46.161021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbe415-2084-408a-8cd2-2a1ac10dd795 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:46.161432 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0dc53-dc60-4019-86b5-89fcd42f793f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:46.162863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0dc53-dc60-4019-86b5-89fcd42f793f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:46.171339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 513/1041] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:46.172193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbe415-2084-408a-8cd2-2a1ac10dd795 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:46.190648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 529/1042] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:20:45 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:46.235362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:46.298973 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbe415-2084-408a-8cd2-2a1ac10dd795 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:46.335063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcae46-fab8-412b-84f7-9235a5073701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:46.335666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcae46-fab8-412b-84f7-9235a5073701 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:46.335972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcae46-fab8-412b-84f7-9235a5073701 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:46.336243 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcae46-fab8-412b-84f7-9235a5073701 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:46.336874 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcae46-fab8-412b-84f7-9235a5073701 None admin] RBAC: Adding query filter params (type=image) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:46.337174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcae46-fab8-412b-84f7-9235a5073701 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:46.338533 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcae46-fab8-412b-84f7-9235a5073701 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:46.345855 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 514/1043] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:46.351561 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0dc53-dc60-4019-86b5-89fcd42f793f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:46.467602 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0dc53-dc60-4019-86b5-89fcd42f793f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:46.501997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd6df2-97be-465c-921d-a727a0dd4e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:46.502604 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd6df2-97be-465c-921d-a727a0dd4e7e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:46.502913 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd6df2-97be-465c-921d-a727a0dd4e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:46.503184 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd6df2-97be-465c-921d-a727a0dd4e7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:46.503885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd6df2-97be-465c-921d-a727a0dd4e7e None admin] RBAC: Adding query filter params (interface=public, service_id=9c1319ecdd4f4899a09d544a3904e755, region_id=RegionOne) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:46.504192 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd6df2-97be-465c-921d-a727a0dd4e7e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:46.505542 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd6df2-97be-465c-921d-a727a0dd4e7e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:46.515065 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 530/1044] 10.222.0.71 () {56 vars in 1251 bytes} [Thu Sep 1 16:20:46 2022] GET /identity/v3/endpoints?service_id=9c1319ecdd4f4899a09d544a3904e755&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:46.516700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcae46-fab8-412b-84f7-9235a5073701 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:46.626588 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcae46-fab8-412b-84f7-9235a5073701 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:46.634397 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:46.663370 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750779f-8d5a-429b-8c4b-7938e37e834f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:46.664598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750779f-8d5a-429b-8c4b-7938e37e834f None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:46.666868 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750779f-8d5a-429b-8c4b-7938e37e834f None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:46.667164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750779f-8d5a-429b-8c4b-7938e37e834f None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:46.667782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750779f-8d5a-429b-8c4b-7938e37e834f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:46.671955 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750779f-8d5a-429b-8c4b-7938e37e834f None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:46.682716 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 515/1045] 10.222.0.71 () {56 vars in 1087 bytes} [Thu Sep 1 16:20:46 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:20:47.896808 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf4556-5665-4763-a57d-78bdb2d538da None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:47.897318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf4556-5665-4763-a57d-78bdb2d538da None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:47.897318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf4556-5665-4763-a57d-78bdb2d538da None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:47.898787 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 531/1046] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:47.903607 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40673bce-3755-4508-8395-896aa87fa78f None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:47.903986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40673bce-3755-4508-8395-896aa87fa78f None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:47.904145 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40673bce-3755-4508-8395-896aa87fa78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:47.922783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-40673bce-3755-4508-8395-896aa87fa78f None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:47.923960 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-40673bce-3755-4508-8395-896aa87fa78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:47.993552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 516/1047] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:48.170684 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df7ba-17a0-4d45-9bb3-86b71481d805 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:48.171018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df7ba-17a0-4d45-9bb3-86b71481d805 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:48.171236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df7ba-17a0-4d45-9bb3-86b71481d805 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:48.172652 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 532/1048] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:48.177578 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfd574-3b11-470e-9531-0f4e246898ab None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:48.177942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfd574-3b11-470e-9531-0f4e246898ab None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:48.178346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfd574-3b11-470e-9531-0f4e246898ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:48.197303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-12dfd574-3b11-470e-9531-0f4e246898ab None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:48.198482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-12dfd574-3b11-470e-9531-0f4e246898ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:48.256736 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04df7ba-17a0-4d45-9bb3-86b71481d805 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:48.269711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 517/1049] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:48.286192 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:48.364693 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04df7ba-17a0-4d45-9bb3-86b71481d805 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:48.397304 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b104a8-05b1-4fd3-8b94-608097ff1d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:48.397923 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b104a8-05b1-4fd3-8b94-608097ff1d02 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:48.398198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b104a8-05b1-4fd3-8b94-608097ff1d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:48.399003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b104a8-05b1-4fd3-8b94-608097ff1d02 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:48.409427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b104a8-05b1-4fd3-8b94-608097ff1d02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:48.414824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-57b104a8-05b1-4fd3-8b94-608097ff1d02 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:20:48.414824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:48.414824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:48.414824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:48.414824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:48.414824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:48.414824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:48.414824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:48.414824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:48.414824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:48.414824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:48.414824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:48.414824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:48.414824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:48.414824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:48.414824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:48.415744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:48.415744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:48.415744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:48.415744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:48.415744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:48.415744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:48.415744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:48.415744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:48.415744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:48.415744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:48.415744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:48.415744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:48.415744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:48.415744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:48.415744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:48.415744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:48.416611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:48.416611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:48.416611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:48.416611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:48.416611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:48.416611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:48.416611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:48.416611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:48.416611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:48.416611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:48.416611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:20:48.416611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:48.416611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 533/1050] 10.222.0.71 () {56 vars in 1120 bytes} [Thu Sep 1 16:20:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:48.421815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfd574-3b11-470e-9531-0f4e246898ab None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:48.452245 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:48.525349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfd574-3b11-470e-9531-0f4e246898ab None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:48.537660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b104a8-05b1-4fd3-8b94-608097ff1d02 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:48.561205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9ae9b-e7f4-4379-af59-52bd736dde09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:48.561817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9ae9b-e7f4-4379-af59-52bd736dde09 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:48.562096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9ae9b-e7f4-4379-af59-52bd736dde09 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:48.562368 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9ae9b-e7f4-4379-af59-52bd736dde09 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:48.563070 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9ae9b-e7f4-4379-af59-52bd736dde09 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:48.563376 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9ae9b-e7f4-4379-af59-52bd736dde09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:48.564728 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9ae9b-e7f4-4379-af59-52bd736dde09 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:48.573948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 518/1051] 10.222.0.71 () {56 vars in 1115 bytes} [Thu Sep 1 16:20:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:48.579279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9ae9b-e7f4-4379-af59-52bd736dde09 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:48.635309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:48.650449 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b104a8-05b1-4fd3-8b94-608097ff1d02 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:48.671417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:48.681441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9ae9b-e7f4-4379-af59-52bd736dde09 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:48.683674 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7053e-c814-41d2-a960-1f950efa9633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:48.684297 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7053e-c814-41d2-a960-1f950efa9633 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:48.684572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7053e-c814-41d2-a960-1f950efa9633 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:48.684838 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7053e-c814-41d2-a960-1f950efa9633 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:48.695053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7053e-c814-41d2-a960-1f950efa9633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:48.705443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-74e7053e-c814-41d2-a960-1f950efa9633 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:48.705443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:48.705443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:48.705443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:48.705443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:48.705443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:48.705443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:48.705443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:48.705443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:48.705443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:48.705443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:48.705443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:48.705443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:48.705443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:48.705443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:48.705443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:48.706569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:48.706569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:48.706569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:48.706569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:48.706569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:48.706569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:48.706569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:48.706569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:48.706569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:48.706569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:48.706569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:48.706569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:48.706569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:48.706569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:48.706569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:48.706569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:48.707491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:48.707491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:48.707491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:48.707491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:48.707491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:48.707491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:48.707491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:48.707491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:48.707491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:48.707491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:48.707491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:48.707491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:48.707491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 534/1052] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:48.708224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d445d-0d65-420c-8eb7-6772ed3b88d5 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:48.708224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d445d-0d65-420c-8eb7-6772ed3b88d5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:48.708577 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d445d-0d65-420c-8eb7-6772ed3b88d5 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:48.709739 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 535/1053] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:48.713033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d445d-0d65-420c-8eb7-6772ed3b88d5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:48.720333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f88dfe-8870-47f8-8ff5-aabe39ec4422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:48.720963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f88dfe-8870-47f8-8ff5-aabe39ec4422 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:48.721245 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f88dfe-8870-47f8-8ff5-aabe39ec4422 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:48.721520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f88dfe-8870-47f8-8ff5-aabe39ec4422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:48.733717 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f88dfe-8870-47f8-8ff5-aabe39ec4422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:48.735319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f88dfe-8870-47f8-8ff5-aabe39ec4422 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:48.750442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-f5f88dfe-8870-47f8-8ff5-aabe39ec4422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:48.750442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:48.750442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:48.750442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:48.750442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:48.750442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:48.750442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:48.750442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:48.750442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:48.750442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:48.750442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:48.750442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:48.750442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:48.750442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:48.750442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:48.750442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:48.751600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:48.751600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:48.751600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:48.751600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:48.751600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:48.751600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:48.751600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:48.751600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:48.751600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:48.751600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:48.751600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:48.751600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:48.751600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:48.751600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:48.751600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:48.751600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:48.751600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:48.752992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:48.752992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:48.752992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:48.752992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 519/1054] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:48.752992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4666f-3c17-4c6c-af7e-4ac8607087d4 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:48.752992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4666f-3c17-4c6c-af7e-4ac8607087d4 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:48.753354 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4666f-3c17-4c6c-af7e-4ac8607087d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:48.770712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-b0b4666f-3c17-4c6c-af7e-4ac8607087d4 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:48.771901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b0b4666f-3c17-4c6c-af7e-4ac8607087d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:48.819679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d445d-0d65-420c-8eb7-6772ed3b88d5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:48.839032 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 520/1055] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:48.839822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4666f-3c17-4c6c-af7e-4ac8607087d4 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:48.852896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476d3d2-56fe-4662-a326-cfd0a400c7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:48.853567 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476d3d2-56fe-4662-a326-cfd0a400c7aa None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:48.853911 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476d3d2-56fe-4662-a326-cfd0a400c7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:48.854244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476d3d2-56fe-4662-a326-cfd0a400c7aa None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:48.855020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476d3d2-56fe-4662-a326-cfd0a400c7aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:48.855323 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476d3d2-56fe-4662-a326-cfd0a400c7aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:48.856675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476d3d2-56fe-4662-a326-cfd0a400c7aa None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:48.865686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 536/1056] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:48.871675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476d3d2-56fe-4662-a326-cfd0a400c7aa None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:48.882348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:48.932098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:48.957926 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4666f-3c17-4c6c-af7e-4ac8607087d4 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:48.980647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476d3d2-56fe-4662-a326-cfd0a400c7aa None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:48.992516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfe0bd-8543-4256-a89d-0bd64bee22ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:48.993113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe0bd-8543-4256-a89d-0bd64bee22ba None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:48.993388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe0bd-8543-4256-a89d-0bd64bee22ba None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:48.993655 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe0bd-8543-4256-a89d-0bd64bee22ba None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:48.994292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfe0bd-8543-4256-a89d-0bd64bee22ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:48.994590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfe0bd-8543-4256-a89d-0bd64bee22ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:48.995958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfe0bd-8543-4256-a89d-0bd64bee22ba None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.012678 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 521/1057] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:49.013873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfe0bd-8543-4256-a89d-0bd64bee22ba None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:49.016704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580802b1-03db-481d-a8db-7aa112235dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:49.017906 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580802b1-03db-481d-a8db-7aa112235dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.017906 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580802b1-03db-481d-a8db-7aa112235dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.017906 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580802b1-03db-481d-a8db-7aa112235dd9 None admin] PATH_INFO: `/v3/users/d8659f4d59f0408e834ef42541a2f4df` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.032684 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580802b1-03db-481d-a8db-7aa112235dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=d8659f4d59f0408e834ef42541a2f4df)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:49.034094 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580802b1-03db-481d-a8db-7aa112235dd9 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.040645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 537/1058] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:20:48 2022] GET /identity/v3/users/d8659f4d59f0408e834ef42541a2f4df => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:49.041388 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580802b1-03db-481d-a8db-7aa112235dd9 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:49.110935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:49.125777 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfe0bd-8543-4256-a89d-0bd64bee22ba None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:49.146703 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580802b1-03db-481d-a8db-7aa112235dd9 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:49.160824 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8b308-ce23-413d-9bcd-067333831ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:49.161456 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8b308-ce23-413d-9bcd-067333831ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.161733 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8b308-ce23-413d-9bcd-067333831ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.162003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8b308-ce23-413d-9bcd-067333831ba0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.164008 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:49.171737 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8b308-ce23-413d-9bcd-067333831ba0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:49.173169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8b308-ce23-413d-9bcd-067333831ba0 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.181399 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8e103-34c7-46cd-88a5-3a227076ba7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:49.181994 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8e103-34c7-46cd-88a5-3a227076ba7c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.182316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8e103-34c7-46cd-88a5-3a227076ba7c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.182531 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8e103-34c7-46cd-88a5-3a227076ba7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.184410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-03c8b308-ce23-413d-9bcd-067333831ba0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:49.184410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:49.184410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:49.184410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:49.184410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:49.184410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:49.184410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:49.184410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:49.184410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:49.184410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:49.184410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:49.184410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:49.184410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:49.184410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:49.184410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:49.184410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:49.185531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:49.186755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:49.186755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:49.186755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:49.186755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:49.186755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:49.186755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:49.186755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:49.186755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:49.186755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:49.186755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:49.186755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 522/1059] 10.222.0.71 () {56 vars in 1093 bytes} [Thu Sep 1 16:20:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:49.186755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8b308-ce23-413d-9bcd-067333831ba0 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:49.250107 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8e103-34c7-46cd-88a5-3a227076ba7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:49.251547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8e103-34c7-46cd-88a5-3a227076ba7c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.283842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8b308-ce23-413d-9bcd-067333831ba0 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:49.312997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:49.317707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01c1f7-8dc6-489b-bbdc-4a0cc477bdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:49.318645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01c1f7-8dc6-489b-bbdc-4a0cc477bdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.318645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01c1f7-8dc6-489b-bbdc-4a0cc477bdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.318876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01c1f7-8dc6-489b-bbdc-4a0cc477bdd2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.319455 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01c1f7-8dc6-489b-bbdc-4a0cc477bdd2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:49.320810 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01c1f7-8dc6-489b-bbdc-4a0cc477bdd2 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.329495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-8f01c1f7-8dc6-489b-bbdc-4a0cc477bdd2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:20:49.329495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:49.329495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:49.329495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:49.329495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:49.329495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:49.329495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:49.329495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:49.329495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:20:49.329495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:49.329495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:49.329495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:49.329495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:49.329495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:49.329495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:49.329495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:49.329495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:49.330589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:49.330589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:49.330589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:49.330589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:49.330589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:49.330589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:49.330589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:49.330589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:49.330589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:49.330589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:49.330589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:49.330589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:49.330589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:49.330589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:49.330589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:49.330589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:49.331480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:49.331480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:49.331480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:49.331480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:49.331480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:49.331480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:49.331480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:49.331480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:49.331480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:49.331480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:49.331480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:49.331480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:49.331480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:20:49.331480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:49.331480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 523/1060] 10.222.0.71 () {56 vars in 1105 bytes} [Thu Sep 1 16:20:49 2022] GET /identity/v3/services/image => generated 86 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:49.332367 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01c1f7-8dc6-489b-bbdc-4a0cc477bdd2 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:49.358990 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 538/1061] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:49 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:20:49.358990 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8e103-34c7-46cd-88a5-3a227076ba7c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:49.391948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:49.435980 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01c1f7-8dc6-489b-bbdc-4a0cc477bdd2 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:49.452331 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8e103-34c7-46cd-88a5-3a227076ba7c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:49.470500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024e450-1498-4045-958e-ff7ce90c4049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:49.471119 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024e450-1498-4045-958e-ff7ce90c4049 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.471394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024e450-1498-4045-958e-ff7ce90c4049 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.471662 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024e450-1498-4045-958e-ff7ce90c4049 None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.472790 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024e450-1498-4045-958e-ff7ce90c4049 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:49.473096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024e450-1498-4045-958e-ff7ce90c4049 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:49.474513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024e450-1498-4045-958e-ff7ce90c4049 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.485549 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50107624-dae7-4ddd-81e7-67f0d5fef437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:49.486138 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50107624-dae7-4ddd-81e7-67f0d5fef437 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.486414 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50107624-dae7-4ddd-81e7-67f0d5fef437 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.486715 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50107624-dae7-4ddd-81e7-67f0d5fef437 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.487335 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50107624-dae7-4ddd-81e7-67f0d5fef437 None admin] RBAC: Adding query filter params (name=image) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:49.487633 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50107624-dae7-4ddd-81e7-67f0d5fef437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:49.488990 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50107624-dae7-4ddd-81e7-67f0d5fef437 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.491796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 524/1062] 10.222.0.71 () {56 vars in 1133 bytes} [Thu Sep 1 16:20:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:49.492862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024e450-1498-4045-958e-ff7ce90c4049 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:49.494652 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 539/1063] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:49.497545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50107624-dae7-4ddd-81e7-67f0d5fef437 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:49.527976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:49.595999 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50107624-dae7-4ddd-81e7-67f0d5fef437 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:49.596673 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024e450-1498-4045-958e-ff7ce90c4049 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:49.612988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:49.630799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7accddc-4cbf-4db2-969f-750062286bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:49.631426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7accddc-4cbf-4db2-969f-750062286bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.631700 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7accddc-4cbf-4db2-969f-750062286bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.631810 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bb596-dfb7-4230-9772-5b7c8b73e78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:49.631967 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7accddc-4cbf-4db2-969f-750062286bf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.632345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bb596-dfb7-4230-9772-5b7c8b73e78c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.633255 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bb596-dfb7-4230-9772-5b7c8b73e78c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.633531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bb596-dfb7-4230-9772-5b7c8b73e78c None admin] PATH_INFO: `/v3/projects/9e4a28c765cb4c88bdce9712025f4ddb` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.634674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bb596-dfb7-4230-9772-5b7c8b73e78c None admin] RBAC: Authorizing `identity:get_project(project_id=9e4a28c765cb4c88bdce9712025f4ddb)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:49.636096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bb596-dfb7-4230-9772-5b7c8b73e78c None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.637731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 525/1064] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:20:49 2022] GET /identity/v3/projects/9e4a28c765cb4c88bdce9712025f4ddb => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:49.638481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bb596-dfb7-4230-9772-5b7c8b73e78c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:49.642468 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7accddc-4cbf-4db2-969f-750062286bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:49.643927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7accddc-4cbf-4db2-969f-750062286bf1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.659302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-f7accddc-4cbf-4db2-969f-750062286bf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:49.659302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:49.659302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:49.659302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:49.659302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:49.659302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:49.659302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:49.659302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:49.659302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:49.659302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:49.659302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:49.659302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:49.659302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:49.659302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:49.659302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:49.659302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:49.660352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:49.660352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:49.660352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:49.660352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:49.660352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:49.660352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:49.660352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:49.660352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:49.660352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:49.660352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:49.660352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:49.660352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:49.660352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:49.660352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:49.660352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:49.660352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:49.660352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:49.661247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:49.661247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:49.661247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:49.661247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 540/1065] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:49.661247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7accddc-4cbf-4db2-969f-750062286bf1 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:49.739500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:49.744380 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bb596-dfb7-4230-9772-5b7c8b73e78c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:49.758170 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7accddc-4cbf-4db2-969f-750062286bf1 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:49.777688 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f24069-c200-42f8-b7d1-728750b99758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:49.778287 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24069-c200-42f8-b7d1-728750b99758 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.778562 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24069-c200-42f8-b7d1-728750b99758 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.778861 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24069-c200-42f8-b7d1-728750b99758 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.779491 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f24069-c200-42f8-b7d1-728750b99758 None admin] RBAC: Adding query filter params (type=image) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:49.779792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f24069-c200-42f8-b7d1-728750b99758 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:49.781142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f24069-c200-42f8-b7d1-728750b99758 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.785869 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 526/1066] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:49.786636 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f24069-c200-42f8-b7d1-728750b99758 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:49.790283 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204052bd-07f2-4b3a-b83a-ef0ec6534005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:49.791026 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204052bd-07f2-4b3a-b83a-ef0ec6534005 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.791303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204052bd-07f2-4b3a-b83a-ef0ec6534005 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.791574 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204052bd-07f2-4b3a-b83a-ef0ec6534005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.792295 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204052bd-07f2-4b3a-b83a-ef0ec6534005 None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.project.id=9e4a28c765cb4c88bdce9712025f4ddb, user.id=d8659f4d59f0408e834ef42541a2f4df) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:49.792611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204052bd-07f2-4b3a-b83a-ef0ec6534005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:49.794021 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204052bd-07f2-4b3a-b83a-ef0ec6534005 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.810642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 541/1067] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:49 2022] GET /identity/v3/role_assignments?user.id=d8659f4d59f0408e834ef42541a2f4df&scope.project.id=9e4a28c765cb4c88bdce9712025f4ddb&role.id=3cd61239237441418529e9028ef801e4 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:49.810642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204052bd-07f2-4b3a-b83a-ef0ec6534005 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:49.854513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:49.912131 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204052bd-07f2-4b3a-b83a-ef0ec6534005 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:49.912396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f24069-c200-42f8-b7d1-728750b99758 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:49.951348 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d3e20-942f-437d-8b12-2068f4dcc905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:49.951974 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d3e20-942f-437d-8b12-2068f4dcc905 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.952211 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d3e20-942f-437d-8b12-2068f4dcc905 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.952585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d3e20-942f-437d-8b12-2068f4dcc905 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.953152 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d3e20-942f-437d-8b12-2068f4dcc905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:49.953421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d3e20-942f-437d-8b12-2068f4dcc905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:49.954859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d3e20-942f-437d-8b12-2068f4dcc905 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.955995 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f672f0-63a9-4c5b-99b6-ec32c012cd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:49.956773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f672f0-63a9-4c5b-99b6-ec32c012cd76 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.957052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f672f0-63a9-4c5b-99b6-ec32c012cd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.957665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f672f0-63a9-4c5b-99b6-ec32c012cd76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.957991 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f672f0-63a9-4c5b-99b6-ec32c012cd76 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:49.959367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f672f0-63a9-4c5b-99b6-ec32c012cd76 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.972269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 527/1068] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:49.973419 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d3e20-942f-437d-8b12-2068f4dcc905 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:49.991091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 542/1069] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:20:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:50.084900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d3e20-942f-437d-8b12-2068f4dcc905 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:50.095763 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:50.130521 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dc9da-4158-4509-8321-b4fe40b01025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:50.131189 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dc9da-4158-4509-8321-b4fe40b01025 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:50.131470 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dc9da-4158-4509-8321-b4fe40b01025 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:50.131743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dc9da-4158-4509-8321-b4fe40b01025 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:50.140611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064dc9da-4158-4509-8321-b4fe40b01025 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:50.142065 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064dc9da-4158-4509-8321-b4fe40b01025 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:50.155483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-064dc9da-4158-4509-8321-b4fe40b01025 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:50.155483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:50.155483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:50.155483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:50.155483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:50.155483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:50.155483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:50.155483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:50.155483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:50.155483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:50.155483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:50.155483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:50.155483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:50.155483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:50.155483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:50.156399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:50.156399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:50.156399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:50.156399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:50.156399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:50.156399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:50.156399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:50.156399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:50.156399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:50.156399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:50.156399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:50.156399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:50.156399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:50.156399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:50.156399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:50.156399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:50.156399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:50.157325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:50.157325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:50.157325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:50.157325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:50.157325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:50.157325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:50.157325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:50.157325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:50.157325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 528/1070] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:50.162411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f672f0-63a9-4c5b-99b6-ec32c012cd76 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:50.165905 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:50.268980 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f672f0-63a9-4c5b-99b6-ec32c012cd76 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:50.302199 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb209e7a-ab4f-4da5-b7bb-5e7e91232d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:50.302842 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb209e7a-ab4f-4da5-b7bb-5e7e91232d81 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:50.303122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb209e7a-ab4f-4da5-b7bb-5e7e91232d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:50.303407 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb209e7a-ab4f-4da5-b7bb-5e7e91232d81 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:50.304085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb209e7a-ab4f-4da5-b7bb-5e7e91232d81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:50.304384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb209e7a-ab4f-4da5-b7bb-5e7e91232d81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:50.306458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb209e7a-ab4f-4da5-b7bb-5e7e91232d81 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:50.323457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 543/1071] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:50.324683 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dc9da-4158-4509-8321-b4fe40b01025 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:50.424839 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dc9da-4158-4509-8321-b4fe40b01025 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:50.460908 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e188fe-b6e2-436b-845c-126ad846f7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:50.460908 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e188fe-b6e2-436b-845c-126ad846f7ec None admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:50.460908 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e188fe-b6e2-436b-845c-126ad846f7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:50.460908 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e188fe-b6e2-436b-845c-126ad846f7ec None admin] PATH_INFO: `/v3/projects/9527063094354a99a80822107d2740fb/users/ed71d63cd24f4a6caf6ebba2c30d3608/roles/0d6c0de77625409c8fe68e983df3a394` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:50.463185 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e188fe-b6e2-436b-845c-126ad846f7ec None admin] RBAC: Authorizing `identity:create_grant(project_id=9527063094354a99a80822107d2740fb, user_id=ed71d63cd24f4a6caf6ebba2c30d3608, role_id=0d6c0de77625409c8fe68e983df3a394)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:50.464652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e188fe-b6e2-436b-845c-126ad846f7ec None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:50.478346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 529/1072] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:20:50 2022] PUT /identity/v3/projects/9527063094354a99a80822107d2740fb/users/ed71d63cd24f4a6caf6ebba2c30d3608/roles/0d6c0de77625409c8fe68e983df3a394 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:20:51.715213 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde0e6a-c5c5-4679-bb59-9a96b3876542 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:51.715729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde0e6a-c5c5-4679-bb59-9a96b3876542 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:51.715729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde0e6a-c5c5-4679-bb59-9a96b3876542 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:51.717496 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 544/1073] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:51.722377 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd3412-59ca-43f6-af40-3cf4569502fd None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:51.722788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd3412-59ca-43f6-af40-3cf4569502fd None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:51.722952 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd3412-59ca-43f6-af40-3cf4569502fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:51.741571 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-17dd3412-59ca-43f6-af40-3cf4569502fd None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:51.743325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-17dd3412-59ca-43f6-af40-3cf4569502fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:51.761224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:51.813984 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 530/1074] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:51.934737 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c403f-6936-4625-87e1-4ba24f8d6fd2 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:51.934921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c403f-6936-4625-87e1-4ba24f8d6fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:51.935205 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c403f-6936-4625-87e1-4ba24f8d6fd2 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:51.936681 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 545/1075] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:51.941744 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a300e0c-feed-409a-859a-d5e029acced1 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:51.942035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a300e0c-feed-409a-859a-d5e029acced1 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:51.942311 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a300e0c-feed-409a-859a-d5e029acced1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:51.961153 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-2a300e0c-feed-409a-859a-d5e029acced1 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:51.962344 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2a300e0c-feed-409a-859a-d5e029acced1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:52.032278 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 531/1076] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:52.080922 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c403f-6936-4625-87e1-4ba24f8d6fd2 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:52.143420 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:52.184350 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c403f-6936-4625-87e1-4ba24f8d6fd2 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:52.218232 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7092733-cc7f-4a8d-b822-105263f263a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:52.218801 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092733-cc7f-4a8d-b822-105263f263a4 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:52.219077 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092733-cc7f-4a8d-b822-105263f263a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:52.219343 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092733-cc7f-4a8d-b822-105263f263a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:52.229456 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7092733-cc7f-4a8d-b822-105263f263a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:52.234250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-a7092733-cc7f-4a8d-b822-105263f263a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:52.234250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:52.234250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:52.234250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:52.234250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:52.234250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:52.234250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:52.234250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:52.234250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:52.234250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:52.234250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:52.234250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:52.234250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:52.234250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:52.234250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:52.234250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:52.235180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:52.235180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:52.235180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:52.235180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:52.235180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:52.235180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:52.235180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:52.235180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:52.235180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:52.235180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:52.235180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:52.235180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:52.235180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:52.235180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:52.235180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:52.235180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:52.236051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:52.236051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:52.236051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:52.236051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:52.236051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:52.236051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:52.236051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:52.236051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:52.236051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:52.236051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:52.236051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:52.236051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:52.238936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 546/1077] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:52.241220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a300e0c-feed-409a-859a-d5e029acced1 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:52.303250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7092733-cc7f-4a8d-b822-105263f263a4 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:52.327825 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:52.345698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a300e0c-feed-409a-859a-d5e029acced1 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:52.381420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3c4e6-ec65-4e99-bd8c-ad6169a06698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:52.382021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3c4e6-ec65-4e99-bd8c-ad6169a06698 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:52.382299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3c4e6-ec65-4e99-bd8c-ad6169a06698 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:52.383144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3c4e6-ec65-4e99-bd8c-ad6169a06698 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:52.383809 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3c4e6-ec65-4e99-bd8c-ad6169a06698 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:52.384109 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3c4e6-ec65-4e99-bd8c-ad6169a06698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:52.385462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3c4e6-ec65-4e99-bd8c-ad6169a06698 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:52.393833 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 532/1078] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:52.395011 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5e023-5bc7-44a9-a346-97766df2c3b3 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:52.395296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5e023-5bc7-44a9-a346-97766df2c3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:52.395568 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5e023-5bc7-44a9-a346-97766df2c3b3 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:52.396896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 533/1079] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:52.401327 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5e023-5bc7-44a9-a346-97766df2c3b3 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:52.408077 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7092733-cc7f-4a8d-b822-105263f263a4 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:52.431434 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:52.443167 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562a1b5-faf1-4152-9ce1-adfc67546a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:52.443765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562a1b5-faf1-4152-9ce1-adfc67546a59 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:52.444037 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562a1b5-faf1-4152-9ce1-adfc67546a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:52.444303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562a1b5-faf1-4152-9ce1-adfc67546a59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:52.501126 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5e023-5bc7-44a9-a346-97766df2c3b3 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:52.510097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562a1b5-faf1-4152-9ce1-adfc67546a59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:52.511552 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562a1b5-faf1-4152-9ce1-adfc67546a59 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:52.534945 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9265c0-3a05-475d-aa43-121908781fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:52.535558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9265c0-3a05-475d-aa43-121908781fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:52.535832 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9265c0-3a05-475d-aa43-121908781fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:52.536184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9265c0-3a05-475d-aa43-121908781fb9 None admin] PATH_INFO: `/v3/users/d8659f4d59f0408e834ef42541a2f4df` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:52.537223 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9265c0-3a05-475d-aa43-121908781fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=d8659f4d59f0408e834ef42541a2f4df)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:52.538691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9265c0-3a05-475d-aa43-121908781fb9 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:52.540419 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 534/1080] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:20:52 2022] GET /identity/v3/users/d8659f4d59f0408e834ef42541a2f4df => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:52.541350 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a4168-1b25-4e2e-b14b-fd2bcbe6715a None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:52.541632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a4168-1b25-4e2e-b14b-fd2bcbe6715a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:52.541906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a4168-1b25-4e2e-b14b-fd2bcbe6715a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:52.559874 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-928a4168-1b25-4e2e-b14b-fd2bcbe6715a None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:52.561065 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-928a4168-1b25-4e2e-b14b-fd2bcbe6715a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:52.570768 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:52.610917 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 547/1081] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:20:52.611820 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562a1b5-faf1-4152-9ce1-adfc67546a59 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:52.635919 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 535/1082] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:52.636594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a4168-1b25-4e2e-b14b-fd2bcbe6715a None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:52.637026 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:52.720389 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562a1b5-faf1-4152-9ce1-adfc67546a59 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:52.743220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a4168-1b25-4e2e-b14b-fd2bcbe6715a None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:52.754852 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33a80a-762d-4201-b1fb-181992b59573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:52.755408 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33a80a-762d-4201-b1fb-181992b59573 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:52.755688 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33a80a-762d-4201-b1fb-181992b59573 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:52.755960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33a80a-762d-4201-b1fb-181992b59573 None admin] PATH_INFO: `/v3/projects/9e4a28c765cb4c88bdce9712025f4ddb` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:52.757219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33a80a-762d-4201-b1fb-181992b59573 None admin] RBAC: Authorizing `identity:get_project(project_id=9e4a28c765cb4c88bdce9712025f4ddb)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:52.759547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33a80a-762d-4201-b1fb-181992b59573 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:52.762481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 548/1083] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:20:52 2022] GET /identity/v3/projects/9e4a28c765cb4c88bdce9712025f4ddb => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:52.767088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33a80a-762d-4201-b1fb-181992b59573 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:52.786884 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caadc6-9ed1-4dff-a331-f183e8cf5279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:52.787508 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caadc6-9ed1-4dff-a331-f183e8cf5279 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:52.787790 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caadc6-9ed1-4dff-a331-f183e8cf5279 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:52.788061 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caadc6-9ed1-4dff-a331-f183e8cf5279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:52.798595 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4caadc6-9ed1-4dff-a331-f183e8cf5279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:52.800586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4caadc6-9ed1-4dff-a331-f183e8cf5279 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:52.804085 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:52.818605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-a4caadc6-9ed1-4dff-a331-f183e8cf5279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:52.818605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:52.818605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:52.818605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:52.818605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:52.818605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:52.818605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:52.818605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:52.818605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:52.818605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:52.818605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:52.818605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:52.818605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:52.818605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:52.818605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:52.818605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:52.819654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:52.819654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:52.819654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:52.819654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:52.819654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:52.819654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:52.819654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:52.819654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:52.819654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:52.819654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:52.819654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:52.819654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:52.819654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:52.819654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:52.819654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:52.819654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:52.819654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:52.821158 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:52.821158 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:52.821158 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:52.821158 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 536/1084] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:52.827028 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caadc6-9ed1-4dff-a331-f183e8cf5279 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:52.871433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:52.882509 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33a80a-762d-4201-b1fb-181992b59573 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:52.917670 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317953e4-1af4-493b-9980-9e6b1836c3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:52.918321 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317953e4-1af4-493b-9980-9e6b1836c3d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:52.918598 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317953e4-1af4-493b-9980-9e6b1836c3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:52.918900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317953e4-1af4-493b-9980-9e6b1836c3d4 None admin] PATH_INFO: `/v3/projects/9e4a28c765cb4c88bdce9712025f4ddb/users/d8659f4d59f0408e834ef42541a2f4df/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:52.920812 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317953e4-1af4-493b-9980-9e6b1836c3d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e4a28c765cb4c88bdce9712025f4ddb, user_id=d8659f4d59f0408e834ef42541a2f4df, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:52.922231 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317953e4-1af4-493b-9980-9e6b1836c3d4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:52.932514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caadc6-9ed1-4dff-a331-f183e8cf5279 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:52.935627 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 549/1085] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:20:52 2022] PUT /identity/v3/projects/9e4a28c765cb4c88bdce9712025f4ddb/users/d8659f4d59f0408e834ef42541a2f4df/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:20:52.936409 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317953e4-1af4-493b-9980-9e6b1836c3d4 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:52.979406 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2f96a-ab1f-4b22-9ff7-10b84c4d7ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:52.980040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2f96a-ab1f-4b22-9ff7-10b84c4d7ece None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:52.980323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2f96a-ab1f-4b22-9ff7-10b84c4d7ece None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:52.980599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2f96a-ab1f-4b22-9ff7-10b84c4d7ece None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:52.981298 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2f96a-ab1f-4b22-9ff7-10b84c4d7ece None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:52.981608 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2f96a-ab1f-4b22-9ff7-10b84c4d7ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:52.983164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2f96a-ab1f-4b22-9ff7-10b84c4d7ece None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:53.006738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 537/1086] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:53.067514 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317953e4-1af4-493b-9980-9e6b1836c3d4 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:53.111946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ec17a-5ee7-4013-86ae-5f59bdc762ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:53.112585 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ec17a-5ee7-4013-86ae-5f59bdc762ca None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:53.112861 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ec17a-5ee7-4013-86ae-5f59bdc762ca None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:53.113130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ec17a-5ee7-4013-86ae-5f59bdc762ca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:53.124830 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ec17a-5ee7-4013-86ae-5f59bdc762ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:53.129799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-a84ec17a-5ee7-4013-86ae-5f59bdc762ca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:20:53.129799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:53.129799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:53.129799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:53.129799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:53.129799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:53.129799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:53.129799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:53.129799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:53.129799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:53.129799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:53.129799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:53.129799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:53.129799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:53.129799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:53.129799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:53.130831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:53.130831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:53.130831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:53.130831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:53.130831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:53.130831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:53.130831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:53.130831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:53.130831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:53.130831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:53.130831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:53.130831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:53.130831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:53.130831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:53.130831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:53.130831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:53.131794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:53.131794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:53.131794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:53.131794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:53.131794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:53.131794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:53.131794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:53.131794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:53.131794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:53.131794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:53.131794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:20:53.131794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:53.131794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 550/1087] 10.222.0.71 () {56 vars in 1120 bytes} [Thu Sep 1 16:20:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:53.138137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2f96a-ab1f-4b22-9ff7-10b84c4d7ece None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:53.198035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:53.245188 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2f96a-ab1f-4b22-9ff7-10b84c4d7ece None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:53.280893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422e5e5-0440-47b5-9ebe-5dd87236006e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:53.281504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422e5e5-0440-47b5-9ebe-5dd87236006e None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:53.281781 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422e5e5-0440-47b5-9ebe-5dd87236006e None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:53.282047 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422e5e5-0440-47b5-9ebe-5dd87236006e None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:53.282831 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422e5e5-0440-47b5-9ebe-5dd87236006e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:53.283142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422e5e5-0440-47b5-9ebe-5dd87236006e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:53.284489 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422e5e5-0440-47b5-9ebe-5dd87236006e None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:53.293859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 538/1088] 10.222.0.71 () {56 vars in 1115 bytes} [Thu Sep 1 16:20:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:53.299477 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ec17a-5ee7-4013-86ae-5f59bdc762ca None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:53.312571 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:53.403115 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ec17a-5ee7-4013-86ae-5f59bdc762ca None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:53.436461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc57ca6-0a2b-41a0-ac5e-0e87807a4761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:53.437079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc57ca6-0a2b-41a0-ac5e-0e87807a4761 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:53.437351 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc57ca6-0a2b-41a0-ac5e-0e87807a4761 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:53.437621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc57ca6-0a2b-41a0-ac5e-0e87807a4761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:53.447965 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc57ca6-0a2b-41a0-ac5e-0e87807a4761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:53.449395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc57ca6-0a2b-41a0-ac5e-0e87807a4761 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:53.464223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-cbc57ca6-0a2b-41a0-ac5e-0e87807a4761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:53.464223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:53.464223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:53.464223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:53.464223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:53.464223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:53.464223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:53.464223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:53.464223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:53.464223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:53.464223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:53.464223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:53.464223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:53.464223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:53.464223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:53.464223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:53.465333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:53.465333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:53.465333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:53.465333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:53.465333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:53.465333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:53.465333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:53.465333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:53.465333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:53.465333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:53.465333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:53.465333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:53.465333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:53.465333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:53.465333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:53.465333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:53.465333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:53.466249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:53.466249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:53.466249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:53.466249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 551/1089] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:53.471623 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422e5e5-0440-47b5-9ebe-5dd87236006e None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:53.567242 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422e5e5-0440-47b5-9ebe-5dd87236006e None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:53.583879 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:53.600689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c6199-276d-4de5-882a-37ca878ac758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:53.601337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c6199-276d-4de5-882a-37ca878ac758 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:53.601616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c6199-276d-4de5-882a-37ca878ac758 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:53.601887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c6199-276d-4de5-882a-37ca878ac758 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:53.602525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c6199-276d-4de5-882a-37ca878ac758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:53.602854 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c6199-276d-4de5-882a-37ca878ac758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:53.604199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c6199-276d-4de5-882a-37ca878ac758 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:53.617674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 539/1090] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:53.624010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc57ca6-0a2b-41a0-ac5e-0e87807a4761 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:53.683144 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:53.722694 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc57ca6-0a2b-41a0-ac5e-0e87807a4761 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:53.755077 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01b795-3865-44b8-a1a4-e623cb69cd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:53.755684 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01b795-3865-44b8-a1a4-e623cb69cd3f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:53.755958 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01b795-3865-44b8-a1a4-e623cb69cd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:53.756224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01b795-3865-44b8-a1a4-e623cb69cd3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:53.763214 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01b795-3865-44b8-a1a4-e623cb69cd3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:53.764626 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01b795-3865-44b8-a1a4-e623cb69cd3f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:53.775864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-0b01b795-3865-44b8-a1a4-e623cb69cd3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:53.775864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:53.775864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:53.775864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:53.775864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:53.775864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:53.775864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:53.775864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:53.775864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:53.775864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:53.775864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:53.775864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:53.775864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:53.775864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:53.775864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:53.775864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:53.776983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:53.778178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:53.778178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:53.778178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:53.778178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:53.778178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:53.778178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:53.778178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:53.778178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:53.778178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:53.778178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:20:53.778178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 552/1091] 10.222.0.71 () {56 vars in 1093 bytes} [Thu Sep 1 16:20:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:53.782643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c6199-276d-4de5-882a-37ca878ac758 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:53.878174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c6199-276d-4de5-882a-37ca878ac758 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:53.910493 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09577596-8627-4861-b933-ac486ea38f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:53.911114 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09577596-8627-4861-b933-ac486ea38f2c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:53.911391 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09577596-8627-4861-b933-ac486ea38f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:53.911653 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09577596-8627-4861-b933-ac486ea38f2c None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:53.912369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09577596-8627-4861-b933-ac486ea38f2c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:53.912666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09577596-8627-4861-b933-ac486ea38f2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:53.914599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09577596-8627-4861-b933-ac486ea38f2c None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:53.931714 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 540/1092] 10.222.0.71 () {56 vars in 1133 bytes} [Thu Sep 1 16:20:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:53.937396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01b795-3865-44b8-a1a4-e623cb69cd3f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:54.035551 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01b795-3865-44b8-a1a4-e623cb69cd3f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:54.058404 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:54.070263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64800a-1d24-4e07-9d88-601da2159305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:54.070896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64800a-1d24-4e07-9d88-601da2159305 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:54.071177 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64800a-1d24-4e07-9d88-601da2159305 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:54.071446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64800a-1d24-4e07-9d88-601da2159305 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:54.136233 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64800a-1d24-4e07-9d88-601da2159305 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:54.137589 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64800a-1d24-4e07-9d88-601da2159305 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:54.239506 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 553/1093] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:20:54.245792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09577596-8627-4861-b933-ac486ea38f2c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:54.281944 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:54.348657 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09577596-8627-4861-b933-ac486ea38f2c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:54.382140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537beb7-427d-4911-a9cc-59675761d8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:54.383337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537beb7-427d-4911-a9cc-59675761d8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:54.383617 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537beb7-427d-4911-a9cc-59675761d8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:54.383883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537beb7-427d-4911-a9cc-59675761d8e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:54.393827 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537beb7-427d-4911-a9cc-59675761d8e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:54.395252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537beb7-427d-4911-a9cc-59675761d8e3 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:54.409575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-c537beb7-427d-4911-a9cc-59675761d8e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:54.409575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:54.409575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:54.409575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:54.409575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:54.409575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:54.409575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:54.409575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:54.409575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:54.409575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:54.409575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:54.409575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:54.409575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:54.409575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:54.409575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:54.409575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:54.410816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:54.410816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:54.410816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:54.410816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:54.410816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:54.410816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:54.410816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:54.410816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:54.410816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:54.410816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:54.410816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:54.410816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:54.410816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:54.410816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:54.410816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:54.410816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:54.410816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:54.411739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:54.411739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:54.411739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:54.411739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 541/1094] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:54.416546 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64800a-1d24-4e07-9d88-601da2159305 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:54.439895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:54.516223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64800a-1d24-4e07-9d88-601da2159305 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:54.549198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42b6df-d997-48a4-8862-5abef0e0c679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:54.549797 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42b6df-d997-48a4-8862-5abef0e0c679 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:54.550069 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42b6df-d997-48a4-8862-5abef0e0c679 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:54.550332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42b6df-d997-48a4-8862-5abef0e0c679 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:54.551075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42b6df-d997-48a4-8862-5abef0e0c679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:54.551372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42b6df-d997-48a4-8862-5abef0e0c679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:54.552774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42b6df-d997-48a4-8862-5abef0e0c679 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:54.564199 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 554/1095] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:54.569896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537beb7-427d-4911-a9cc-59675761d8e3 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:54.660073 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:54.672069 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537beb7-427d-4911-a9cc-59675761d8e3 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:54.704467 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602cfee-f463-4fd7-b157-60d852e8a914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:54.705088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602cfee-f463-4fd7-b157-60d852e8a914 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:54.705366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602cfee-f463-4fd7-b157-60d852e8a914 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:54.705639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602cfee-f463-4fd7-b157-60d852e8a914 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:54.712770 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602cfee-f463-4fd7-b157-60d852e8a914 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:54.714205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602cfee-f463-4fd7-b157-60d852e8a914 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:54.726793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-2602cfee-f463-4fd7-b157-60d852e8a914 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:54.726793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:54.726793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:54.726793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:54.726793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:54.726793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:54.726793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:54.726793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:54.726793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:54.726793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:54.726793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:54.726793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:54.726793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:54.726793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:54.726793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:54.727793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:54.727793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:54.727793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:54.727793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:54.727793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:54.727793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:54.727793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:54.727793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:54.727793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:54.727793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:54.727793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:54.727793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:54.727793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:54.727793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:54.727793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:54.727793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:54.727793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:54.728719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:54.728719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:54.728719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:54.728719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:54.728719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:54.728719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:54.728719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:54.728719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:54.728719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 542/1096] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:54.733732 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42b6df-d997-48a4-8862-5abef0e0c679 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:54.813239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:54.831430 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42b6df-d997-48a4-8862-5abef0e0c679 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:54.863120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a94a66-bf90-488c-b9df-e53c8721512f None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:54.863619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a94a66-bf90-488c-b9df-e53c8721512f None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:54.863714 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a94a66-bf90-488c-b9df-e53c8721512f None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:54.864998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 543/1097] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:54.865439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3b316-ac03-4524-af91-7a6d740ad83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:54.866032 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3b316-ac03-4524-af91-7a6d740ad83e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:54.866302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3b316-ac03-4524-af91-7a6d740ad83e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:54.866564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3b316-ac03-4524-af91-7a6d740ad83e None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:54.867873 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3b316-ac03-4524-af91-7a6d740ad83e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:54.868170 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3b316-ac03-4524-af91-7a6d740ad83e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:54.869580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3b316-ac03-4524-af91-7a6d740ad83e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:54.870346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e093f-3e06-41ac-a279-3b6abb026992 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:54.870642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e093f-3e06-41ac-a279-3b6abb026992 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:54.870930 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e093f-3e06-41ac-a279-3b6abb026992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:54.881635 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 555/1098] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:54.887518 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3b316-ac03-4524-af91-7a6d740ad83e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:54.888682 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-bb7e093f-3e06-41ac-a279-3b6abb026992 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:54.889853 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-bb7e093f-3e06-41ac-a279-3b6abb026992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:54.958166 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 544/1099] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:54.983982 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3b316-ac03-4524-af91-7a6d740ad83e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:55.016515 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62363b7e-a1b0-48d9-9709-8b696ae3bdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:55.017108 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62363b7e-a1b0-48d9-9709-8b696ae3bdda None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:55.017381 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62363b7e-a1b0-48d9-9709-8b696ae3bdda None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:55.017650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62363b7e-a1b0-48d9-9709-8b696ae3bdda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:55.018364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62363b7e-a1b0-48d9-9709-8b696ae3bdda None admin] RBAC: Adding query filter params (role.id=0d6c0de77625409c8fe68e983df3a394, scope.project.id=9527063094354a99a80822107d2740fb, user.id=ed71d63cd24f4a6caf6ebba2c30d3608) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:55.018698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62363b7e-a1b0-48d9-9709-8b696ae3bdda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:55.020112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62363b7e-a1b0-48d9-9709-8b696ae3bdda None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:55.026211 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 556/1100] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:54 2022] GET /identity/v3/role_assignments?user.id=ed71d63cd24f4a6caf6ebba2c30d3608&scope.project.id=9527063094354a99a80822107d2740fb&role.id=0d6c0de77625409c8fe68e983df3a394 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:55.228620 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e093f-3e06-41ac-a279-3b6abb026992 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:55.307909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:55.329702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e093f-3e06-41ac-a279-3b6abb026992 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:55.363994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd3a0e-1c1a-4388-a97d-afa795363eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:55.364617 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd3a0e-1c1a-4388-a97d-afa795363eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:55.364890 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd3a0e-1c1a-4388-a97d-afa795363eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:55.365153 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd3a0e-1c1a-4388-a97d-afa795363eb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:55.375137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd3a0e-1c1a-4388-a97d-afa795363eb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:55.379893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-a8cd3a0e-1c1a-4388-a97d-afa795363eb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:55.379893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:55.379893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:55.379893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:55.379893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:55.379893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:55.379893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:55.379893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:55.379893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:55.379893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:55.379893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:55.379893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:55.379893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:55.379893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:55.379893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:55.379893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:55.380849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:55.380849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:55.380849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:55.380849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:55.380849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:55.380849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:55.380849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:55.380849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:55.380849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:55.380849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:55.380849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:55.380849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:55.380849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:55.380849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:55.380849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:55.380849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:55.381742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:55.381742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:55.381742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:55.381742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:55.381742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:55.381742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:55.381742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:55.381742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:55.381742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:55.381742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:55.381742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:55.381742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:20:55.381742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 545/1101] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:55.387596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62363b7e-a1b0-48d9-9709-8b696ae3bdda None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:55.396530 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:55.496233 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62363b7e-a1b0-48d9-9709-8b696ae3bdda None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:55.529533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571199bc-72a6-4831-99d9-99c5ee88b888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:55.530136 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571199bc-72a6-4831-99d9-99c5ee88b888 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:55.530411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571199bc-72a6-4831-99d9-99c5ee88b888 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:55.530704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571199bc-72a6-4831-99d9-99c5ee88b888 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:55.531366 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571199bc-72a6-4831-99d9-99c5ee88b888 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:55.531666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571199bc-72a6-4831-99d9-99c5ee88b888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:55.533033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571199bc-72a6-4831-99d9-99c5ee88b888 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:55.541696 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 557/1102] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:55.547686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd3a0e-1c1a-4388-a97d-afa795363eb0 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:55.650915 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd3a0e-1c1a-4388-a97d-afa795363eb0 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:55.685236 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077f6c4-98ff-4628-a576-12c032b5474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:55.685858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077f6c4-98ff-4628-a576-12c032b5474c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:55.686134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077f6c4-98ff-4628-a576-12c032b5474c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:55.686404 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077f6c4-98ff-4628-a576-12c032b5474c None admin] PATH_INFO: `/v3/users/d8659f4d59f0408e834ef42541a2f4df` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:55.687557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077f6c4-98ff-4628-a576-12c032b5474c None admin] RBAC: Authorizing `identity:get_user(user_id=d8659f4d59f0408e834ef42541a2f4df)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:55.689036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077f6c4-98ff-4628-a576-12c032b5474c None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:55.690669 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 546/1103] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:20:55 2022] GET /identity/v3/users/d8659f4d59f0408e834ef42541a2f4df => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:55.696654 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571199bc-72a6-4831-99d9-99c5ee88b888 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:55.766060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:55.800396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571199bc-72a6-4831-99d9-99c5ee88b888 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:55.840279 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119e252-4b4c-4e04-aebd-c4f4386e50a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:55.840891 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119e252-4b4c-4e04-aebd-c4f4386e50a4 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:55.841186 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119e252-4b4c-4e04-aebd-c4f4386e50a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:55.841432 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119e252-4b4c-4e04-aebd-c4f4386e50a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:55.909447 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119e252-4b4c-4e04-aebd-c4f4386e50a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:55.910908 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119e252-4b4c-4e04-aebd-c4f4386e50a4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:55.972693 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:56.005269 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 558/1104] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:20:56.011165 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077f6c4-98ff-4628-a576-12c032b5474c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:56.019974 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:56.107955 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077f6c4-98ff-4628-a576-12c032b5474c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:56.140414 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815af73-0672-4b0b-bb47-0516d75460bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:56.141021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815af73-0672-4b0b-bb47-0516d75460bb None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:56.141295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815af73-0672-4b0b-bb47-0516d75460bb None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:56.141588 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815af73-0672-4b0b-bb47-0516d75460bb None admin] PATH_INFO: `/v3/projects/9e4a28c765cb4c88bdce9712025f4ddb` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:56.142709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815af73-0672-4b0b-bb47-0516d75460bb None admin] RBAC: Authorizing `identity:get_project(project_id=9e4a28c765cb4c88bdce9712025f4ddb)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:56.144157 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815af73-0672-4b0b-bb47-0516d75460bb None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:56.145757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 547/1105] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:20:56 2022] GET /identity/v3/projects/9e4a28c765cb4c88bdce9712025f4ddb => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:56.152390 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119e252-4b4c-4e04-aebd-c4f4386e50a4 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:56.247677 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119e252-4b4c-4e04-aebd-c4f4386e50a4 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:56.280774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b1acf-c307-4fd7-aba0-691b4648496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:56.281307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b1acf-c307-4fd7-aba0-691b4648496f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:56.281582 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b1acf-c307-4fd7-aba0-691b4648496f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:56.281855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b1acf-c307-4fd7-aba0-691b4648496f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:56.282570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b1acf-c307-4fd7-aba0-691b4648496f None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.project.id=9e4a28c765cb4c88bdce9712025f4ddb, user.id=d8659f4d59f0408e834ef42541a2f4df) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:56.282908 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b1acf-c307-4fd7-aba0-691b4648496f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:56.284318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b1acf-c307-4fd7-aba0-691b4648496f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:56.289883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 559/1106] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:56 2022] GET /identity/v3/role_assignments?user.id=d8659f4d59f0408e834ef42541a2f4df&scope.project.id=9e4a28c765cb4c88bdce9712025f4ddb&role.id=3cd61239237441418529e9028ef801e4 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:58.203771 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a4110-dc3b-4d94-83d9-f7d2d24f1f8c None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:58.204297 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a4110-dc3b-4d94-83d9-f7d2d24f1f8c None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:58.204297 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a4110-dc3b-4d94-83d9-f7d2d24f1f8c None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:58.205651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 548/1107] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:58.211285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7de1ac-275e-49b2-9f53-ea8c4a9ba7cb None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:58.211725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7de1ac-275e-49b2-9f53-ea8c4a9ba7cb None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:58.211881 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7de1ac-275e-49b2-9f53-ea8c4a9ba7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:58.230551 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7d7de1ac-275e-49b2-9f53-ea8c4a9ba7cb None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:58.231985 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7d7de1ac-275e-49b2-9f53-ea8c4a9ba7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:58.259501 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:58.300050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 560/1108] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:58.565883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a4110-dc3b-4d94-83d9-f7d2d24f1f8c None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:58.640983 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:58.666638 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a4110-dc3b-4d94-83d9-f7d2d24f1f8c None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:58.699388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41a204-513d-4ef3-a300-aed26f58c8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:58.700003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41a204-513d-4ef3-a300-aed26f58c8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:58.700284 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41a204-513d-4ef3-a300-aed26f58c8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:58.700558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41a204-513d-4ef3-a300-aed26f58c8d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:58.701655 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41a204-513d-4ef3-a300-aed26f58c8d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:58.703095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41a204-513d-4ef3-a300-aed26f58c8d8 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:58.704649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 549/1109] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:58.710917 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7de1ac-275e-49b2-9f53-ea8c4a9ba7cb None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:58.805121 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7de1ac-275e-49b2-9f53-ea8c4a9ba7cb None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:58.837828 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca70558-afff-4ac8-9aed-8c867fc0b5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:58.838348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca70558-afff-4ac8-9aed-8c867fc0b5b4 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:58.838648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca70558-afff-4ac8-9aed-8c867fc0b5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:58.838924 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca70558-afff-4ac8-9aed-8c867fc0b5b4 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:58.839564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca70558-afff-4ac8-9aed-8c867fc0b5b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:58.840971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca70558-afff-4ac8-9aed-8c867fc0b5b4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:58.862917 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 561/1110] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:20:58 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:21:00.811744 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a910be-562c-4221-9ee2-e8d9fb812b90 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:00.812294 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a910be-562c-4221-9ee2-e8d9fb812b90 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:00.812294 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a910be-562c-4221-9ee2-e8d9fb812b90 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:00.813632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 550/1111] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:00.818794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d6c71-7b4e-48a9-8d78-6706dfc8c70d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:00.819184 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d6c71-7b4e-48a9-8d78-6706dfc8c70d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:00.819345 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d6c71-7b4e-48a9-8d78-6706dfc8c70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:00.838821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-6f8d6c71-7b4e-48a9-8d78-6706dfc8c70d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:00.840000 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6f8d6c71-7b4e-48a9-8d78-6706dfc8c70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:00.852913 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:00.907522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 562/1112] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:01.188075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a910be-562c-4221-9ee2-e8d9fb812b90 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:01.285589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a910be-562c-4221-9ee2-e8d9fb812b90 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:01.317989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7afaf3-983d-4c01-8b2e-4a6054d4ce32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:01.318603 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7afaf3-983d-4c01-8b2e-4a6054d4ce32 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:01.318918 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7afaf3-983d-4c01-8b2e-4a6054d4ce32 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:01.319191 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7afaf3-983d-4c01-8b2e-4a6054d4ce32 None admin] PATH_INFO: `/v3/roles/0e112f96840a483bb6dfeab1bb8af187` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:01.320603 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7afaf3-983d-4c01-8b2e-4a6054d4ce32 None admin] RBAC: Authorizing `identity:get_role(role_id=0e112f96840a483bb6dfeab1bb8af187)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:01.321957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7afaf3-983d-4c01-8b2e-4a6054d4ce32 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:01.323281 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 551/1113] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:01 2022] GET /identity/v3/roles/0e112f96840a483bb6dfeab1bb8af187 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:01.329045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d6c71-7b4e-48a9-8d78-6706dfc8c70d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:01.422928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d6c71-7b4e-48a9-8d78-6706dfc8c70d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:01.454755 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75f1bb-f4b7-41b2-b9c3-e9e003ca00ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:01.455308 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75f1bb-f4b7-41b2-b9c3-e9e003ca00ae None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:01.455580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75f1bb-f4b7-41b2-b9c3-e9e003ca00ae None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:01.455843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75f1bb-f4b7-41b2-b9c3-e9e003ca00ae None admin] PATH_INFO: `/v3/users/ea5eff3bb6a04eaaa2a464a2c4b920d2` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:01.468869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75f1bb-f4b7-41b2-b9c3-e9e003ca00ae None admin] RBAC: Authorizing `identity:get_user(user_id=ea5eff3bb6a04eaaa2a464a2c4b920d2)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:01.470271 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75f1bb-f4b7-41b2-b9c3-e9e003ca00ae None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:01.471862 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 563/1114] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:01 2022] GET /identity/v3/users/ea5eff3bb6a04eaaa2a464a2c4b920d2 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:01.477699 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7afaf3-983d-4c01-8b2e-4a6054d4ce32 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:01.490772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:01.575278 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7afaf3-983d-4c01-8b2e-4a6054d4ce32 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:01.607734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85716634-62bf-418b-b01f-c75b2846b40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:01.608333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85716634-62bf-418b-b01f-c75b2846b40a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:01.608610 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85716634-62bf-418b-b01f-c75b2846b40a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:01.608882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85716634-62bf-418b-b01f-c75b2846b40a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:01.673888 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85716634-62bf-418b-b01f-c75b2846b40a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:01.675339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85716634-62bf-418b-b01f-c75b2846b40a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:01.685819 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:01.770167 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 552/1115] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:21:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:21:01.776622 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75f1bb-f4b7-41b2-b9c3-e9e003ca00ae None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:01.785094 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:01.871952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75f1bb-f4b7-41b2-b9c3-e9e003ca00ae None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:01.904016 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b27f7-8ef9-4ed4-808e-30003b7a72a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:01.904620 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b27f7-8ef9-4ed4-808e-30003b7a72a1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:01.904896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b27f7-8ef9-4ed4-808e-30003b7a72a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:01.905167 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b27f7-8ef9-4ed4-808e-30003b7a72a1 None admin] PATH_INFO: `/v3/projects/9e4a28c765cb4c88bdce9712025f4ddb` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:01.906263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b27f7-8ef9-4ed4-808e-30003b7a72a1 None admin] RBAC: Authorizing `identity:get_project(project_id=9e4a28c765cb4c88bdce9712025f4ddb)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:01.907701 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b27f7-8ef9-4ed4-808e-30003b7a72a1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:01.909293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 564/1116] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:01 2022] GET /identity/v3/projects/9e4a28c765cb4c88bdce9712025f4ddb => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:01.915390 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85716634-62bf-418b-b01f-c75b2846b40a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:02.011503 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85716634-62bf-418b-b01f-c75b2846b40a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:02.021633 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:02.044222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf215c0-0664-4b51-95ea-ab85a18682f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:02.044799 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf215c0-0664-4b51-95ea-ab85a18682f4 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:02.045074 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf215c0-0664-4b51-95ea-ab85a18682f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:02.045342 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf215c0-0664-4b51-95ea-ab85a18682f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:02.046052 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf215c0-0664-4b51-95ea-ab85a18682f4 None admin] RBAC: Adding query filter params (role.id=0e112f96840a483bb6dfeab1bb8af187, scope.project.id=9e4a28c765cb4c88bdce9712025f4ddb, user.id=ea5eff3bb6a04eaaa2a464a2c4b920d2) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:02.046354 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf215c0-0664-4b51-95ea-ab85a18682f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:02.047780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf215c0-0664-4b51-95ea-ab85a18682f4 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:02.052929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 553/1117] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:21:01 2022] GET /identity/v3/role_assignments?user.id=ea5eff3bb6a04eaaa2a464a2c4b920d2&scope.project.id=9e4a28c765cb4c88bdce9712025f4ddb&role.id=0e112f96840a483bb6dfeab1bb8af187 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:03.923072 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595ffd9-c292-46a2-9188-078fa84565e3 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:03.923581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595ffd9-c292-46a2-9188-078fa84565e3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:03.923581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595ffd9-c292-46a2-9188-078fa84565e3 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:03.924905 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 565/1118] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:03.929982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509511f-539a-4690-8e28-b1d157ff19ed None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:03.930378 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509511f-539a-4690-8e28-b1d157ff19ed None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:03.930528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509511f-539a-4690-8e28-b1d157ff19ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:03.948766 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-2509511f-539a-4690-8e28-b1d157ff19ed None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:03.949971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2509511f-539a-4690-8e28-b1d157ff19ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:04.013801 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 554/1119] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:04.278167 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595ffd9-c292-46a2-9188-078fa84565e3 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:04.353779 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:04.379615 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595ffd9-c292-46a2-9188-078fa84565e3 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:04.412815 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa29b0-a255-4210-9d0d-ae5e6e0d7040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:04.413944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa29b0-a255-4210-9d0d-ae5e6e0d7040 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:04.414221 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa29b0-a255-4210-9d0d-ae5e6e0d7040 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:04.414490 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa29b0-a255-4210-9d0d-ae5e6e0d7040 None admin] PATH_INFO: `/v3/roles/0e112f96840a483bb6dfeab1bb8af187` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:04.415897 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa29b0-a255-4210-9d0d-ae5e6e0d7040 None admin] RBAC: Authorizing `identity:get_role(role_id=0e112f96840a483bb6dfeab1bb8af187)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:04.417254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa29b0-a255-4210-9d0d-ae5e6e0d7040 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:04.418581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 566/1120] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:04 2022] GET /identity/v3/roles/0e112f96840a483bb6dfeab1bb8af187 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:04.424433 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509511f-539a-4690-8e28-b1d157ff19ed None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:04.518357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509511f-539a-4690-8e28-b1d157ff19ed None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:04.520590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:04.550843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b09c2-a1e3-43f8-9395-b0b8894dec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:04.551445 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b09c2-a1e3-43f8-9395-b0b8894dec7b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:04.551720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b09c2-a1e3-43f8-9395-b0b8894dec7b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:04.551990 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b09c2-a1e3-43f8-9395-b0b8894dec7b None admin] PATH_INFO: `/v3/users/ea5eff3bb6a04eaaa2a464a2c4b920d2` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:04.553083 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b09c2-a1e3-43f8-9395-b0b8894dec7b None admin] RBAC: Authorizing `identity:get_user(user_id=ea5eff3bb6a04eaaa2a464a2c4b920d2)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:04.555060 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b09c2-a1e3-43f8-9395-b0b8894dec7b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:04.556602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 555/1121] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:04 2022] GET /identity/v3/users/ea5eff3bb6a04eaaa2a464a2c4b920d2 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:04.562226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa29b0-a255-4210-9d0d-ae5e6e0d7040 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:04.662264 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa29b0-a255-4210-9d0d-ae5e6e0d7040 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:04.694230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2178da-cc9f-4766-9505-61048530bf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:04.695364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2178da-cc9f-4766-9505-61048530bf38 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:04.695640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2178da-cc9f-4766-9505-61048530bf38 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:04.695906 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2178da-cc9f-4766-9505-61048530bf38 None admin] PATH_INFO: `/v3/projects/9e4a28c765cb4c88bdce9712025f4ddb` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:04.697014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2178da-cc9f-4766-9505-61048530bf38 None admin] RBAC: Authorizing `identity:get_project(project_id=9e4a28c765cb4c88bdce9712025f4ddb)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:04.698423 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2178da-cc9f-4766-9505-61048530bf38 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:04.700073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 567/1122] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:04 2022] GET /identity/v3/projects/9e4a28c765cb4c88bdce9712025f4ddb => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:04.706051 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b09c2-a1e3-43f8-9395-b0b8894dec7b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:04.803063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b09c2-a1e3-43f8-9395-b0b8894dec7b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:04.835579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749a4b7-4407-4ff3-9f14-0c2989b5ec7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:04.836215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749a4b7-4407-4ff3-9f14-0c2989b5ec7e None admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:04.836494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749a4b7-4407-4ff3-9f14-0c2989b5ec7e None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:04.836764 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749a4b7-4407-4ff3-9f14-0c2989b5ec7e None admin] PATH_INFO: `/v3/projects/9e4a28c765cb4c88bdce9712025f4ddb/users/ea5eff3bb6a04eaaa2a464a2c4b920d2/roles/0e112f96840a483bb6dfeab1bb8af187` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:04.839103 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749a4b7-4407-4ff3-9f14-0c2989b5ec7e None admin] RBAC: Authorizing `identity:create_grant(project_id=9e4a28c765cb4c88bdce9712025f4ddb, user_id=ea5eff3bb6a04eaaa2a464a2c4b920d2, role_id=0e112f96840a483bb6dfeab1bb8af187)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:04.840525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749a4b7-4407-4ff3-9f14-0c2989b5ec7e None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:04.853198 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 556/1123] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:21:04 2022] PUT /identity/v3/projects/9e4a28c765cb4c88bdce9712025f4ddb/users/ea5eff3bb6a04eaaa2a464a2c4b920d2/roles/0e112f96840a483bb6dfeab1bb8af187 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:21:06.752035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdfefd-eaab-4fd7-a891-906db20dbfe4 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:06.752584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdfefd-eaab-4fd7-a891-906db20dbfe4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:06.752584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdfefd-eaab-4fd7-a891-906db20dbfe4 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:06.753891 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 568/1124] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:06.759112 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cdf20-853c-4179-98df-24997a4e318b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:06.759549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cdf20-853c-4179-98df-24997a4e318b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:06.759651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cdf20-853c-4179-98df-24997a4e318b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:06.777288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-3f6cdf20-853c-4179-98df-24997a4e318b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:06.778463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-3f6cdf20-853c-4179-98df-24997a4e318b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:06.803555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:06.844311 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 557/1125] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:07.111992 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bdfefd-eaab-4fd7-a891-906db20dbfe4 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:07.124017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:07.207527 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bdfefd-eaab-4fd7-a891-906db20dbfe4 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:07.240368 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33fa99-bdfb-4a96-9aab-f6a5b97dcfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:07.240967 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33fa99-bdfb-4a96-9aab-f6a5b97dcfdd None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:07.241766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33fa99-bdfb-4a96-9aab-f6a5b97dcfdd None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:07.242033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33fa99-bdfb-4a96-9aab-f6a5b97dcfdd None admin] PATH_INFO: `/v3/roles/0e112f96840a483bb6dfeab1bb8af187` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:07.243411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33fa99-bdfb-4a96-9aab-f6a5b97dcfdd None admin] RBAC: Authorizing `identity:get_role(role_id=0e112f96840a483bb6dfeab1bb8af187)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:07.244743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33fa99-bdfb-4a96-9aab-f6a5b97dcfdd None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:07.246022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 569/1126] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:07 2022] GET /identity/v3/roles/0e112f96840a483bb6dfeab1bb8af187 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:07.251702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cdf20-853c-4179-98df-24997a4e318b None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:07.353275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cdf20-853c-4179-98df-24997a4e318b None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:07.385723 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b79b5b-7723-4f1d-ad1e-45585df80745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:07.386274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b79b5b-7723-4f1d-ad1e-45585df80745 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:07.386556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b79b5b-7723-4f1d-ad1e-45585df80745 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:07.386922 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b79b5b-7723-4f1d-ad1e-45585df80745 None admin] PATH_INFO: `/v3/users/ea5eff3bb6a04eaaa2a464a2c4b920d2` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:07.388039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b79b5b-7723-4f1d-ad1e-45585df80745 None admin] RBAC: Authorizing `identity:get_user(user_id=ea5eff3bb6a04eaaa2a464a2c4b920d2)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:07.389449 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b79b5b-7723-4f1d-ad1e-45585df80745 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:07.391041 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 558/1127] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:07 2022] GET /identity/v3/users/ea5eff3bb6a04eaaa2a464a2c4b920d2 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:07.396817 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33fa99-bdfb-4a96-9aab-f6a5b97dcfdd None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:07.472308 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:07.493650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33fa99-bdfb-4a96-9aab-f6a5b97dcfdd None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:07.526401 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4d613-b784-4f03-9d73-69dc4d8f9df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:07.527013 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4d613-b784-4f03-9d73-69dc4d8f9df3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:07.527289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4d613-b784-4f03-9d73-69dc4d8f9df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:07.527556 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4d613-b784-4f03-9d73-69dc4d8f9df3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:07.592258 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4d613-b784-4f03-9d73-69dc4d8f9df3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:07.593679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4d613-b784-4f03-9d73-69dc4d8f9df3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:07.667556 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:07.689451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 570/1128] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:21:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:21:07.695305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b79b5b-7723-4f1d-ad1e-45585df80745 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:07.725070 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:07.792021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b79b5b-7723-4f1d-ad1e-45585df80745 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:07.824008 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e7462-9bc4-4a33-943b-a31fca9590fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:07.824615 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e7462-9bc4-4a33-943b-a31fca9590fe None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:07.824897 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e7462-9bc4-4a33-943b-a31fca9590fe None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:07.825170 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e7462-9bc4-4a33-943b-a31fca9590fe None admin] PATH_INFO: `/v3/projects/9e4a28c765cb4c88bdce9712025f4ddb` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:07.826278 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e7462-9bc4-4a33-943b-a31fca9590fe None admin] RBAC: Authorizing `identity:get_project(project_id=9e4a28c765cb4c88bdce9712025f4ddb)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:07.827719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e7462-9bc4-4a33-943b-a31fca9590fe None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:07.829324 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 559/1129] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:07 2022] GET /identity/v3/projects/9e4a28c765cb4c88bdce9712025f4ddb => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:07.836024 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4d613-b784-4f03-9d73-69dc4d8f9df3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:07.931144 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4d613-b784-4f03-9d73-69dc4d8f9df3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:07.963538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6353b-5d1d-486d-9ab0-dc1063822c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:07.964165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6353b-5d1d-486d-9ab0-dc1063822c17 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:07.964398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6353b-5d1d-486d-9ab0-dc1063822c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:07.964666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6353b-5d1d-486d-9ab0-dc1063822c17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:07.965381 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6353b-5d1d-486d-9ab0-dc1063822c17 None admin] RBAC: Adding query filter params (role.id=0e112f96840a483bb6dfeab1bb8af187, scope.project.id=9e4a28c765cb4c88bdce9712025f4ddb, user.id=ea5eff3bb6a04eaaa2a464a2c4b920d2) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:07.965688 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6353b-5d1d-486d-9ab0-dc1063822c17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:07.967404 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6353b-5d1d-486d-9ab0-dc1063822c17 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:07.972967 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 571/1130] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:21:07 2022] GET /identity/v3/role_assignments?user.id=ea5eff3bb6a04eaaa2a464a2c4b920d2&scope.project.id=9e4a28c765cb4c88bdce9712025f4ddb&role.id=0e112f96840a483bb6dfeab1bb8af187 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:09.845737 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f348b9-1f62-4adc-bffc-6bb4d3c2d944 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:09.846279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f348b9-1f62-4adc-bffc-6bb4d3c2d944 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:09.846279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f348b9-1f62-4adc-bffc-6bb4d3c2d944 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:09.847633 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 560/1131] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:09.852984 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7719c3a-6522-436d-960f-40829447d252 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:09.853380 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7719c3a-6522-436d-960f-40829447d252 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:09.853537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7719c3a-6522-436d-960f-40829447d252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:09.871253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b7719c3a-6522-436d-960f-40829447d252 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:09.872433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b7719c3a-6522-436d-960f-40829447d252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:09.907128 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:09.936786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 572/1132] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:10.208164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f348b9-1f62-4adc-bffc-6bb4d3c2d944 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:10.302390 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:10.307890 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f348b9-1f62-4adc-bffc-6bb4d3c2d944 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:10.340677 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d178286-e75b-4ece-bfa4-723c395b138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:10.341280 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d178286-e75b-4ece-bfa4-723c395b138c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:10.341812 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d178286-e75b-4ece-bfa4-723c395b138c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:10.342080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d178286-e75b-4ece-bfa4-723c395b138c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:10.343197 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d178286-e75b-4ece-bfa4-723c395b138c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:10.344615 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d178286-e75b-4ece-bfa4-723c395b138c None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:10.346160 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 561/1133] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:10.351992 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7719c3a-6522-436d-960f-40829447d252 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:10.450840 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7719c3a-6522-436d-960f-40829447d252 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:10.484061 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441761ed-564a-4571-af09-504deb4c9c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:10.484589 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441761ed-564a-4571-af09-504deb4c9c8c None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:10.484870 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441761ed-564a-4571-af09-504deb4c9c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:10.485138 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441761ed-564a-4571-af09-504deb4c9c8c None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:10.485779 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441761ed-564a-4571-af09-504deb4c9c8c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:10.487234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441761ed-564a-4571-af09-504deb4c9c8c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:10.513586 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 573/1134] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Sep 1 16:21:10 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:21:12.401709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe8bcd-7543-4113-8505-15a4c753903d None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:12.402263 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe8bcd-7543-4113-8505-15a4c753903d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:12.402263 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe8bcd-7543-4113-8505-15a4c753903d None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:12.403628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 562/1135] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:12.408867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b90bc8-67bb-4b07-b76c-3836805d0818 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:12.409275 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b90bc8-67bb-4b07-b76c-3836805d0818 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:12.409417 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b90bc8-67bb-4b07-b76c-3836805d0818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:12.428478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-15b90bc8-67bb-4b07-b76c-3836805d0818 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:12.429689 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-15b90bc8-67bb-4b07-b76c-3836805d0818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:12.446343 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:12.495520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 574/1136] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:12.766481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe8bcd-7543-4113-8505-15a4c753903d None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:12.867690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe8bcd-7543-4113-8505-15a4c753903d None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:12.901302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2010-ca6d-4a9a-858b-bc495fdf2437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:12.901926 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2010-ca6d-4a9a-858b-bc495fdf2437 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:12.902204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2010-ca6d-4a9a-858b-bc495fdf2437 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:12.902471 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2010-ca6d-4a9a-858b-bc495fdf2437 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:12.903601 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b2010-ca6d-4a9a-858b-bc495fdf2437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:12.905017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b2010-ca6d-4a9a-858b-bc495fdf2437 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:12.906739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 563/1137] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:12.912470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b90bc8-67bb-4b07-b76c-3836805d0818 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:13.009997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b90bc8-67bb-4b07-b76c-3836805d0818 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:13.049396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252093ae-aee2-4164-8ec8-cc19e33829b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:13.049998 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252093ae-aee2-4164-8ec8-cc19e33829b0 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:13.050276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252093ae-aee2-4164-8ec8-cc19e33829b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:13.050546 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252093ae-aee2-4164-8ec8-cc19e33829b0 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:13.051221 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252093ae-aee2-4164-8ec8-cc19e33829b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:13.052643 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252093ae-aee2-4164-8ec8-cc19e33829b0 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:13.073274 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 575/1138] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:21:12 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:21:14.960418 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67c5a6-d149-4fe0-b326-fe0582beae10 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:14.960934 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67c5a6-d149-4fe0-b326-fe0582beae10 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:14.960934 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67c5a6-d149-4fe0-b326-fe0582beae10 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:14.962188 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 564/1139] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:14.967645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53147-d745-451b-ac14-2127c5e095d7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:14.968029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53147-d745-451b-ac14-2127c5e095d7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:14.968200 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53147-d745-451b-ac14-2127c5e095d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:14.986297 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-55c53147-d745-451b-ac14-2127c5e095d7 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:14.987545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-55c53147-d745-451b-ac14-2127c5e095d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:14.990230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:15.051601 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 576/1140] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:15.316640 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67c5a6-d149-4fe0-b326-fe0582beae10 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:15.351007 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:15.421239 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67c5a6-d149-4fe0-b326-fe0582beae10 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:15.456468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12740203-2bfe-4e31-81b0-fa73439d6415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:15.457072 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12740203-2bfe-4e31-81b0-fa73439d6415 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:15.457345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12740203-2bfe-4e31-81b0-fa73439d6415 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:15.457613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12740203-2bfe-4e31-81b0-fa73439d6415 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:15.467503 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12740203-2bfe-4e31-81b0-fa73439d6415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:21:15.472204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-12740203-2bfe-4e31-81b0-fa73439d6415 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:15.472204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:15.472204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:15.472204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:15.472204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:15.472204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:15.472204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:15.472204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:15.472204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:15.472204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:15.472204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:15.472204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:15.472204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:21:15.472204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:21:15.472204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:21:15.472204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:21:15.473353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:21:15.473353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:21:15.473353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:21:15.473353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:21:15.473353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:15.473353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:15.473353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:15.473353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:15.473353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:15.473353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:15.473353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:15.473353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:15.473353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:15.473353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:15.473353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:15.473353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:15.474476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:15.474476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:15.474476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:15.474476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:15.474476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:21:15.474476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:21:15.474476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:21:15.474476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:21:15.474476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:21:15.474476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:21:15.474476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:15.474476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:21:15.474476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 565/1141] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:21:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:15.479442 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53147-d745-451b-ac14-2127c5e095d7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:15.574306 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53147-d745-451b-ac14-2127c5e095d7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:15.607015 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f3f6d-36e5-4120-aa82-76d70f8cb16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:15.607623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f3f6d-36e5-4120-aa82-76d70f8cb16c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:15.607896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f3f6d-36e5-4120-aa82-76d70f8cb16c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:15.608159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f3f6d-36e5-4120-aa82-76d70f8cb16c None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:15.608829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f3f6d-36e5-4120-aa82-76d70f8cb16c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:15.609127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f3f6d-36e5-4120-aa82-76d70f8cb16c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:15.610478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f3f6d-36e5-4120-aa82-76d70f8cb16c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:15.619138 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 577/1142] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:21:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:15.627343 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12740203-2bfe-4e31-81b0-fa73439d6415 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:15.717707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:15.724599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12740203-2bfe-4e31-81b0-fa73439d6415 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:15.758255 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ae473-e0ae-4a65-b719-91cb74f3b518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:15.758897 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ae473-e0ae-4a65-b719-91cb74f3b518 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:15.759175 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ae473-e0ae-4a65-b719-91cb74f3b518 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:15.759447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ae473-e0ae-4a65-b719-91cb74f3b518 None admin] PATH_INFO: `/v3/users/2451a47748e94d779fe3217c3e7e0791` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:15.773081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ae473-e0ae-4a65-b719-91cb74f3b518 None admin] RBAC: Authorizing `identity:get_user(user_id=2451a47748e94d779fe3217c3e7e0791)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:15.774495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ae473-e0ae-4a65-b719-91cb74f3b518 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:15.776137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 566/1143] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:15 2022] GET /identity/v3/users/2451a47748e94d779fe3217c3e7e0791 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:15.782200 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f3f6d-36e5-4120-aa82-76d70f8cb16c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:15.785060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:15.879806 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f3f6d-36e5-4120-aa82-76d70f8cb16c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:15.911476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb21d89-6f41-4d1f-beab-05958687925d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:15.912062 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb21d89-6f41-4d1f-beab-05958687925d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:15.912337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb21d89-6f41-4d1f-beab-05958687925d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:15.913120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb21d89-6f41-4d1f-beab-05958687925d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:15.978535 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb21d89-6f41-4d1f-beab-05958687925d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:15.979981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb21d89-6f41-4d1f-beab-05958687925d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:15.981718 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:16.076645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 578/1144] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:21:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:21:16.082495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ae473-e0ae-4a65-b719-91cb74f3b518 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:16.178649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ae473-e0ae-4a65-b719-91cb74f3b518 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:16.211932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd94fa2-44cd-4c40-8dee-bc14188ea19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:16.212541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd94fa2-44cd-4c40-8dee-bc14188ea19e None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:16.212813 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd94fa2-44cd-4c40-8dee-bc14188ea19e None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:16.213081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd94fa2-44cd-4c40-8dee-bc14188ea19e None admin] PATH_INFO: `/v3/projects/661277fa7f6646be92750fe8c8fca0b6` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:16.214171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd94fa2-44cd-4c40-8dee-bc14188ea19e None admin] RBAC: Authorizing `identity:get_project(project_id=661277fa7f6646be92750fe8c8fca0b6)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:16.215600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd94fa2-44cd-4c40-8dee-bc14188ea19e None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:16.217451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 567/1145] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:16 2022] GET /identity/v3/projects/661277fa7f6646be92750fe8c8fca0b6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:16.223484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb21d89-6f41-4d1f-beab-05958687925d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:16.317824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb21d89-6f41-4d1f-beab-05958687925d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:16.319379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:16.352522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5b475-42ac-48cd-8240-0bf565f8bc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:16.353116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5b475-42ac-48cd-8240-0bf565f8bc5a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:16.353389 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5b475-42ac-48cd-8240-0bf565f8bc5a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:16.353657 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5b475-42ac-48cd-8240-0bf565f8bc5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:16.354370 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5b475-42ac-48cd-8240-0bf565f8bc5a None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.project.id=661277fa7f6646be92750fe8c8fca0b6, user.id=2451a47748e94d779fe3217c3e7e0791) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:16.354702 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5b475-42ac-48cd-8240-0bf565f8bc5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:16.356107 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5b475-42ac-48cd-8240-0bf565f8bc5a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:16.361293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 579/1146] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:21:16 2022] GET /identity/v3/role_assignments?user.id=2451a47748e94d779fe3217c3e7e0791&scope.project.id=661277fa7f6646be92750fe8c8fca0b6&role.id=3cd61239237441418529e9028ef801e4 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:18.194673 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062c73d-a688-45d1-9efd-e8a432286daf None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:18.195218 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062c73d-a688-45d1-9efd-e8a432286daf None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:18.195218 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062c73d-a688-45d1-9efd-e8a432286daf None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:18.196528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 568/1147] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:18.201805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d996a5-19cf-43c9-b628-80241f02e81f None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:18.202218 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d996a5-19cf-43c9-b628-80241f02e81f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:18.202353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d996a5-19cf-43c9-b628-80241f02e81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:18.220320 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-66d996a5-19cf-43c9-b628-80241f02e81f None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:18.221494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-66d996a5-19cf-43c9-b628-80241f02e81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:18.286061 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 580/1148] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:18.553505 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062c73d-a688-45d1-9efd-e8a432286daf None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:18.574635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:18.653747 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062c73d-a688-45d1-9efd-e8a432286daf None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:18.685590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c51b84-2807-42fd-a8a1-39b9e7f52140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:18.686192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c51b84-2807-42fd-a8a1-39b9e7f52140 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:18.686464 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c51b84-2807-42fd-a8a1-39b9e7f52140 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:18.686764 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c51b84-2807-42fd-a8a1-39b9e7f52140 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:18.696829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c51b84-2807-42fd-a8a1-39b9e7f52140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:21:18.701559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-62c51b84-2807-42fd-a8a1-39b9e7f52140 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:18.701559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:18.701559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:18.701559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:18.701559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:18.701559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:18.701559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:18.701559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:18.701559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:18.701559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:18.701559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:18.701559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:18.701559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:21:18.701559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:21:18.701559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:21:18.701559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:21:18.702664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:21:18.702664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:21:18.702664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:21:18.702664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:21:18.702664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:18.702664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:18.702664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:18.702664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:18.702664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:18.702664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:18.702664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:18.702664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:18.702664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:18.702664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:18.702664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:18.702664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:18.703896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:18.703896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:18.703896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:18.703896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:18.703896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:21:18.703896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:21:18.703896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:21:18.703896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:21:18.703896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:21:18.703896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:21:18.703896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:18.703896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:21:18.703896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 569/1149] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:21:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:18.708631 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d996a5-19cf-43c9-b628-80241f02e81f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:18.796759 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:18.802781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d996a5-19cf-43c9-b628-80241f02e81f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:18.836608 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba31e4-7bf1-43de-a9ee-6926f02d30b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:18.837410 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba31e4-7bf1-43de-a9ee-6926f02d30b4 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:18.837682 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba31e4-7bf1-43de-a9ee-6926f02d30b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:18.837946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba31e4-7bf1-43de-a9ee-6926f02d30b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:18.838596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba31e4-7bf1-43de-a9ee-6926f02d30b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:18.838922 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba31e4-7bf1-43de-a9ee-6926f02d30b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:18.840285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba31e4-7bf1-43de-a9ee-6926f02d30b4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:18.848171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 581/1150] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:21:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:18.854173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c51b84-2807-42fd-a8a1-39b9e7f52140 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:18.932287 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:18.951514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c51b84-2807-42fd-a8a1-39b9e7f52140 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:18.984928 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df6916-cfe4-4a34-8fd6-878baeaaaece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:18.985537 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df6916-cfe4-4a34-8fd6-878baeaaaece None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:18.985814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df6916-cfe4-4a34-8fd6-878baeaaaece None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:18.986083 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df6916-cfe4-4a34-8fd6-878baeaaaece None admin] PATH_INFO: `/v3/users/2451a47748e94d779fe3217c3e7e0791` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:18.987213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df6916-cfe4-4a34-8fd6-878baeaaaece None admin] RBAC: Authorizing `identity:get_user(user_id=2451a47748e94d779fe3217c3e7e0791)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:18.988622 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df6916-cfe4-4a34-8fd6-878baeaaaece None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:18.990165 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 570/1151] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:18 2022] GET /identity/v3/users/2451a47748e94d779fe3217c3e7e0791 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:18.995797 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba31e4-7bf1-43de-a9ee-6926f02d30b4 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:19.091664 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba31e4-7bf1-43de-a9ee-6926f02d30b4 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:19.123376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c8916-8bd6-4a9a-a594-421888399f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:19.123982 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c8916-8bd6-4a9a-a594-421888399f03 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:19.124257 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c8916-8bd6-4a9a-a594-421888399f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:19.124523 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c8916-8bd6-4a9a-a594-421888399f03 None admin] PATH_INFO: `/v3/projects/661277fa7f6646be92750fe8c8fca0b6` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:19.125619 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c8916-8bd6-4a9a-a594-421888399f03 None admin] RBAC: Authorizing `identity:get_project(project_id=661277fa7f6646be92750fe8c8fca0b6)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:19.127057 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c8916-8bd6-4a9a-a594-421888399f03 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:19.128655 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 582/1152] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:18 2022] GET /identity/v3/projects/661277fa7f6646be92750fe8c8fca0b6 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:19.135084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df6916-cfe4-4a34-8fd6-878baeaaaece None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:19.231930 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df6916-cfe4-4a34-8fd6-878baeaaaece None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:19.265132 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98815949-4099-4c7a-9df7-818d3267e991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:19.265768 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98815949-4099-4c7a-9df7-818d3267e991 None admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:19.266045 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98815949-4099-4c7a-9df7-818d3267e991 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:19.266319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98815949-4099-4c7a-9df7-818d3267e991 None admin] PATH_INFO: `/v3/projects/661277fa7f6646be92750fe8c8fca0b6/users/2451a47748e94d779fe3217c3e7e0791/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:19.268225 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98815949-4099-4c7a-9df7-818d3267e991 None admin] RBAC: Authorizing `identity:create_grant(project_id=661277fa7f6646be92750fe8c8fca0b6, user_id=2451a47748e94d779fe3217c3e7e0791, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:19.269637 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98815949-4099-4c7a-9df7-818d3267e991 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:19.282602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 571/1153] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:21:19 2022] PUT /identity/v3/projects/661277fa7f6646be92750fe8c8fca0b6/users/2451a47748e94d779fe3217c3e7e0791/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:21:21.125509 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8e54d-cdc3-4697-85ea-469191b0cb58 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:21.126028 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8e54d-cdc3-4697-85ea-469191b0cb58 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:21.126151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8e54d-cdc3-4697-85ea-469191b0cb58 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:21.127450 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 583/1154] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:21.132395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacb041-4423-4f5b-a444-7613b4be4caa None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:21.132761 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacb041-4423-4f5b-a444-7613b4be4caa None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:21.132935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacb041-4423-4f5b-a444-7613b4be4caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:21.150447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-4bacb041-4423-4f5b-a444-7613b4be4caa None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:21.151632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4bacb041-4423-4f5b-a444-7613b4be4caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:21.153519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:21.219984 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 572/1155] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:21.485717 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8e54d-cdc3-4697-85ea-469191b0cb58 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:21.513283 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:21.584985 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8e54d-cdc3-4697-85ea-469191b0cb58 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:21.617145 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3049c3-4fc2-40b0-8258-f20cbeee3184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:21.617758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3049c3-4fc2-40b0-8258-f20cbeee3184 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:21.618030 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3049c3-4fc2-40b0-8258-f20cbeee3184 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:21.618297 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3049c3-4fc2-40b0-8258-f20cbeee3184 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:21.628643 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3049c3-4fc2-40b0-8258-f20cbeee3184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:21:21.633954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-2e3049c3-4fc2-40b0-8258-f20cbeee3184 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:21.633954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:21.633954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:21.633954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:21.633954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:21.633954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:21.633954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:21.633954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:21.633954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:21.633954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:21.633954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:21.633954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:21.633954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:21:21.633954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:21:21.633954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:21:21.633954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:21:21.635090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:21:21.635090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:21:21.635090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:21:21.635090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:21:21.635090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:21.635090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:21.635090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:21.635090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:21.635090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:21.635090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:21.635090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:21.635090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:21.635090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:21.635090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:21.635090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:21.635090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:21.636219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:21.636219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:21.636219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:21.636219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:21.636219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:21:21.636219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:21:21.636219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:21:21.636219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:21:21.636219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:21:21.636219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:21:21.636219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:21.636219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:21:21.636219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 584/1156] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:21:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:21.641021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacb041-4423-4f5b-a444-7613b4be4caa None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:21.736193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacb041-4423-4f5b-a444-7613b4be4caa None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:21.768607 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14832b-a20e-4bba-930d-15cef09e5415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:21.769196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14832b-a20e-4bba-930d-15cef09e5415 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:21.769473 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14832b-a20e-4bba-930d-15cef09e5415 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:21.769744 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14832b-a20e-4bba-930d-15cef09e5415 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:21.770395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14832b-a20e-4bba-930d-15cef09e5415 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:21.770722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14832b-a20e-4bba-930d-15cef09e5415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:21.772155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14832b-a20e-4bba-930d-15cef09e5415 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:21.776974 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:21.780360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 573/1157] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:21:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:21.785847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3049c3-4fc2-40b0-8258-f20cbeee3184 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:21.869104 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:21.883318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3049c3-4fc2-40b0-8258-f20cbeee3184 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:21.915084 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41da82-d37d-40aa-bc43-33853aef4dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:21.915688 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41da82-d37d-40aa-bc43-33853aef4dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:21.915962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41da82-d37d-40aa-bc43-33853aef4dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:21.916228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41da82-d37d-40aa-bc43-33853aef4dc8 None admin] PATH_INFO: `/v3/users/2451a47748e94d779fe3217c3e7e0791` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:21.917337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41da82-d37d-40aa-bc43-33853aef4dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=2451a47748e94d779fe3217c3e7e0791)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:21.918771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41da82-d37d-40aa-bc43-33853aef4dc8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:21.920326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 585/1158] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:21 2022] GET /identity/v3/users/2451a47748e94d779fe3217c3e7e0791 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:21.926099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14832b-a20e-4bba-930d-15cef09e5415 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:22.031249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14832b-a20e-4bba-930d-15cef09e5415 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:22.063632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70495845-449e-4e07-aba9-8f940bf876f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:22.064226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70495845-449e-4e07-aba9-8f940bf876f4 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:22.064510 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70495845-449e-4e07-aba9-8f940bf876f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:22.064786 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70495845-449e-4e07-aba9-8f940bf876f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:22.127540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:22.130103 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70495845-449e-4e07-aba9-8f940bf876f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:22.131905 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70495845-449e-4e07-aba9-8f940bf876f4 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:22.227543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 574/1159] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:21:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:21:22.233469 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41da82-d37d-40aa-bc43-33853aef4dc8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:22.328281 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41da82-d37d-40aa-bc43-33853aef4dc8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:22.361040 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d53c58-1c57-4dc5-a6d5-ae6d4e6139e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:22.361649 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d53c58-1c57-4dc5-a6d5-ae6d4e6139e9 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:22.361929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d53c58-1c57-4dc5-a6d5-ae6d4e6139e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:22.362200 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d53c58-1c57-4dc5-a6d5-ae6d4e6139e9 None admin] PATH_INFO: `/v3/projects/661277fa7f6646be92750fe8c8fca0b6` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:22.363382 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d53c58-1c57-4dc5-a6d5-ae6d4e6139e9 None admin] RBAC: Authorizing `identity:get_project(project_id=661277fa7f6646be92750fe8c8fca0b6)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:22.364825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d53c58-1c57-4dc5-a6d5-ae6d4e6139e9 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:22.366487 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 586/1160] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:22 2022] GET /identity/v3/projects/661277fa7f6646be92750fe8c8fca0b6 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:22.372545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70495845-449e-4e07-aba9-8f940bf876f4 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:22.465349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:22.468448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70495845-449e-4e07-aba9-8f940bf876f4 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:22.502051 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f937a-3f74-4cfb-a4ac-939636898fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:22.502653 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f937a-3f74-4cfb-a4ac-939636898fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:22.502939 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f937a-3f74-4cfb-a4ac-939636898fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:22.503210 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f937a-3f74-4cfb-a4ac-939636898fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:22.503923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f937a-3f74-4cfb-a4ac-939636898fb7 None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.project.id=661277fa7f6646be92750fe8c8fca0b6, user.id=2451a47748e94d779fe3217c3e7e0791) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:22.504230 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f937a-3f74-4cfb-a4ac-939636898fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:22.505632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f937a-3f74-4cfb-a4ac-939636898fb7 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:22.511208 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 575/1161] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:21:22 2022] GET /identity/v3/role_assignments?user.id=2451a47748e94d779fe3217c3e7e0791&scope.project.id=661277fa7f6646be92750fe8c8fca0b6&role.id=3cd61239237441418529e9028ef801e4 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:24.383894 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318a477-f4b6-476b-b141-e733c2d9648d None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:24.384464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318a477-f4b6-476b-b141-e733c2d9648d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:24.384464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318a477-f4b6-476b-b141-e733c2d9648d None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:24.385773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 587/1162] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:21:24.390877 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7951e56-8e2f-4737-8e5d-71edfc692455 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:24.391276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7951e56-8e2f-4737-8e5d-71edfc692455 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:24.391430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7951e56-8e2f-4737-8e5d-71edfc692455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:24.409530 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-b7951e56-8e2f-4737-8e5d-71edfc692455 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:24.410736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b7951e56-8e2f-4737-8e5d-71edfc692455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:24.474297 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 576/1163] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:24.742411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318a477-f4b6-476b-b141-e733c2d9648d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:24.767114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:24.842146 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318a477-f4b6-476b-b141-e733c2d9648d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:24.873481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e2937-577a-44a9-95bb-cb711d40011b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:24.874073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e2937-577a-44a9-95bb-cb711d40011b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:24.874352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e2937-577a-44a9-95bb-cb711d40011b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:24.874634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e2937-577a-44a9-95bb-cb711d40011b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:24.938493 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e2937-577a-44a9-95bb-cb711d40011b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:24.939942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e2937-577a-44a9-95bb-cb711d40011b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:24.962965 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:25.034160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 588/1164] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:21:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:21:25.040254 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7951e56-8e2f-4737-8e5d-71edfc692455 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:25.128410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:25.135274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7951e56-8e2f-4737-8e5d-71edfc692455 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:25.167053 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0328d79-5b9c-4119-923c-94ab3e5ae1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:25.167657 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0328d79-5b9c-4119-923c-94ab3e5ae1e1 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:25.167932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0328d79-5b9c-4119-923c-94ab3e5ae1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:25.168197 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0328d79-5b9c-4119-923c-94ab3e5ae1e1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:25.174547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0328d79-5b9c-4119-923c-94ab3e5ae1e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:25.175994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0328d79-5b9c-4119-923c-94ab3e5ae1e1 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:25.187586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-e0328d79-5b9c-4119-923c-94ab3e5ae1e1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 16:21:25.187586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:25.187586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 01 16:21:25.187586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 01 16:21:25.187586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:21:25.187586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:21:25.187586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:21:25.187586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:21:25.187586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 01 16:21:25.187586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:21:25.187586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:21:25.187586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:21:25.187586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:25.187586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:25.187586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:25.187586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:25.187586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:25.188796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:25.188796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:25.188796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:25.188796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:25.188796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:25.188796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:25.188796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:21:25.188796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:21:25.188796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:21:25.188796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:21:25.188796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:25.188796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:25.188796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:25.188796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:25.188796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:25.188796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:25.189852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:25.189852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:25.189852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:25.189852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:25.189852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:25.189852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:25.189852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:25.189852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:25.189852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:25.189852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:25.189852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 01 16:21:25.189852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:21:25.189852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 16:21:25.189852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:21:25.189852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 577/1165] 10.222.0.71 () {56 vars in 1117 bytes} [Thu Sep 1 16:21:25 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:25.195421 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e2937-577a-44a9-95bb-cb711d40011b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:25.292087 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e2937-577a-44a9-95bb-cb711d40011b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:25.313822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:25.325913 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bd01d-5283-42b1-97ad-959bb9c1148f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:25.326508 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bd01d-5283-42b1-97ad-959bb9c1148f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:25.326818 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bd01d-5283-42b1-97ad-959bb9c1148f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:25.327091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bd01d-5283-42b1-97ad-959bb9c1148f None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:25.327725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bd01d-5283-42b1-97ad-959bb9c1148f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:25.328028 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bd01d-5283-42b1-97ad-959bb9c1148f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:25.329376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bd01d-5283-42b1-97ad-959bb9c1148f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:25.336245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 589/1166] 10.222.0.71 () {56 vars in 1115 bytes} [Thu Sep 1 16:21:25 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:27.181868 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cba056-a296-4bca-adad-19ce475e01e8 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:27.182414 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cba056-a296-4bca-adad-19ce475e01e8 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:27.182414 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cba056-a296-4bca-adad-19ce475e01e8 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:27.183789 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 578/1167] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:27.188895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8681b-c399-4e4b-aaa6-8e0203788f74 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:27.189269 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8681b-c399-4e4b-aaa6-8e0203788f74 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:27.189426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8681b-c399-4e4b-aaa6-8e0203788f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:27.206948 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-28a8681b-c399-4e4b-aaa6-8e0203788f74 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:27.208102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-28a8681b-c399-4e4b-aaa6-8e0203788f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:27.275948 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 590/1168] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:27.544093 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cba056-a296-4bca-adad-19ce475e01e8 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:27.643423 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cba056-a296-4bca-adad-19ce475e01e8 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:27.676133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825f7ab-2acf-4d4a-af2d-e52ed629ceec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:27.676729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825f7ab-2acf-4d4a-af2d-e52ed629ceec None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:27.677006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825f7ab-2acf-4d4a-af2d-e52ed629ceec None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:27.677275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825f7ab-2acf-4d4a-af2d-e52ed629ceec None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:27.677951 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825f7ab-2acf-4d4a-af2d-e52ed629ceec None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:27.679322 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825f7ab-2acf-4d4a-af2d-e52ed629ceec None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:27.695045 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 579/1169] 10.222.0.71 () {60 vars in 1138 bytes} [Thu Sep 1 16:21:27 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:21:29.607772 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00a6c5-5b62-4b43-81b6-ca32f3314016 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:29.608289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00a6c5-5b62-4b43-81b6-ca32f3314016 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:29.608411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00a6c5-5b62-4b43-81b6-ca32f3314016 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:29.609655 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 591/1170] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:29.614940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fce284-73d4-410e-8e1a-56433277953b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:29.615381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fce284-73d4-410e-8e1a-56433277953b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:29.615492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fce284-73d4-410e-8e1a-56433277953b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:29.633213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-92fce284-73d4-410e-8e1a-56433277953b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:29.634396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-92fce284-73d4-410e-8e1a-56433277953b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:29.643413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:29.699310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 580/1171] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:29.969720 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00a6c5-5b62-4b43-81b6-ca32f3314016 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:30.075080 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00a6c5-5b62-4b43-81b6-ca32f3314016 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:30.091365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:30.108336 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdb37d-3646-4679-a410-a8d04de167f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:30.108953 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdb37d-3646-4679-a410-a8d04de167f1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:30.109229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdb37d-3646-4679-a410-a8d04de167f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:30.109496 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdb37d-3646-4679-a410-a8d04de167f1 None admin] PATH_INFO: `/v3/domains/66ed064c211645398cf1120bee3a14fc` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:30.119401 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdb37d-3646-4679-a410-a8d04de167f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=66ed064c211645398cf1120bee3a14fc)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:30.120818 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdb37d-3646-4679-a410-a8d04de167f1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:30.122378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 592/1172] 10.222.0.71 () {56 vars in 1183 bytes} [Thu Sep 1 16:21:29 2022] GET /identity/v3/domains/66ed064c211645398cf1120bee3a14fc => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:30.128246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fce284-73d4-410e-8e1a-56433277953b None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:30.224090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fce284-73d4-410e-8e1a-56433277953b None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:30.256317 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f089049-55ed-4426-9cf4-267ba708fe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:30.256904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f089049-55ed-4426-9cf4-267ba708fe34 None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:30.257185 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f089049-55ed-4426-9cf4-267ba708fe34 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:30.257459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f089049-55ed-4426-9cf4-267ba708fe34 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:30.258098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f089049-55ed-4426-9cf4-267ba708fe34 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:30.259534 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f089049-55ed-4426-9cf4-267ba708fe34 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:30.274438 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:30.286288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 581/1173] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Sep 1 16:21:30 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:21:32.180339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34904ce5-3ce8-4e30-bad0-702ff2474dca None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:32.180863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34904ce5-3ce8-4e30-bad0-702ff2474dca None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:32.180863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34904ce5-3ce8-4e30-bad0-702ff2474dca None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:32.182224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 593/1174] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:32.187407 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8abbc0-63cf-48a9-9b89-9300aaf6469a None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:32.187828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8abbc0-63cf-48a9-9b89-9300aaf6469a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:32.187962 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8abbc0-63cf-48a9-9b89-9300aaf6469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:32.205539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-6c8abbc0-63cf-48a9-9b89-9300aaf6469a None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:32.206718 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6c8abbc0-63cf-48a9-9b89-9300aaf6469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:32.270002 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 582/1175] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:32.533486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34904ce5-3ce8-4e30-bad0-702ff2474dca None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:32.633564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34904ce5-3ce8-4e30-bad0-702ff2474dca None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:32.666685 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef85f4-239f-4b57-8b3e-d15d39e8a86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:32.667301 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef85f4-239f-4b57-8b3e-d15d39e8a86c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:32.667581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef85f4-239f-4b57-8b3e-d15d39e8a86c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:32.667851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef85f4-239f-4b57-8b3e-d15d39e8a86c None admin] PATH_INFO: `/v3/domains/66ed064c211645398cf1120bee3a14fc` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:32.668983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef85f4-239f-4b57-8b3e-d15d39e8a86c None admin] RBAC: Authorizing `identity:get_domain(domain_id=66ed064c211645398cf1120bee3a14fc)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:32.670392 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef85f4-239f-4b57-8b3e-d15d39e8a86c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:32.671983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 594/1176] 10.222.0.71 () {56 vars in 1183 bytes} [Thu Sep 1 16:21:32 2022] GET /identity/v3/domains/66ed064c211645398cf1120bee3a14fc => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:32.677584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8abbc0-63cf-48a9-9b89-9300aaf6469a None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:32.772435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8abbc0-63cf-48a9-9b89-9300aaf6469a None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:32.797727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:32.806922 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48baf4e4-73f8-4ae6-bed0-56bd19111708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:32.807532 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baf4e4-73f8-4ae6-bed0-56bd19111708 None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:32.807804 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baf4e4-73f8-4ae6-bed0-56bd19111708 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:32.808077 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baf4e4-73f8-4ae6-bed0-56bd19111708 None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:32.808723 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48baf4e4-73f8-4ae6-bed0-56bd19111708 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:32.810147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48baf4e4-73f8-4ae6-bed0-56bd19111708 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:32.830565 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 583/1177] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:21:32 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:21:34.757692 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a2de3-a4aa-47ff-8f97-6752ece5401a None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:34.758204 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a2de3-a4aa-47ff-8f97-6752ece5401a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:34.758318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a2de3-a4aa-47ff-8f97-6752ece5401a None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:34.759612 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 595/1178] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:34.764604 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe654a-7295-42c4-bbb4-f112682884c1 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:34.764987 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe654a-7295-42c4-bbb4-f112682884c1 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:34.765156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe654a-7295-42c4-bbb4-f112682884c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:34.783446 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-30fe654a-7295-42c4-bbb4-f112682884c1 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:34.784623 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-30fe654a-7295-42c4-bbb4-f112682884c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:34.848749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 584/1179] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:35.115672 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a2de3-a4aa-47ff-8f97-6752ece5401a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:35.161275 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:35.215008 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a2de3-a4aa-47ff-8f97-6752ece5401a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:35.247963 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd07183-07dd-46fe-ade1-0acfe5fbb0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:35.248569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd07183-07dd-46fe-ade1-0acfe5fbb0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:35.248849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd07183-07dd-46fe-ade1-0acfe5fbb0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:35.249120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd07183-07dd-46fe-ade1-0acfe5fbb0e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:35.259517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd07183-07dd-46fe-ade1-0acfe5fbb0e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:21:35.264346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-5dd07183-07dd-46fe-ade1-0acfe5fbb0e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:35.264346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:35.264346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:35.264346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:35.264346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:35.264346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:35.264346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:35.264346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:35.264346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:35.264346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:35.264346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:35.264346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:35.264346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:21:35.264346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:21:35.264346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:21:35.264346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:21:35.265435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:21:35.265435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:21:35.265435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:21:35.265435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:21:35.265435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:35.265435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:35.265435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:35.265435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:35.265435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:35.265435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:35.265435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:35.265435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:35.265435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:35.265435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:35.265435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:35.265435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:35.266282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:35.266282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:35.266282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:35.266282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:35.266282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:21:35.266282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:21:35.266282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:21:35.266282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:21:35.266282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:21:35.266282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:21:35.266282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:35.266282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:21:35.266282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 596/1180] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:21:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:35.271322 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe654a-7295-42c4-bbb4-f112682884c1 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:35.366281 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe654a-7295-42c4-bbb4-f112682884c1 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:35.378568 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:35.401509 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc19895-82ef-43c6-b110-694375985fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:35.402227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc19895-82ef-43c6-b110-694375985fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:35.402510 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc19895-82ef-43c6-b110-694375985fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:35.402808 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc19895-82ef-43c6-b110-694375985fa2 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:35.403468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc19895-82ef-43c6-b110-694375985fa2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:35.403768 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc19895-82ef-43c6-b110-694375985fa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:35.405125 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc19895-82ef-43c6-b110-694375985fa2 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:35.413489 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 585/1181] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:21:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:35.419413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd07183-07dd-46fe-ade1-0acfe5fbb0e7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:35.518606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd07183-07dd-46fe-ade1-0acfe5fbb0e7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:35.521423 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:35.560969 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dde31a-498a-4f04-bdde-0b7f46e60942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:35.561582 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dde31a-498a-4f04-bdde-0b7f46e60942 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:35.561854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dde31a-498a-4f04-bdde-0b7f46e60942 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:35.562118 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dde31a-498a-4f04-bdde-0b7f46e60942 None admin] PATH_INFO: `/v3/users/b1feda8f5a3341b886f3f3418cab382e` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:35.574815 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dde31a-498a-4f04-bdde-0b7f46e60942 None admin] RBAC: Authorizing `identity:get_user(user_id=b1feda8f5a3341b886f3f3418cab382e)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:35.576235 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dde31a-498a-4f04-bdde-0b7f46e60942 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:35.577848 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 597/1182] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:35 2022] GET /identity/v3/users/b1feda8f5a3341b886f3f3418cab382e => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:35.584279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc19895-82ef-43c6-b110-694375985fa2 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:35.680517 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc19895-82ef-43c6-b110-694375985fa2 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:35.712669 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae5e69-26ee-4a5c-8177-4d7b6a7c9d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:35.713266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae5e69-26ee-4a5c-8177-4d7b6a7c9d5d None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:35.713545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae5e69-26ee-4a5c-8177-4d7b6a7c9d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:35.713816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae5e69-26ee-4a5c-8177-4d7b6a7c9d5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:35.754551 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:35.779505 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae5e69-26ee-4a5c-8177-4d7b6a7c9d5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:35.780935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae5e69-26ee-4a5c-8177-4d7b6a7c9d5d None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:35.886222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 586/1183] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:21:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:21:35.892075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dde31a-498a-4f04-bdde-0b7f46e60942 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:35.987801 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dde31a-498a-4f04-bdde-0b7f46e60942 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:36.021841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd1d6c-420c-4acc-8c24-5ab12addf458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:36.022441 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd1d6c-420c-4acc-8c24-5ab12addf458 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:36.022748 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd1d6c-420c-4acc-8c24-5ab12addf458 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:36.023021 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd1d6c-420c-4acc-8c24-5ab12addf458 None admin] PATH_INFO: `/v3/projects/5dc9a2cb94ad4e388e4035f8af23fc5e` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:36.024127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd1d6c-420c-4acc-8c24-5ab12addf458 None admin] RBAC: Authorizing `identity:get_project(project_id=5dc9a2cb94ad4e388e4035f8af23fc5e)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:36.025533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd1d6c-420c-4acc-8c24-5ab12addf458 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:36.027159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 598/1184] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:35 2022] GET /identity/v3/projects/5dc9a2cb94ad4e388e4035f8af23fc5e => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:36.033173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae5e69-26ee-4a5c-8177-4d7b6a7c9d5d None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:36.104435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:36.128216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae5e69-26ee-4a5c-8177-4d7b6a7c9d5d None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:36.161660 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a09ebb-4759-4b0f-a7f9-1fa609d07f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:36.162184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a09ebb-4759-4b0f-a7f9-1fa609d07f49 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:36.162461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a09ebb-4759-4b0f-a7f9-1fa609d07f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:36.162760 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a09ebb-4759-4b0f-a7f9-1fa609d07f49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:36.163471 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a09ebb-4759-4b0f-a7f9-1fa609d07f49 None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.project.id=5dc9a2cb94ad4e388e4035f8af23fc5e, user.id=b1feda8f5a3341b886f3f3418cab382e) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:36.163774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a09ebb-4759-4b0f-a7f9-1fa609d07f49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:36.165166 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a09ebb-4759-4b0f-a7f9-1fa609d07f49 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:36.170371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 587/1185] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:21:36 2022] GET /identity/v3/role_assignments?user.id=b1feda8f5a3341b886f3f3418cab382e&scope.project.id=5dc9a2cb94ad4e388e4035f8af23fc5e&role.id=3cd61239237441418529e9028ef801e4 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:38.042502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0586556-0c69-42b6-9c58-1c03a2e8d180 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:38.043091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0586556-0c69-42b6-9c58-1c03a2e8d180 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:38.043091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0586556-0c69-42b6-9c58-1c03a2e8d180 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:38.044402 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 599/1186] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:38.049672 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46340ce-41a3-43f2-a140-dab5e8a2ed86 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:38.050057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46340ce-41a3-43f2-a140-dab5e8a2ed86 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:38.050221 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46340ce-41a3-43f2-a140-dab5e8a2ed86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:38.069068 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-e46340ce-41a3-43f2-a140-dab5e8a2ed86 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:38.070244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e46340ce-41a3-43f2-a140-dab5e8a2ed86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:38.134363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 588/1187] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:38.401721 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0586556-0c69-42b6-9c58-1c03a2e8d180 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:38.431907 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:38.500056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0586556-0c69-42b6-9c58-1c03a2e8d180 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:38.532200 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f77f15-cdc2-4ffe-9e0b-9a05f09a8b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:38.532804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f77f15-cdc2-4ffe-9e0b-9a05f09a8b3b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:38.533078 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f77f15-cdc2-4ffe-9e0b-9a05f09a8b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:38.533343 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f77f15-cdc2-4ffe-9e0b-9a05f09a8b3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:38.543646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f77f15-cdc2-4ffe-9e0b-9a05f09a8b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:21:38.548428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-94f77f15-cdc2-4ffe-9e0b-9a05f09a8b3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:38.548428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:38.548428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:38.548428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:38.548428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:38.548428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:38.548428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:38.548428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:38.548428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:38.548428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:38.548428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:38.548428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:38.548428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:21:38.548428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:21:38.548428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:21:38.548428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:21:38.549606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:21:38.549606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:21:38.549606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:21:38.549606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:21:38.549606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:38.549606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:38.549606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:38.549606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:38.549606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:38.549606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:38.549606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:38.549606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:38.549606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:38.549606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:38.549606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:38.549606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:38.550538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:38.550538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:38.550538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:38.550538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:38.550538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:21:38.550538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:21:38.550538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:21:38.550538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:21:38.550538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:21:38.550538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:21:38.550538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:38.550538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:21:38.550538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 600/1188] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:21:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:38.555523 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46340ce-41a3-43f2-a140-dab5e8a2ed86 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:38.618927 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:38.652001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46340ce-41a3-43f2-a140-dab5e8a2ed86 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:38.685373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523f6e7-51a2-43fd-8189-092a3761de19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:38.686303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523f6e7-51a2-43fd-8189-092a3761de19 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:38.686813 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523f6e7-51a2-43fd-8189-092a3761de19 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:38.687248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523f6e7-51a2-43fd-8189-092a3761de19 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:38.688370 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523f6e7-51a2-43fd-8189-092a3761de19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:38.688896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523f6e7-51a2-43fd-8189-092a3761de19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:38.690298 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523f6e7-51a2-43fd-8189-092a3761de19 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:38.698142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 589/1189] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:21:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:38.703928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f77f15-cdc2-4ffe-9e0b-9a05f09a8b3b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:38.792379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:38.802207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f77f15-cdc2-4ffe-9e0b-9a05f09a8b3b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:38.834769 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98706daa-2bd8-474e-be82-cc6dab03c823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:38.835375 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98706daa-2bd8-474e-be82-cc6dab03c823 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:38.835653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98706daa-2bd8-474e-be82-cc6dab03c823 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:38.835926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98706daa-2bd8-474e-be82-cc6dab03c823 None admin] PATH_INFO: `/v3/users/b1feda8f5a3341b886f3f3418cab382e` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:38.837033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98706daa-2bd8-474e-be82-cc6dab03c823 None admin] RBAC: Authorizing `identity:get_user(user_id=b1feda8f5a3341b886f3f3418cab382e)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:38.838439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98706daa-2bd8-474e-be82-cc6dab03c823 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:38.840024 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 601/1190] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:38 2022] GET /identity/v3/users/b1feda8f5a3341b886f3f3418cab382e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:38.845952 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523f6e7-51a2-43fd-8189-092a3761de19 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:38.950304 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523f6e7-51a2-43fd-8189-092a3761de19 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:38.977840 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:38.983829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbed0c-7d57-41a1-bde9-3ea46c04a043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:38.984447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbed0c-7d57-41a1-bde9-3ea46c04a043 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:38.984723 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbed0c-7d57-41a1-bde9-3ea46c04a043 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:38.984993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbed0c-7d57-41a1-bde9-3ea46c04a043 None admin] PATH_INFO: `/v3/projects/5dc9a2cb94ad4e388e4035f8af23fc5e` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:38.986094 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbed0c-7d57-41a1-bde9-3ea46c04a043 None admin] RBAC: Authorizing `identity:get_project(project_id=5dc9a2cb94ad4e388e4035f8af23fc5e)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:38.987537 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbed0c-7d57-41a1-bde9-3ea46c04a043 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:38.989189 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 590/1191] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:38 2022] GET /identity/v3/projects/5dc9a2cb94ad4e388e4035f8af23fc5e => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:38.995116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98706daa-2bd8-474e-be82-cc6dab03c823 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:39.089498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98706daa-2bd8-474e-be82-cc6dab03c823 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:39.121540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e27514-6fe6-468f-aeaa-71a0761682ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:39.122168 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e27514-6fe6-468f-aeaa-71a0761682ae None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:39.122442 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e27514-6fe6-468f-aeaa-71a0761682ae None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:39.122736 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e27514-6fe6-468f-aeaa-71a0761682ae None admin] PATH_INFO: `/v3/projects/5dc9a2cb94ad4e388e4035f8af23fc5e/users/b1feda8f5a3341b886f3f3418cab382e/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:39.124604 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e27514-6fe6-468f-aeaa-71a0761682ae None admin] RBAC: Authorizing `identity:create_grant(project_id=5dc9a2cb94ad4e388e4035f8af23fc5e, user_id=b1feda8f5a3341b886f3f3418cab382e, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:39.126003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e27514-6fe6-468f-aeaa-71a0761682ae None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:39.138426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 602/1192] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:21:38 2022] PUT /identity/v3/projects/5dc9a2cb94ad4e388e4035f8af23fc5e/users/b1feda8f5a3341b886f3f3418cab382e/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:21:41.004227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42e729-14f3-47f7-81cc-55855aa6250e None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:41.004741 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42e729-14f3-47f7-81cc-55855aa6250e None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:41.004741 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42e729-14f3-47f7-81cc-55855aa6250e None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:41.006596 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 591/1193] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:41.011717 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ae512-35a4-48e4-8fc6-92db8cb559d5 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:41.012138 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ae512-35a4-48e4-8fc6-92db8cb559d5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:41.012255 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ae512-35a4-48e4-8fc6-92db8cb559d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:41.029675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8b2ae512-35a4-48e4-8fc6-92db8cb559d5 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:41.030856 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8b2ae512-35a4-48e4-8fc6-92db8cb559d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:41.043405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:41.096158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 603/1194] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:41.357014 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42e729-14f3-47f7-81cc-55855aa6250e None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:41.456476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42e729-14f3-47f7-81cc-55855aa6250e None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:41.492301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b51d55-f5a8-484d-91e6-f30628ef32ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:41.492909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b51d55-f5a8-484d-91e6-f30628ef32ed None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:41.493182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b51d55-f5a8-484d-91e6-f30628ef32ed None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:41.493445 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b51d55-f5a8-484d-91e6-f30628ef32ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:41.503288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b51d55-f5a8-484d-91e6-f30628ef32ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:21:41.508569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-10b51d55-f5a8-484d-91e6-f30628ef32ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:41.508569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:41.508569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:41.508569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:41.508569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:41.508569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:41.508569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:41.508569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:41.508569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:41.508569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:41.508569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:41.508569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:41.508569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:21:41.508569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:21:41.508569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:21:41.508569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:21:41.509695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:21:41.509695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:21:41.509695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:21:41.509695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:21:41.509695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:41.509695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:41.509695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:41.509695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:41.509695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:41.509695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:41.509695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:41.509695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:41.509695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:41.509695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:41.509695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:41.509695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:41.510575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:41.510575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:41.510575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:41.510575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:41.510575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:21:41.510575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:21:41.510575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:21:41.510575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:21:41.510575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:21:41.510575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:21:41.510575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:41.510575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:21:41.510575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 592/1195] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:21:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:41.515762 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ae512-35a4-48e4-8fc6-92db8cb559d5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:41.610244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ae512-35a4-48e4-8fc6-92db8cb559d5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:41.643694 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46759d-469f-4a86-b33f-7884ef74ac79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:41.644295 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46759d-469f-4a86-b33f-7884ef74ac79 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:41.644575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46759d-469f-4a86-b33f-7884ef74ac79 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:41.644849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46759d-469f-4a86-b33f-7884ef74ac79 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:41.645506 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46759d-469f-4a86-b33f-7884ef74ac79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:41.645806 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46759d-469f-4a86-b33f-7884ef74ac79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:41.647203 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46759d-469f-4a86-b33f-7884ef74ac79 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:41.654976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 604/1196] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:21:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:41.660853 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b51d55-f5a8-484d-91e6-f30628ef32ed None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:41.717462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:41.757589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b51d55-f5a8-484d-91e6-f30628ef32ed None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:41.789381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05e11a-597a-4561-bd09-18f214dbcce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:41.789985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05e11a-597a-4561-bd09-18f214dbcce2 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:41.790262 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05e11a-597a-4561-bd09-18f214dbcce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:41.790532 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05e11a-597a-4561-bd09-18f214dbcce2 None admin] PATH_INFO: `/v3/users/b1feda8f5a3341b886f3f3418cab382e` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:41.791676 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05e11a-597a-4561-bd09-18f214dbcce2 None admin] RBAC: Authorizing `identity:get_user(user_id=b1feda8f5a3341b886f3f3418cab382e)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:41.793087 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05e11a-597a-4561-bd09-18f214dbcce2 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:41.794655 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 593/1197] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:41 2022] GET /identity/v3/users/b1feda8f5a3341b886f3f3418cab382e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:41.803995 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46759d-469f-4a86-b33f-7884ef74ac79 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:41.817273 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:41.902971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46759d-469f-4a86-b33f-7884ef74ac79 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:41.934745 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28cfb5-bea1-4b94-9a0d-d1b84f401780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:41.935335 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28cfb5-bea1-4b94-9a0d-d1b84f401780 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:41.935611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28cfb5-bea1-4b94-9a0d-d1b84f401780 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:41.935880 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28cfb5-bea1-4b94-9a0d-d1b84f401780 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:42.001388 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28cfb5-bea1-4b94-9a0d-d1b84f401780 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:42.002833 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28cfb5-bea1-4b94-9a0d-d1b84f401780 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:42.013756 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:42.097937 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 605/1198] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:21:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:21:42.103880 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05e11a-597a-4561-bd09-18f214dbcce2 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:42.198884 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05e11a-597a-4561-bd09-18f214dbcce2 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:42.223261 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:42.234371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ae651-47c4-4616-b304-b70af00d7a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:42.235027 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ae651-47c4-4616-b304-b70af00d7a6e None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:42.235304 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ae651-47c4-4616-b304-b70af00d7a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:42.235573 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ae651-47c4-4616-b304-b70af00d7a6e None admin] PATH_INFO: `/v3/projects/5dc9a2cb94ad4e388e4035f8af23fc5e` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:42.236847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ae651-47c4-4616-b304-b70af00d7a6e None admin] RBAC: Authorizing `identity:get_project(project_id=5dc9a2cb94ad4e388e4035f8af23fc5e)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:42.238332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ae651-47c4-4616-b304-b70af00d7a6e None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:42.240127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 594/1199] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:42 2022] GET /identity/v3/projects/5dc9a2cb94ad4e388e4035f8af23fc5e => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:42.246193 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28cfb5-bea1-4b94-9a0d-d1b84f401780 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:42.342875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28cfb5-bea1-4b94-9a0d-d1b84f401780 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:42.353129 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:42.376164 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c5441-fbe9-4458-9381-3c3dd02c59da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:42.376754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c5441-fbe9-4458-9381-3c3dd02c59da None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:42.377032 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c5441-fbe9-4458-9381-3c3dd02c59da None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:42.377304 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c5441-fbe9-4458-9381-3c3dd02c59da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:42.378020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c5441-fbe9-4458-9381-3c3dd02c59da None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.project.id=5dc9a2cb94ad4e388e4035f8af23fc5e, user.id=b1feda8f5a3341b886f3f3418cab382e) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:42.378327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c5441-fbe9-4458-9381-3c3dd02c59da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:42.379774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c5441-fbe9-4458-9381-3c3dd02c59da None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:42.385912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 606/1200] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:21:42 2022] GET /identity/v3/role_assignments?user.id=b1feda8f5a3341b886f3f3418cab382e&scope.project.id=5dc9a2cb94ad4e388e4035f8af23fc5e&role.id=3cd61239237441418529e9028ef801e4 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:52.229894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:52.383415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=13 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:37.489279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e660f1-402f-4273-a5b1-0501fe43eea2 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:37.489870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e660f1-402f-4273-a5b1-0501fe43eea2 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:37.489870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e660f1-402f-4273-a5b1-0501fe43eea2 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:37.491235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 595/1201] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:22:37.500364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de74ca9-50e8-464b-a7dc-f38785478463 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:37.500364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de74ca9-50e8-464b-a7dc-f38785478463 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:37.500364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de74ca9-50e8-464b-a7dc-f38785478463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:37.520570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9de74ca9-50e8-464b-a7dc-f38785478463 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:22:37.521770 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9de74ca9-50e8-464b-a7dc-f38785478463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:22:37.614637 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 607/1202] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:22:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:22:37.887998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e660f1-402f-4273-a5b1-0501fe43eea2 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:38.032997 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e660f1-402f-4273-a5b1-0501fe43eea2 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:38.073526 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40506345-007f-4898-acd0-f4715fa6291c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:38.074157 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40506345-007f-4898-acd0-f4715fa6291c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:38.074461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40506345-007f-4898-acd0-f4715fa6291c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:38.074738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40506345-007f-4898-acd0-f4715fa6291c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:38.086268 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40506345-007f-4898-acd0-f4715fa6291c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:38.087792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40506345-007f-4898-acd0-f4715fa6291c None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:38.106847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-40506345-007f-4898-acd0-f4715fa6291c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:38.106847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:38.106847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:38.106847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:38.106847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:38.106847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:38.106847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:38.106847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:38.106847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:38.106847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:38.106847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:38.106847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:38.106847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:22:38.106847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:22:38.106847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:22:38.106847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:22:38.107988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:38.107988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:38.107988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:38.107988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:38.107988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:38.107988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:38.107988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:38.107988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:38.107988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:38.107988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:38.107988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:38.107988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:38.107988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:38.107988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:38.107988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:38.107988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:38.107988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:22:38.109436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:22:38.109436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:38.109436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:22:38.114632 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de74ca9-50e8-464b-a7dc-f38785478463 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:38.116960 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 596/1203] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:22:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:22:38.259879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de74ca9-50e8-464b-a7dc-f38785478463 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:38.299244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:38.306312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda5e3f-c2ac-4369-ba35-5164ae41b08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:38.307169 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda5e3f-c2ac-4369-ba35-5164ae41b08a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:38.307621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda5e3f-c2ac-4369-ba35-5164ae41b08a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:38.307868 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda5e3f-c2ac-4369-ba35-5164ae41b08a None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:38.308563 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda5e3f-c2ac-4369-ba35-5164ae41b08a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:38.308850 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda5e3f-c2ac-4369-ba35-5164ae41b08a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:38.310222 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda5e3f-c2ac-4369-ba35-5164ae41b08a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:38.326704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 608/1204] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:38.329969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40506345-007f-4898-acd0-f4715fa6291c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:38.394871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:38.457639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40506345-007f-4898-acd0-f4715fa6291c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:38.499306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3fc48-a00f-42ee-b2e6-5a950554d5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:38.500321 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3fc48-a00f-42ee-b2e6-5a950554d5ff None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:38.500321 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3fc48-a00f-42ee-b2e6-5a950554d5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:38.500613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3fc48-a00f-42ee-b2e6-5a950554d5ff None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:38.501116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3fc48-a00f-42ee-b2e6-5a950554d5ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:38.504201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3fc48-a00f-42ee-b2e6-5a950554d5ff None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:38.541201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 597/1205] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Sep 1 16:22:38 2022] POST /identity/v3/users => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:22:40.750177 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681df1f-3544-4a26-8aa4-f8092d64db5e None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:40.750770 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681df1f-3544-4a26-8aa4-f8092d64db5e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:40.750770 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681df1f-3544-4a26-8aa4-f8092d64db5e None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:40.752686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 609/1206] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:22:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:22:40.759193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead529b-ae04-4947-b470-446367039a05 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:40.759789 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead529b-ae04-4947-b470-446367039a05 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:40.760012 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead529b-ae04-4947-b470-446367039a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:40.783243 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-5ead529b-ae04-4947-b470-446367039a05 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:22:40.784512 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5ead529b-ae04-4947-b470-446367039a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:22:40.865648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 598/1207] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:22:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:22:41.145337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681df1f-3544-4a26-8aa4-f8092d64db5e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:41.257115 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681df1f-3544-4a26-8aa4-f8092d64db5e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:41.301714 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d9eda-8747-4d8c-a673-f83e35a6df8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:41.302583 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d9eda-8747-4d8c-a673-f83e35a6df8a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:41.303072 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d9eda-8747-4d8c-a673-f83e35a6df8a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:41.303348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d9eda-8747-4d8c-a673-f83e35a6df8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:41.322083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d9eda-8747-4d8c-a673-f83e35a6df8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:22:41.329150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-8b6d9eda-8747-4d8c-a673-f83e35a6df8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:22:41.329150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:41.329150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:41.329150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:41.329150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:41.329150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:41.329150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:41.329150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:41.329150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:41.329150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:41.329150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:41.329150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:41.329150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:22:41.329150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:22:41.329150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:22:41.329150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:22:41.334764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:22:41.334764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:22:41.334764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:22:41.334764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:22:41.334764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:41.334764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:41.334764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:41.334764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:41.334764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:41.334764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:41.334764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:41.334764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:41.334764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:41.334764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:41.334764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:41.334764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:41.336180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:41.336180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:41.336180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:41.336180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:41.336180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:22:41.336180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:22:41.336180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:22:41.336180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:22:41.336180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:22:41.336180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:22:41.336180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:22:41.336180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:22:41.336180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 610/1208] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:22:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:22:41.337308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead529b-ae04-4947-b470-446367039a05 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:41.387385 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:41.467369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead529b-ae04-4947-b470-446367039a05 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:41.519702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fefeff-080c-4aaf-ae2b-fdba3a14b955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:41.520416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fefeff-080c-4aaf-ae2b-fdba3a14b955 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:41.520699 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fefeff-080c-4aaf-ae2b-fdba3a14b955 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:41.520974 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fefeff-080c-4aaf-ae2b-fdba3a14b955 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:41.521679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fefeff-080c-4aaf-ae2b-fdba3a14b955 None admin] RBAC: Adding query filter params (name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:41.521982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fefeff-080c-4aaf-ae2b-fdba3a14b955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:41.523384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fefeff-080c-4aaf-ae2b-fdba3a14b955 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:41.532279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 599/1209] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:22:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:22:41.538134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d9eda-8747-4d8c-a673-f83e35a6df8a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:41.603977 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:41.675830 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d9eda-8747-4d8c-a673-f83e35a6df8a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:41.712735 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4540d0c-d784-413f-9213-0c788eac06e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:41.713603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4540d0c-d784-413f-9213-0c788eac06e8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:41.713982 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4540d0c-d784-413f-9213-0c788eac06e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:41.714254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4540d0c-d784-413f-9213-0c788eac06e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:41.727334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4540d0c-d784-413f-9213-0c788eac06e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:41.729228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4540d0c-d784-413f-9213-0c788eac06e8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:41.747854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-b4540d0c-d784-413f-9213-0c788eac06e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:41.747854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:41.747854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:41.747854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:41.747854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:41.747854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:41.747854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:41.747854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:41.747854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:41.747854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:41.747854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:41.747854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:41.747854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:22:41.747854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:22:41.747854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:22:41.747854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:22:41.748932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:41.748932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:41.748932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:41.748932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:41.748932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:41.748932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:41.748932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:41.748932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:41.748932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:41.748932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:41.748932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:41.748932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:41.748932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:41.748932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:41.748932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:41.748932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:41.748932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:22:41.755825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:22:41.755825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:41.755825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:22:41.755825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 611/1210] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:22:41.756088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fefeff-080c-4aaf-ae2b-fdba3a14b955 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:41.880766 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:41.884654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fefeff-080c-4aaf-ae2b-fdba3a14b955 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:41.924358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac6d2a-6bef-4f0e-8803-5a588e517938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:41.925260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac6d2a-6bef-4f0e-8803-5a588e517938 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:41.925647 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac6d2a-6bef-4f0e-8803-5a588e517938 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:41.925920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac6d2a-6bef-4f0e-8803-5a588e517938 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:41.926574 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac6d2a-6bef-4f0e-8803-5a588e517938 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:41.926898 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac6d2a-6bef-4f0e-8803-5a588e517938 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:41.928312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac6d2a-6bef-4f0e-8803-5a588e517938 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:41.944650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 600/1211] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:41.950235 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4540d0c-d784-413f-9213-0c788eac06e8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:42.070442 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4540d0c-d784-413f-9213-0c788eac06e8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:42.072104 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:42.107655 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d45625-15c7-40ee-a21b-a0b568f044f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:42.108285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d45625-15c7-40ee-a21b-a0b568f044f8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:42.108564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d45625-15c7-40ee-a21b-a0b568f044f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:42.108836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d45625-15c7-40ee-a21b-a0b568f044f8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:42.116615 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d45625-15c7-40ee-a21b-a0b568f044f8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:42.118033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d45625-15c7-40ee-a21b-a0b568f044f8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:42.129804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-80d45625-15c7-40ee-a21b-a0b568f044f8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:22:42.129804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:42.129804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:42.129804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:42.129804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:42.129804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:42.129804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:42.129804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:42.129804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:42.129804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:42.129804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:42.129804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:42.129804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:22:42.129804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:22:42.129804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:22:42.129804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:42.130987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:42.132126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:42.132126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:42.132126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:22:42.132126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:22:42.132126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:22:42.132126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:22:42.132126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:22:42.132126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:22:42.132126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:22:42.132126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:22:42.132126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 612/1212] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:22:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:22:42.137034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac6d2a-6bef-4f0e-8803-5a588e517938 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:42.260578 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac6d2a-6bef-4f0e-8803-5a588e517938 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:42.298374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a3550-c962-4ce0-a83a-1e46c8d7cd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:42.299021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a3550-c962-4ce0-a83a-1e46c8d7cd77 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:42.299826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a3550-c962-4ce0-a83a-1e46c8d7cd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:42.300189 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a3550-c962-4ce0-a83a-1e46c8d7cd77 None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:42.300937 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a3550-c962-4ce0-a83a-1e46c8d7cd77 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:42.301330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a3550-c962-4ce0-a83a-1e46c8d7cd77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:42.303602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a3550-c962-4ce0-a83a-1e46c8d7cd77 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:42.324487 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 601/1213] 10.222.0.71 () {56 vars in 1143 bytes} [Thu Sep 1 16:22:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:42.330745 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d45625-15c7-40ee-a21b-a0b568f044f8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:42.444437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d45625-15c7-40ee-a21b-a0b568f044f8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:42.487823 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1b485-3efd-4859-a0d2-5ebe69a95622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:42.488507 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1b485-3efd-4859-a0d2-5ebe69a95622 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:42.488799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1b485-3efd-4859-a0d2-5ebe69a95622 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:42.489125 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1b485-3efd-4859-a0d2-5ebe69a95622 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:42.524819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:42.566110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1b485-3efd-4859-a0d2-5ebe69a95622 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:42.567584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1b485-3efd-4859-a0d2-5ebe69a95622 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:42.680530 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 613/1214] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:22:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:22:42.686411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a3550-c962-4ce0-a83a-1e46c8d7cd77 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:42.706364 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:42.799352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a3550-c962-4ce0-a83a-1e46c8d7cd77 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:42.836560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b46200-6f89-4aa6-9b13-3fe3ae74e6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:42.837173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b46200-6f89-4aa6-9b13-3fe3ae74e6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:42.837452 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b46200-6f89-4aa6-9b13-3fe3ae74e6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:42.837723 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b46200-6f89-4aa6-9b13-3fe3ae74e6d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:42.852961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b46200-6f89-4aa6-9b13-3fe3ae74e6d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:42.854435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b46200-6f89-4aa6-9b13-3fe3ae74e6d5 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:42.870513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-36b46200-6f89-4aa6-9b13-3fe3ae74e6d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:42.870513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:42.870513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:42.870513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:42.870513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:42.870513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:42.870513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:42.870513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:42.870513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:42.870513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:42.870513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:42.870513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:42.870513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:22:42.870513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:22:42.870513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:22:42.870513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:22:42.876388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:42.876388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:42.876388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:42.876388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:42.876388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:42.876388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:42.876388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:42.876388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:42.876388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:42.876388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:42.876388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:42.876388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:42.876388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:42.876388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:42.876388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:42.876388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:42.876388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:22:42.877366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:22:42.877366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:42.877366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:22:42.877366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 602/1215] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:22:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:22:42.877622 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1b485-3efd-4859-a0d2-5ebe69a95622 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:42.943902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:42.992665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1b485-3efd-4859-a0d2-5ebe69a95622 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:43.036535 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c96c4-7927-410e-b979-7151cb6a959e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:43.037224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c96c4-7927-410e-b979-7151cb6a959e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:43.037537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c96c4-7927-410e-b979-7151cb6a959e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:43.037807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c96c4-7927-410e-b979-7151cb6a959e None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:43.038457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c96c4-7927-410e-b979-7151cb6a959e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:43.038791 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c96c4-7927-410e-b979-7151cb6a959e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:43.040137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c96c4-7927-410e-b979-7151cb6a959e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:43.053666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 614/1216] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:43.059060 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b46200-6f89-4aa6-9b13-3fe3ae74e6d5 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:43.139401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:43.182649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b46200-6f89-4aa6-9b13-3fe3ae74e6d5 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:43.222532 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b1cc5-7d1b-4a8e-a8af-7f2c05261e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:43.223542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b1cc5-7d1b-4a8e-a8af-7f2c05261e89 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:43.223823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b1cc5-7d1b-4a8e-a8af-7f2c05261e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:43.224092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b1cc5-7d1b-4a8e-a8af-7f2c05261e89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:43.231107 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b1cc5-7d1b-4a8e-a8af-7f2c05261e89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:43.232549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b1cc5-7d1b-4a8e-a8af-7f2c05261e89 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:43.245216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-e67b1cc5-7d1b-4a8e-a8af-7f2c05261e89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:22:43.245216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:43.245216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:43.245216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:43.245216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:43.245216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:43.245216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:43.245216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:43.245216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:43.245216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:43.245216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:43.245216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:43.245216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:22:43.245216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:22:43.245216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:22:43.246443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:22:43.246443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:43.246443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:43.246443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:43.246443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:43.246443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:43.246443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:43.246443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:43.246443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:43.246443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:43.246443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:43.246443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:43.246443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:43.246443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:43.246443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:43.246443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:43.246443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:43.247515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:22:43.247515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:22:43.247515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:22:43.247515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:22:43.247515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:22:43.247515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:22:43.247515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:22:43.247515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:22:43.247515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 603/1217] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:22:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:22:43.252666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c96c4-7927-410e-b979-7151cb6a959e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:43.369530 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c96c4-7927-410e-b979-7151cb6a959e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:43.398383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:43.412085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07283a8c-cba0-4cda-b70b-2933f2c6195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:43.412688 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07283a8c-cba0-4cda-b70b-2933f2c6195a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:43.412958 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07283a8c-cba0-4cda-b70b-2933f2c6195a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:43.413222 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07283a8c-cba0-4cda-b70b-2933f2c6195a None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:43.413910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07283a8c-cba0-4cda-b70b-2933f2c6195a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:43.414203 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07283a8c-cba0-4cda-b70b-2933f2c6195a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:43.415873 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07283a8c-cba0-4cda-b70b-2933f2c6195a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:43.435069 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 615/1218] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:22:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:22:43.436811 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b1cc5-7d1b-4a8e-a8af-7f2c05261e89 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:43.560146 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b1cc5-7d1b-4a8e-a8af-7f2c05261e89 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:43.598028 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:43.605834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8aeef5-d4fa-4d22-9264-b31f9a9cf585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:43.606490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aeef5-d4fa-4d22-9264-b31f9a9cf585 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:43.606804 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aeef5-d4fa-4d22-9264-b31f9a9cf585 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:43.607074 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aeef5-d4fa-4d22-9264-b31f9a9cf585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:43.607866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8aeef5-d4fa-4d22-9264-b31f9a9cf585 None admin] RBAC: Adding query filter params (role.id=21a27b57a72246b2ade92d82599c569d, scope.project.id=9527063094354a99a80822107d2740fb, user.id=dae8db0856ed44088f0bd3cb93701de0) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:43.608197 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8aeef5-d4fa-4d22-9264-b31f9a9cf585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:43.609781 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8aeef5-d4fa-4d22-9264-b31f9a9cf585 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:43.616355 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 604/1219] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:22:43 2022] GET /identity/v3/role_assignments?user.id=dae8db0856ed44088f0bd3cb93701de0&scope.project.id=9527063094354a99a80822107d2740fb&role.id=21a27b57a72246b2ade92d82599c569d => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:45.592466 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd76dfa-e1a5-4e05-86b3-42272d27b28c None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:45.593022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd76dfa-e1a5-4e05-86b3-42272d27b28c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:45.593022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd76dfa-e1a5-4e05-86b3-42272d27b28c None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:45.594489 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 616/1220] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:22:45.600093 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0d36c-b144-4ce8-be59-0616767adedf None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:45.600560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0d36c-b144-4ce8-be59-0616767adedf None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:45.600670 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0d36c-b144-4ce8-be59-0616767adedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:45.618707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-7ca0d36c-b144-4ce8-be59-0616767adedf None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:22:45.619895 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7ca0d36c-b144-4ce8-be59-0616767adedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:22:45.694238 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 605/1221] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:22:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:22:45.980541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd76dfa-e1a5-4e05-86b3-42272d27b28c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:46.101120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd76dfa-e1a5-4e05-86b3-42272d27b28c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:46.139161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a5625-0735-47f6-80f6-b3446dadf238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:46.139802 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a5625-0735-47f6-80f6-b3446dadf238 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:46.140105 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a5625-0735-47f6-80f6-b3446dadf238 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:46.140377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a5625-0735-47f6-80f6-b3446dadf238 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:46.153998 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a5625-0735-47f6-80f6-b3446dadf238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:22:46.158903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-df6a5625-0735-47f6-80f6-b3446dadf238 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:22:46.158903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:46.158903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:46.158903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:46.158903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:46.158903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:46.158903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:46.158903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:46.158903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:46.158903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:46.158903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:46.158903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:46.158903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:22:46.158903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:22:46.158903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:22:46.158903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:22:46.160160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:22:46.160160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:22:46.160160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:22:46.160160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:22:46.160160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:46.160160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:46.160160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:46.160160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:46.160160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:46.160160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:46.160160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:46.160160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:46.160160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:46.160160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:46.160160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:46.160160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:46.161137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:46.161137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:46.161137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:46.161137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:46.161137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:22:46.161137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:22:46.161137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:22:46.161137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:22:46.161137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:22:46.161137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:22:46.161137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:22:46.161137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:22:46.161137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 617/1222] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:22:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:22:46.166318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0d36c-b144-4ce8-be59-0616767adedf None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:46.281992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0d36c-b144-4ce8-be59-0616767adedf None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:46.309362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:46.323183 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a59573-ee83-4c29-befb-4ee08ce3a085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:46.323793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a59573-ee83-4c29-befb-4ee08ce3a085 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:46.324081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a59573-ee83-4c29-befb-4ee08ce3a085 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:46.324345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a59573-ee83-4c29-befb-4ee08ce3a085 None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:46.325010 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a59573-ee83-4c29-befb-4ee08ce3a085 None admin] RBAC: Adding query filter params (name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:46.325312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a59573-ee83-4c29-befb-4ee08ce3a085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:46.326702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a59573-ee83-4c29-befb-4ee08ce3a085 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:46.342669 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 606/1223] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:22:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:46.346068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a5625-0735-47f6-80f6-b3446dadf238 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:46.396734 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:46.459423 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a5625-0735-47f6-80f6-b3446dadf238 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:46.499686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79164da7-a3e5-4dc4-80ad-2d3ce568438f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:46.500465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79164da7-a3e5-4dc4-80ad-2d3ce568438f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:46.500741 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79164da7-a3e5-4dc4-80ad-2d3ce568438f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:46.501009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79164da7-a3e5-4dc4-80ad-2d3ce568438f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:46.513793 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79164da7-a3e5-4dc4-80ad-2d3ce568438f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:46.515562 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79164da7-a3e5-4dc4-80ad-2d3ce568438f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:46.533048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-79164da7-a3e5-4dc4-80ad-2d3ce568438f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:46.533048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:46.533048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:46.533048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:46.533048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:46.533048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:46.533048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:46.533048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:46.533048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:46.533048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:46.533048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:46.533048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:46.533048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:22:46.533048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:22:46.533048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:22:46.533048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:22:46.534325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:46.534325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:46.534325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:46.534325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:46.534325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:46.534325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:46.534325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:46.534325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:46.534325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:46.534325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:46.534325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:46.534325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:46.534325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:46.534325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:46.534325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:46.534325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:46.534325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:22:46.535281 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:22:46.535281 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:46.535281 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:22:46.535281 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 618/1224] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:22:46.540531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a59573-ee83-4c29-befb-4ee08ce3a085 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:46.671676 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a59573-ee83-4c29-befb-4ee08ce3a085 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:46.714690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7bc18-2753-485a-963c-8f1ec49a46fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:46.715316 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7bc18-2753-485a-963c-8f1ec49a46fc None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:46.715596 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7bc18-2753-485a-963c-8f1ec49a46fc None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:46.715867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7bc18-2753-485a-963c-8f1ec49a46fc None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:46.716515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7bc18-2753-485a-963c-8f1ec49a46fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:46.716818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7bc18-2753-485a-963c-8f1ec49a46fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:46.718180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7bc18-2753-485a-963c-8f1ec49a46fc None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:46.731271 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 607/1225] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:46.738055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79164da7-a3e5-4dc4-80ad-2d3ce568438f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:46.849604 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:46.858678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79164da7-a3e5-4dc4-80ad-2d3ce568438f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:46.895055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5de00-1106-49d4-b667-7eaec37c8295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:46.895731 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5de00-1106-49d4-b667-7eaec37c8295 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:46.896056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5de00-1106-49d4-b667-7eaec37c8295 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:46.896338 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5de00-1106-49d4-b667-7eaec37c8295 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:46.904479 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5de00-1106-49d4-b667-7eaec37c8295 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:46.905910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5de00-1106-49d4-b667-7eaec37c8295 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:46.920665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-7eb5de00-1106-49d4-b667-7eaec37c8295 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:22:46.920665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:46.920665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:46.920665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:46.920665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:46.920665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:46.920665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:46.920665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:46.920665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:46.920665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:46.920665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:46.920665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:46.920665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:22:46.920665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:22:46.920665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:22:46.920665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:46.921869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:46.923713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:46.923713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:46.923713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:22:46.923713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:22:46.923713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:22:46.923713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:22:46.923713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:22:46.923713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:22:46.923713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:22:46.923713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:22:46.923713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 619/1226] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:22:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:22:46.929396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7bc18-2753-485a-963c-8f1ec49a46fc None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:46.986242 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:47.045775 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7bc18-2753-485a-963c-8f1ec49a46fc None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:47.087593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3164f67-ad97-41d8-99ce-5f8137f26b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:47.088280 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3164f67-ad97-41d8-99ce-5f8137f26b93 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:47.088701 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3164f67-ad97-41d8-99ce-5f8137f26b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:47.088927 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3164f67-ad97-41d8-99ce-5f8137f26b93 None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:47.090085 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3164f67-ad97-41d8-99ce-5f8137f26b93 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:47.090465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3164f67-ad97-41d8-99ce-5f8137f26b93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:47.092157 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3164f67-ad97-41d8-99ce-5f8137f26b93 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:47.115666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 608/1227] 10.222.0.71 () {56 vars in 1143 bytes} [Thu Sep 1 16:22:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:47.116989 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5de00-1106-49d4-b667-7eaec37c8295 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:47.225397 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5de00-1106-49d4-b667-7eaec37c8295 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:47.264172 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4be61-85ad-4678-b698-bef365d906bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:47.264946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4be61-85ad-4678-b698-bef365d906bd None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:47.265248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4be61-85ad-4678-b698-bef365d906bd None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:47.265517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4be61-85ad-4678-b698-bef365d906bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:47.277938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4be61-85ad-4678-b698-bef365d906bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:47.279416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4be61-85ad-4678-b698-bef365d906bd None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:47.293931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-96a4be61-85ad-4678-b698-bef365d906bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:47.293931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:47.293931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:47.293931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:47.293931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:47.293931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:47.293931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:47.293931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:47.293931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:47.293931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:47.293931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:47.293931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:47.293931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:22:47.293931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:22:47.293931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:22:47.293931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:22:47.294972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:47.294972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:47.294972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:47.294972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:47.294972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:47.294972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:47.294972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:47.294972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:47.294972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:47.294972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:47.294972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:47.294972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:47.294972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:47.294972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:47.294972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:47.294972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:47.294972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:22:47.296051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:22:47.296051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:47.296051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:22:47.296051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 620/1228] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:22:47.301327 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3164f67-ad97-41d8-99ce-5f8137f26b93 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:47.411795 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3164f67-ad97-41d8-99ce-5f8137f26b93 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:47.415545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:47.452182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21672f6a-0ed0-46ff-96fd-83112c3a4f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:47.452512 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21672f6a-0ed0-46ff-96fd-83112c3a4f32 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:47.452855 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21672f6a-0ed0-46ff-96fd-83112c3a4f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:47.453095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21672f6a-0ed0-46ff-96fd-83112c3a4f32 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:47.453870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21672f6a-0ed0-46ff-96fd-83112c3a4f32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:47.454259 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21672f6a-0ed0-46ff-96fd-83112c3a4f32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:47.455925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21672f6a-0ed0-46ff-96fd-83112c3a4f32 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:47.468886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 609/1229] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:47.475380 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4be61-85ad-4678-b698-bef365d906bd None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:47.487065 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:47.585170 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4be61-85ad-4678-b698-bef365d906bd None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:47.622076 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3e482-9112-4236-9e97-64d411b2d556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:47.622832 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3e482-9112-4236-9e97-64d411b2d556 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:47.623114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3e482-9112-4236-9e97-64d411b2d556 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:47.623395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3e482-9112-4236-9e97-64d411b2d556 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:47.631696 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3e482-9112-4236-9e97-64d411b2d556 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:47.633129 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3e482-9112-4236-9e97-64d411b2d556 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:47.647454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-e8b3e482-9112-4236-9e97-64d411b2d556 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:22:47.647454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:47.647454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:47.647454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:47.647454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:47.647454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:47.647454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:47.647454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:47.647454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:47.647454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:47.647454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:47.647454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:47.647454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:22:47.647454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:22:47.647454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:22:47.648522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:22:47.648522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:47.648522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:47.648522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:47.648522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:47.648522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:47.648522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:47.648522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:47.648522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:47.648522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:47.648522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:47.648522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:47.648522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:47.648522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:47.648522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:47.648522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:47.648522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:47.649471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:22:47.649471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:22:47.649471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:22:47.649471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:22:47.649471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:22:47.649471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:22:47.649471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:22:47.649471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:22:47.649471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 621/1230] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:22:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:22:47.654500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21672f6a-0ed0-46ff-96fd-83112c3a4f32 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:47.758181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21672f6a-0ed0-46ff-96fd-83112c3a4f32 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:47.794149 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd38e3d-61c1-4d0e-828f-515343cd2942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:47.794789 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd38e3d-61c1-4d0e-828f-515343cd2942 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:47.795063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd38e3d-61c1-4d0e-828f-515343cd2942 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:47.795336 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd38e3d-61c1-4d0e-828f-515343cd2942 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:47.796036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd38e3d-61c1-4d0e-828f-515343cd2942 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:47.796339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd38e3d-61c1-4d0e-828f-515343cd2942 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:47.797775 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd38e3d-61c1-4d0e-828f-515343cd2942 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:47.810019 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 610/1231] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:22:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:22:47.816394 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3e482-9112-4236-9e97-64d411b2d556 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:47.884847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:47.924211 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3e482-9112-4236-9e97-64d411b2d556 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:47.959753 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e277c-c9e0-4b61-ac76-61962b011d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:47.960415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e277c-c9e0-4b61-ac76-61962b011d5d None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:47.960692 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e277c-c9e0-4b61-ac76-61962b011d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:47.961018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e277c-c9e0-4b61-ac76-61962b011d5d None admin] PATH_INFO: `/v3/projects/9527063094354a99a80822107d2740fb/users/dae8db0856ed44088f0bd3cb93701de0/roles/21a27b57a72246b2ade92d82599c569d` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:47.984339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e277c-c9e0-4b61-ac76-61962b011d5d None admin] RBAC: Authorizing `identity:create_grant(project_id=9527063094354a99a80822107d2740fb, user_id=dae8db0856ed44088f0bd3cb93701de0, role_id=21a27b57a72246b2ade92d82599c569d)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:47.986361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e277c-c9e0-4b61-ac76-61962b011d5d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:48.001053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 622/1232] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:22:47 2022] PUT /identity/v3/projects/9527063094354a99a80822107d2740fb/users/dae8db0856ed44088f0bd3cb93701de0/roles/21a27b57a72246b2ade92d82599c569d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:22:49.902745 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3615a-2cf8-4235-8dc4-6ca31a55ed6e None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:49.903350 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3615a-2cf8-4235-8dc4-6ca31a55ed6e None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:49.903350 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3615a-2cf8-4235-8dc4-6ca31a55ed6e None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:49.904558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 611/1233] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:22:49.909982 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430962ce-fb39-4c19-9e28-0d9772edc7d7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:49.910429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430962ce-fb39-4c19-9e28-0d9772edc7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:49.910523 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430962ce-fb39-4c19-9e28-0d9772edc7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:49.932051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-430962ce-fb39-4c19-9e28-0d9772edc7d7 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:22:49.933608 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-430962ce-fb39-4c19-9e28-0d9772edc7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:22:50.018553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 623/1234] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:22:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:22:50.339387 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3615a-2cf8-4235-8dc4-6ca31a55ed6e None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:50.367522 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:50.455928 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3615a-2cf8-4235-8dc4-6ca31a55ed6e None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:50.493721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead44127-b834-4edd-acd1-fdcc42a90b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:50.494345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead44127-b834-4edd-acd1-fdcc42a90b70 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:50.494641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead44127-b834-4edd-acd1-fdcc42a90b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:50.494915 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead44127-b834-4edd-acd1-fdcc42a90b70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:50.506394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead44127-b834-4edd-acd1-fdcc42a90b70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:22:50.512649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-ead44127-b834-4edd-acd1-fdcc42a90b70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:22:50.512649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:50.512649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:50.512649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:50.512649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:50.512649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:50.512649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:50.512649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:50.512649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:50.512649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:50.512649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:50.512649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:50.512649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:22:50.512649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:22:50.512649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:22:50.512649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:22:50.513823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:22:50.513823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:22:50.513823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:22:50.513823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:22:50.513823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:50.513823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:50.513823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:50.513823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:50.513823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:50.513823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:50.513823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:50.513823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:50.513823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:50.513823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:50.513823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:50.513823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:50.514953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:50.514953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:50.514953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:50.514953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:50.514953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:22:50.514953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:22:50.514953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:22:50.514953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:22:50.514953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:22:50.514953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:22:50.514953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:22:50.514953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:22:50.518786 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 612/1235] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Sep 1 16:22:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:22:50.521098 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430962ce-fb39-4c19-9e28-0d9772edc7d7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:50.570253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:50.636400 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430962ce-fb39-4c19-9e28-0d9772edc7d7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:50.671333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1e9fb-135f-413d-9d41-0bd6c0ca3e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:50.671987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1e9fb-135f-413d-9d41-0bd6c0ca3e9f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:50.672220 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1e9fb-135f-413d-9d41-0bd6c0ca3e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:50.672488 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1e9fb-135f-413d-9d41-0bd6c0ca3e9f None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:50.673655 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1e9fb-135f-413d-9d41-0bd6c0ca3e9f None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:50.673954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1e9fb-135f-413d-9d41-0bd6c0ca3e9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:50.675370 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1e9fb-135f-413d-9d41-0bd6c0ca3e9f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:50.683349 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 624/1236] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Sep 1 16:22:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:22:50.689861 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead44127-b834-4edd-acd1-fdcc42a90b70 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:50.779803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:50.796866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead44127-b834-4edd-acd1-fdcc42a90b70 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:50.832980 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d15d10-2ec4-47a6-a53a-70aed8fe592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:50.833663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d15d10-2ec4-47a6-a53a-70aed8fe592b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:50.833976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d15d10-2ec4-47a6-a53a-70aed8fe592b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:50.834322 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d15d10-2ec4-47a6-a53a-70aed8fe592b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:50.846424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d15d10-2ec4-47a6-a53a-70aed8fe592b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:50.848089 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d15d10-2ec4-47a6-a53a-70aed8fe592b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:50.865732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-60d15d10-2ec4-47a6-a53a-70aed8fe592b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:50.865732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:50.865732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:50.865732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:50.865732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:50.865732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:50.865732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:50.865732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:50.865732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:50.865732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:50.865732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:50.865732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:50.865732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:22:50.865732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:22:50.865732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:22:50.865732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:22:50.868080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:50.868080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:50.868080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:50.868080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:50.868080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:50.868080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:50.868080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:50.868080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:50.868080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:50.868080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:50.868080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:50.868080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:50.868080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:50.868080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:50.868080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:50.868080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:50.868080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:22:50.869889 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:22:50.869889 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:50.869889 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:22:50.869889 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 613/1237] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:22:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:22:50.875023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1e9fb-135f-413d-9d41-0bd6c0ca3e9f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:50.992343 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1e9fb-135f-413d-9d41-0bd6c0ca3e9f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:51.007604 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:51.039280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f35d2-0588-416a-843c-dc9466c8a114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:51.040403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f35d2-0588-416a-843c-dc9466c8a114 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:51.040682 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f35d2-0588-416a-843c-dc9466c8a114 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:51.040952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f35d2-0588-416a-843c-dc9466c8a114 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:51.041600 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f35d2-0588-416a-843c-dc9466c8a114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:51.041902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f35d2-0588-416a-843c-dc9466c8a114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:51.043303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f35d2-0588-416a-843c-dc9466c8a114 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:51.058092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 625/1238] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:51.065021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d15d10-2ec4-47a6-a53a-70aed8fe592b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:51.183437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d15d10-2ec4-47a6-a53a-70aed8fe592b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:51.224223 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ac7b0-0a7b-45a0-82a7-78f5163605dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:51.225588 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ac7b0-0a7b-45a0-82a7-78f5163605dd None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:51.225588 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ac7b0-0a7b-45a0-82a7-78f5163605dd None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:51.225588 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ac7b0-0a7b-45a0-82a7-78f5163605dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:51.229191 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:51.234489 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ac7b0-0a7b-45a0-82a7-78f5163605dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:51.236249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ac7b0-0a7b-45a0-82a7-78f5163605dd None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:51.247961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-156ac7b0-0a7b-45a0-82a7-78f5163605dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:22:51.247961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:51.247961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:51.247961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:51.247961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:51.247961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:51.247961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:51.247961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:51.247961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:51.247961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:51.247961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:51.247961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:51.247961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:22:51.247961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:22:51.247961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:22:51.247961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:51.249134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:51.250235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:51.250235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:51.250235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:22:51.250235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:22:51.250235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:22:51.250235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:22:51.250235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:22:51.250235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:22:51.250235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:22:51.250235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:22:51.250235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 614/1239] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:22:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:22:51.255611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f35d2-0588-416a-843c-dc9466c8a114 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:51.366745 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f35d2-0588-416a-843c-dc9466c8a114 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:51.413740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e514f-89f0-4029-ad99-3605bdc84dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:51.414371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e514f-89f0-4029-ad99-3605bdc84dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:51.414679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e514f-89f0-4029-ad99-3605bdc84dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:51.414957 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e514f-89f0-4029-ad99-3605bdc84dd1 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:51.415701 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e514f-89f0-4029-ad99-3605bdc84dd1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:51.416005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e514f-89f0-4029-ad99-3605bdc84dd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:51.417462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e514f-89f0-4029-ad99-3605bdc84dd1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:51.436280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 626/1240] 10.222.0.71 () {56 vars in 1143 bytes} [Thu Sep 1 16:22:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:51.442763 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ac7b0-0a7b-45a0-82a7-78f5163605dd None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:51.553256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ac7b0-0a7b-45a0-82a7-78f5163605dd None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:51.587477 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315811a-f850-4f5c-a4b2-c03a61a76d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:51.588333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315811a-f850-4f5c-a4b2-c03a61a76d0d None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:51.588614 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315811a-f850-4f5c-a4b2-c03a61a76d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:51.588906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315811a-f850-4f5c-a4b2-c03a61a76d0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:51.664418 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:51.671604 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315811a-f850-4f5c-a4b2-c03a61a76d0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:51.673187 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315811a-f850-4f5c-a4b2-c03a61a76d0d None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:51.774450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 615/1241] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:22:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:22:51.780147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e514f-89f0-4029-ad99-3605bdc84dd1 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:51.809362 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:51.891304 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e514f-89f0-4029-ad99-3605bdc84dd1 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:51.932021 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31ab6d-5c48-4df1-a543-a4c5ad5671d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:51.932737 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31ab6d-5c48-4df1-a543-a4c5ad5671d9 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:51.933242 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31ab6d-5c48-4df1-a543-a4c5ad5671d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:51.933522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31ab6d-5c48-4df1-a543-a4c5ad5671d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:51.945193 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31ab6d-5c48-4df1-a543-a4c5ad5671d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:51.946867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31ab6d-5c48-4df1-a543-a4c5ad5671d9 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:51.965877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-ad31ab6d-5c48-4df1-a543-a4c5ad5671d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:51.965877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:51.965877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:51.965877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:51.965877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:51.965877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:51.965877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:51.965877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:51.965877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:51.965877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:51.965877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:51.965877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:51.965877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:22:51.965877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:22:51.965877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:22:51.965877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:22:51.967116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:51.967116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:51.967116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:51.967116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:51.967116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:51.967116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:51.967116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:51.967116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:51.967116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:51.967116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:51.967116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:51.967116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:51.967116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:51.967116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:51.967116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:51.967116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:51.967116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:22:51.968306 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:22:51.968306 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:51.968306 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:22:51.968306 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 627/1242] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:22:51.974730 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315811a-f850-4f5c-a4b2-c03a61a76d0d None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:52.089466 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:52.096281 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315811a-f850-4f5c-a4b2-c03a61a76d0d None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:52.130413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bb871-81d2-438f-b5b6-34b153d44830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:52.131032 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bb871-81d2-438f-b5b6-34b153d44830 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:52.131307 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bb871-81d2-438f-b5b6-34b153d44830 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:52.131574 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bb871-81d2-438f-b5b6-34b153d44830 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:52.132204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bb871-81d2-438f-b5b6-34b153d44830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:52.132502 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bb871-81d2-438f-b5b6-34b153d44830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:52.133843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bb871-81d2-438f-b5b6-34b153d44830 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:52.146159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 616/1243] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:52.152247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31ab6d-5c48-4df1-a543-a4c5ad5671d9 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:52.245392 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:52.271170 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31ab6d-5c48-4df1-a543-a4c5ad5671d9 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:52.309615 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74effb35-ab9d-4c86-96af-5ad3867d7e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:52.310252 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74effb35-ab9d-4c86-96af-5ad3867d7e2a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:52.310526 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74effb35-ab9d-4c86-96af-5ad3867d7e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:52.310823 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74effb35-ab9d-4c86-96af-5ad3867d7e2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:52.317835 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74effb35-ab9d-4c86-96af-5ad3867d7e2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:52.319289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74effb35-ab9d-4c86-96af-5ad3867d7e2a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:52.330754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-74effb35-ab9d-4c86-96af-5ad3867d7e2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:22:52.330754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:52.330754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:52.330754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:52.330754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:52.330754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:52.330754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:52.330754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:52.330754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:52.330754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:52.330754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:52.330754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:52.330754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:22:52.330754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:22:52.330754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:22:52.331960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:22:52.331960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:52.331960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:52.331960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:52.331960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:52.331960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:52.331960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:52.331960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:52.331960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:52.331960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:52.331960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:52.331960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:52.331960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:52.331960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:52.331960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:52.331960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:52.331960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:52.333208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:22:52.333208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:22:52.333208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:22:52.333208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:22:52.333208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:22:52.333208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:22:52.333208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:22:52.333208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:22:52.333208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 628/1244] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:22:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:22:52.337962 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bb871-81d2-438f-b5b6-34b153d44830 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:52.458523 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bb871-81d2-438f-b5b6-34b153d44830 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:52.493585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579b839-6725-4661-be31-2944d8ff00e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:52.494231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579b839-6725-4661-be31-2944d8ff00e6 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:52.494505 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579b839-6725-4661-be31-2944d8ff00e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:52.494798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579b839-6725-4661-be31-2944d8ff00e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:52.495483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579b839-6725-4661-be31-2944d8ff00e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:52.495782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579b839-6725-4661-be31-2944d8ff00e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:52.497191 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579b839-6725-4661-be31-2944d8ff00e6 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:52.509518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 617/1245] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:22:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:22:52.515819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74effb35-ab9d-4c86-96af-5ad3867d7e2a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:52.635388 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74effb35-ab9d-4c86-96af-5ad3867d7e2a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:52.672176 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec57c8-f551-49bd-b40a-390773c384a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:52.672854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec57c8-f551-49bd-b40a-390773c384a2 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:52.673597 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec57c8-f551-49bd-b40a-390773c384a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:52.673860 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec57c8-f551-49bd-b40a-390773c384a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:52.674680 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec57c8-f551-49bd-b40a-390773c384a2 None admin] RBAC: Adding query filter params (role.id=21a27b57a72246b2ade92d82599c569d, scope.project.id=9527063094354a99a80822107d2740fb, user.id=dae8db0856ed44088f0bd3cb93701de0) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:52.674916 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec57c8-f551-49bd-b40a-390773c384a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:52.676329 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec57c8-f551-49bd-b40a-390773c384a2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:52.682163 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 629/1246] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:22:52 2022] GET /identity/v3/role_assignments?user.id=dae8db0856ed44088f0bd3cb93701de0&scope.project.id=9527063094354a99a80822107d2740fb&role.id=21a27b57a72246b2ade92d82599c569d => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:54.900232 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dd42d-6c93-45aa-a74b-b6db8c087514 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:54.900737 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dd42d-6c93-45aa-a74b-b6db8c087514 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:54.900847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dd42d-6c93-45aa-a74b-b6db8c087514 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:54.902637 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 618/1247] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:22:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:22:54.909435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f7ffa-a3b6-4e5c-aea2-0ebfbf80f4cb None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:54.909921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f7ffa-a3b6-4e5c-aea2-0ebfbf80f4cb None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:54.910043 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f7ffa-a3b6-4e5c-aea2-0ebfbf80f4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:54.916513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:54.931785 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-984f7ffa-a3b6-4e5c-aea2-0ebfbf80f4cb None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:22:54.933003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-984f7ffa-a3b6-4e5c-aea2-0ebfbf80f4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:22:55.021508 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 630/1248] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:22:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:22:55.367222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dd42d-6c93-45aa-a74b-b6db8c087514 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:55.389794 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:55.482806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dd42d-6c93-45aa-a74b-b6db8c087514 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:55.519470 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f41a92-42a7-4260-9366-a61a5ad0cc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:55.520088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f41a92-42a7-4260-9366-a61a5ad0cc29 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:55.520363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f41a92-42a7-4260-9366-a61a5ad0cc29 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:55.520634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f41a92-42a7-4260-9366-a61a5ad0cc29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:55.530591 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f41a92-42a7-4260-9366-a61a5ad0cc29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:22:55.536686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-89f41a92-42a7-4260-9366-a61a5ad0cc29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:22:55.536686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:55.536686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:55.536686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:55.536686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:55.536686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:55.536686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:55.536686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:55.536686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:55.536686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:55.536686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:55.536686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:55.536686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:22:55.536686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:22:55.536686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:22:55.536686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:22:55.537805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:22:55.537805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:22:55.537805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:22:55.537805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:22:55.537805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:55.537805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:55.537805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:55.537805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:55.537805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:55.537805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:55.537805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:55.537805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:55.537805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:55.537805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:55.537805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:55.537805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:55.539780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:55.539780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:55.539780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:55.539780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:55.539780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:22:55.539780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:22:55.539780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:22:55.539780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:22:55.539780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:22:55.539780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:22:55.539780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:22:55.539780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:22:55.539780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 619/1249] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:22:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:22:55.544611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f7ffa-a3b6-4e5c-aea2-0ebfbf80f4cb None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:55.662874 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f7ffa-a3b6-4e5c-aea2-0ebfbf80f4cb None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:55.698366 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:55.704307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7f484-a68c-4b80-b173-88d701fad67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:55.704885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7f484-a68c-4b80-b173-88d701fad67b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:55.705736 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7f484-a68c-4b80-b173-88d701fad67b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:55.706077 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7f484-a68c-4b80-b173-88d701fad67b None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:55.706681 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7f484-a68c-4b80-b173-88d701fad67b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:55.706985 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7f484-a68c-4b80-b173-88d701fad67b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:55.708343 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7f484-a68c-4b80-b173-88d701fad67b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:55.717242 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 631/1250] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:22:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:55.723101 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f41a92-42a7-4260-9366-a61a5ad0cc29 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:55.815296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:55.840606 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f41a92-42a7-4260-9366-a61a5ad0cc29 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:55.878260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a4221-fb7d-42e8-a218-9d097a2f5f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:55.879103 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4221-fb7d-42e8-a218-9d097a2f5f32 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:55.879435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4221-fb7d-42e8-a218-9d097a2f5f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:55.879812 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4221-fb7d-42e8-a218-9d097a2f5f32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:55.892969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a4221-fb7d-42e8-a218-9d097a2f5f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:55.895033 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a4221-fb7d-42e8-a218-9d097a2f5f32 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:55.912296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-e25a4221-fb7d-42e8-a218-9d097a2f5f32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:55.912296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:55.912296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:55.912296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:55.912296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:55.912296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:55.912296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:55.912296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:55.912296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:55.912296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:55.912296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:55.912296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:55.912296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:22:55.912296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:22:55.912296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:22:55.912296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:22:55.913986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:55.913986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:55.913986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:55.913986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:55.913986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:55.913986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:55.913986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:55.913986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:55.913986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:55.913986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:55.913986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:55.913986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:55.913986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:55.913986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:55.913986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:55.913986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:55.913986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:22:55.914972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:22:55.914972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:55.914972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:22:55.914972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 620/1251] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:22:55.919880 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7f484-a68c-4b80-b173-88d701fad67b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:56.030989 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7f484-a68c-4b80-b173-88d701fad67b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:56.069864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dbbdb-7962-4c93-bd2f-56fcac40e8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:56.070757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dbbdb-7962-4c93-bd2f-56fcac40e8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:56.071041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dbbdb-7962-4c93-bd2f-56fcac40e8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:56.071312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dbbdb-7962-4c93-bd2f-56fcac40e8d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:56.071988 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8dbbdb-7962-4c93-bd2f-56fcac40e8d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:56.072428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8dbbdb-7962-4c93-bd2f-56fcac40e8d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:56.073821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8dbbdb-7962-4c93-bd2f-56fcac40e8d9 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:56.088000 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 632/1252] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:22:56.094184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a4221-fb7d-42e8-a218-9d097a2f5f32 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:56.217603 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a4221-fb7d-42e8-a218-9d097a2f5f32 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:56.243055 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:56.251306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161787c-d108-4b89-a7a5-786548a68ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:56.251930 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161787c-d108-4b89-a7a5-786548a68ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:56.252206 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161787c-d108-4b89-a7a5-786548a68ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:56.252509 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161787c-d108-4b89-a7a5-786548a68ba4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:56.260049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161787c-d108-4b89-a7a5-786548a68ba4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:56.261523 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161787c-d108-4b89-a7a5-786548a68ba4 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:56.273834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-7161787c-d108-4b89-a7a5-786548a68ba4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:22:56.273834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:56.273834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:56.273834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:56.273834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:56.273834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:56.273834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:56.273834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:56.273834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:56.273834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:56.273834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:56.273834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:56.273834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:22:56.273834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:22:56.273834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:22:56.273834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:56.275339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:56.276500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:56.276500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:56.276500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:22:56.276500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:22:56.276500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:22:56.276500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:22:56.276500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:22:56.276500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:22:56.276500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:22:56.276500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:22:56.276500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 621/1253] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:22:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:22:56.280799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dbbdb-7962-4c93-bd2f-56fcac40e8d9 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:56.346093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:56.393359 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dbbdb-7962-4c93-bd2f-56fcac40e8d9 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:56.429440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85ed47-c426-4bbf-b61e-e0abb756b020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:56.430045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ed47-c426-4bbf-b61e-e0abb756b020 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:56.430322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ed47-c426-4bbf-b61e-e0abb756b020 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:56.430593 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ed47-c426-4bbf-b61e-e0abb756b020 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:56.431344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85ed47-c426-4bbf-b61e-e0abb756b020 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:56.431650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85ed47-c426-4bbf-b61e-e0abb756b020 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:56.433075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85ed47-c426-4bbf-b61e-e0abb756b020 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:56.452746 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 633/1254] 10.222.0.71 () {56 vars in 1143 bytes} [Thu Sep 1 16:22:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:56.459295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161787c-d108-4b89-a7a5-786548a68ba4 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:56.573168 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161787c-d108-4b89-a7a5-786548a68ba4 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:56.611670 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c1004-3565-4987-8823-281d727a4541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:56.612340 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c1004-3565-4987-8823-281d727a4541 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:56.612663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c1004-3565-4987-8823-281d727a4541 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:56.612991 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c1004-3565-4987-8823-281d727a4541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:56.676480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:56.694364 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c1004-3565-4987-8823-281d727a4541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:56.696040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c1004-3565-4987-8823-281d727a4541 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:56.814461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 622/1255] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:22:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:22:56.821351 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85ed47-c426-4bbf-b61e-e0abb756b020 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:56.935039 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85ed47-c426-4bbf-b61e-e0abb756b020 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:56.951930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:56.976101 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f785e1-d491-465c-9244-0f46bc5bae48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:56.976787 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f785e1-d491-465c-9244-0f46bc5bae48 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:56.977092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f785e1-d491-465c-9244-0f46bc5bae48 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:56.977374 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f785e1-d491-465c-9244-0f46bc5bae48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:56.994743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f785e1-d491-465c-9244-0f46bc5bae48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:56.996417 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f785e1-d491-465c-9244-0f46bc5bae48 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:57.012713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-25f785e1-d491-465c-9244-0f46bc5bae48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:57.012713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:57.012713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:57.012713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:57.012713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:57.012713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:57.012713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:57.012713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:57.012713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:57.012713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:57.012713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:57.012713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:57.012713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:22:57.012713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:22:57.012713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:22:57.012713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:22:57.013944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:57.013944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:57.013944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:57.013944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:57.013944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:57.013944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:57.013944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:57.013944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:57.013944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:57.013944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:57.013944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:57.013944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:57.013944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:57.013944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:57.013944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:57.013944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:57.013944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:22:57.015096 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:22:57.015096 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:22:57.015096 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:22:57.015096 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 634/1256] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:22:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:22:57.020244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c1004-3565-4987-8823-281d727a4541 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:57.117558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:57.131108 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c1004-3565-4987-8823-281d727a4541 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:57.166098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765f972-452c-41de-8de1-269571c40ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:57.166754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765f972-452c-41de-8de1-269571c40ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:57.167032 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765f972-452c-41de-8de1-269571c40ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:57.167298 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765f972-452c-41de-8de1-269571c40ca9 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:57.167951 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765f972-452c-41de-8de1-269571c40ca9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:57.168252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765f972-452c-41de-8de1-269571c40ca9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:57.169637 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765f972-452c-41de-8de1-269571c40ca9 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:57.187989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 623/1257] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:57.188945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f785e1-d491-465c-9244-0f46bc5bae48 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:57.290524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f785e1-d491-465c-9244-0f46bc5bae48 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:57.325500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a226a4-f725-4155-b454-f0accd75d042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:57.326127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a226a4-f725-4155-b454-f0accd75d042 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:57.326399 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a226a4-f725-4155-b454-f0accd75d042 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:57.326686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a226a4-f725-4155-b454-f0accd75d042 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:57.334245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a226a4-f725-4155-b454-f0accd75d042 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:57.335716 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a226a4-f725-4155-b454-f0accd75d042 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:57.348378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-21a226a4-f725-4155-b454-f0accd75d042 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:22:57.348378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:57.348378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:57.348378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:57.348378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:57.348378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:57.348378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:57.348378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:57.348378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:57.348378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:57.348378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:57.348378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:57.348378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:22:57.348378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:22:57.348378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:22:57.349517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:22:57.349517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:57.349517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:57.349517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:57.349517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:57.349517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:57.349517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:57.349517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:57.349517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:57.349517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:57.349517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:57.349517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:57.349517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:57.349517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:57.349517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:57.349517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:57.349517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:57.355624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:22:57.355624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:22:57.355624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:22:57.355624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:22:57.355624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:22:57.355624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:22:57.355624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:22:57.355624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:22:57.355624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 635/1258] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:22:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:22:57.357816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765f972-452c-41de-8de1-269571c40ca9 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:57.460950 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765f972-452c-41de-8de1-269571c40ca9 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:57.495070 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b7818-8484-4796-9b82-ce4b0d4b5af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:57.495673 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b7818-8484-4796-9b82-ce4b0d4b5af4 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:57.496044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b7818-8484-4796-9b82-ce4b0d4b5af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:57.496285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b7818-8484-4796-9b82-ce4b0d4b5af4 None admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:57.496976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b7818-8484-4796-9b82-ce4b0d4b5af4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:57.497274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b7818-8484-4796-9b82-ce4b0d4b5af4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:57.498705 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b7818-8484-4796-9b82-ce4b0d4b5af4 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:57.511393 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 624/1259] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:22:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:57.518083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a226a4-f725-4155-b454-f0accd75d042 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:57.544646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:57.620406 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a226a4-f725-4155-b454-f0accd75d042 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:57.657173 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3004a-3160-4404-995c-0579acdac9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:57.657797 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3004a-3160-4404-995c-0579acdac9fd None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:57.658077 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3004a-3160-4404-995c-0579acdac9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:57.658350 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3004a-3160-4404-995c-0579acdac9fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:57.659107 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3004a-3160-4404-995c-0579acdac9fd None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.project.id=9527063094354a99a80822107d2740fb, user.id=dae8db0856ed44088f0bd3cb93701de0) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:57.659419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3004a-3160-4404-995c-0579acdac9fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:57.660839 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3004a-3160-4404-995c-0579acdac9fd None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:57.666756 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 636/1260] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:22:57 2022] GET /identity/v3/role_assignments?user.id=dae8db0856ed44088f0bd3cb93701de0&scope.project.id=9527063094354a99a80822107d2740fb&role.id=3cd61239237441418529e9028ef801e4 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:59.533655 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041216f-4138-4ea7-b0a8-dca73f9954d3 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:59.534184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041216f-4138-4ea7-b0a8-dca73f9954d3 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:59.534184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041216f-4138-4ea7-b0a8-dca73f9954d3 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:59.535560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 625/1261] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:22:59.540723 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933a6ad-7ac9-4bcb-94c7-0bb068b5527d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:59.541170 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933a6ad-7ac9-4bcb-94c7-0bb068b5527d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:59.541274 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933a6ad-7ac9-4bcb-94c7-0bb068b5527d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:59.560276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-e933a6ad-7ac9-4bcb-94c7-0bb068b5527d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:22:59.561461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e933a6ad-7ac9-4bcb-94c7-0bb068b5527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:22:59.626945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 637/1262] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:22:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:22:59.900222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041216f-4138-4ea7-b0a8-dca73f9954d3 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:59.910971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:00.014902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041216f-4138-4ea7-b0a8-dca73f9954d3 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:00.051620 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdf4a1-9778-4a2e-9979-6a66584f638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:00.052240 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdf4a1-9778-4a2e-9979-6a66584f638c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:00.052519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdf4a1-9778-4a2e-9979-6a66584f638c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:00.052793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdf4a1-9778-4a2e-9979-6a66584f638c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:00.062637 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdf4a1-9778-4a2e-9979-6a66584f638c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:23:00.068300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-6dfdf4a1-9778-4a2e-9979-6a66584f638c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:23:00.068300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:00.068300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:00.068300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:00.068300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:00.068300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:00.068300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:00.068300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:00.068300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:00.068300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:00.068300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:00.068300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:00.068300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:23:00.068300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:23:00.068300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:23:00.068300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:23:00.069424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:23:00.069424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:23:00.069424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:23:00.069424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:23:00.069424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:00.069424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:00.069424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:00.069424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:00.069424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:00.069424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:00.069424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:00.069424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:00.069424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:00.069424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:00.069424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:00.069424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:00.070710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:00.070710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:00.070710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:00.070710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:00.070710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:23:00.070710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:23:00.070710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:23:00.070710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:23:00.070710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:23:00.070710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:23:00.070710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:23:00.070710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:23:00.070710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 626/1263] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:22:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:00.075477 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933a6ad-7ac9-4bcb-94c7-0bb068b5527d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:00.093931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:00.171524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933a6ad-7ac9-4bcb-94c7-0bb068b5527d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:00.203848 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43eb50-4901-4f7a-9df6-0cc77a2c64b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:00.204446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43eb50-4901-4f7a-9df6-0cc77a2c64b2 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:00.204719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43eb50-4901-4f7a-9df6-0cc77a2c64b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:00.204987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43eb50-4901-4f7a-9df6-0cc77a2c64b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:00.205638 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43eb50-4901-4f7a-9df6-0cc77a2c64b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:00.205933 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43eb50-4901-4f7a-9df6-0cc77a2c64b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:00.207296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43eb50-4901-4f7a-9df6-0cc77a2c64b2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:00.215224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 638/1264] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:23:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:00.221450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdf4a1-9778-4a2e-9979-6a66584f638c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:00.286568 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:00.318530 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdf4a1-9778-4a2e-9979-6a66584f638c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:00.352170 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c25d9-2ee4-410b-a921-72d2f1349f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:00.352804 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c25d9-2ee4-410b-a921-72d2f1349f25 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:00.353086 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c25d9-2ee4-410b-a921-72d2f1349f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:00.353357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c25d9-2ee4-410b-a921-72d2f1349f25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:00.363232 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c25d9-2ee4-410b-a921-72d2f1349f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:00.364668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c25d9-2ee4-410b-a921-72d2f1349f25 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:00.379006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-044c25d9-2ee4-410b-a921-72d2f1349f25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:00.379006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:00.379006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:00.379006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:00.379006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:00.379006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:00.379006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:00.379006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:00.379006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:00.379006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:00.379006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:00.379006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:00.379006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:23:00.379006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:23:00.379006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:23:00.379006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:23:00.383373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:00.383373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:00.383373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:00.383373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:00.383373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:00.383373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:00.383373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:00.383373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:00.383373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:00.383373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:00.383373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:00.383373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:00.383373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:00.383373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:00.383373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:00.383373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:00.383373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:23:00.384562 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:23:00.384562 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:00.384562 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:23:00.384562 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 627/1265] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:00.385869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43eb50-4901-4f7a-9df6-0cc77a2c64b2 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:00.464559 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:00.483698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43eb50-4901-4f7a-9df6-0cc77a2c64b2 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:00.519721 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e83ca-26b2-4ed2-8483-eea417a72799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:00.520314 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e83ca-26b2-4ed2-8483-eea417a72799 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:00.520591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e83ca-26b2-4ed2-8483-eea417a72799 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:00.520859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e83ca-26b2-4ed2-8483-eea417a72799 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:00.521491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e83ca-26b2-4ed2-8483-eea417a72799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:00.521792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e83ca-26b2-4ed2-8483-eea417a72799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:00.523168 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e83ca-26b2-4ed2-8483-eea417a72799 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:00.534885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 639/1266] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:00.540569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c25d9-2ee4-410b-a921-72d2f1349f25 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:00.637148 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c25d9-2ee4-410b-a921-72d2f1349f25 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:00.655955 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:00.670230 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956461a-7262-4ebc-a3ac-19be98f9b71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:00.670864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956461a-7262-4ebc-a3ac-19be98f9b71c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:00.671143 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956461a-7262-4ebc-a3ac-19be98f9b71c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:00.671408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956461a-7262-4ebc-a3ac-19be98f9b71c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:00.679059 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956461a-7262-4ebc-a3ac-19be98f9b71c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:00.680464 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956461a-7262-4ebc-a3ac-19be98f9b71c None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:00.691215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-0956461a-7262-4ebc-a3ac-19be98f9b71c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:23:00.691215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:00.691215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:00.691215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:00.691215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:00.691215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:00.691215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:00.691215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:00.691215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:00.691215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:00.691215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:00.691215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:00.691215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:23:00.691215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:23:00.691215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:23:00.691215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:00.696901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:00.698129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:00.698129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:00.698129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:23:00.698129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:23:00.698129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:23:00.698129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:23:00.698129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:23:00.698129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:23:00.698129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:23:00.698129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:23:00.698129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 628/1267] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:00.698877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e83ca-26b2-4ed2-8483-eea417a72799 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:00.798414 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e83ca-26b2-4ed2-8483-eea417a72799 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:00.830391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c44d9-3712-4154-94bc-db2842c8347b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:00.831003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c44d9-3712-4154-94bc-db2842c8347b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:00.831280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c44d9-3712-4154-94bc-db2842c8347b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:00.831551 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c44d9-3712-4154-94bc-db2842c8347b None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:00.832262 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c44d9-3712-4154-94bc-db2842c8347b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:00.832563 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c44d9-3712-4154-94bc-db2842c8347b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:00.833966 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c44d9-3712-4154-94bc-db2842c8347b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:00.842423 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:00.851725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 640/1268] 10.222.0.71 () {56 vars in 1143 bytes} [Thu Sep 1 16:23:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:00.857510 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956461a-7262-4ebc-a3ac-19be98f9b71c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:00.959067 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956461a-7262-4ebc-a3ac-19be98f9b71c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:00.995780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de832a1b-209e-461b-a181-15452916e0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:00.996402 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de832a1b-209e-461b-a181-15452916e0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:00.996683 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de832a1b-209e-461b-a181-15452916e0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:00.996956 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de832a1b-209e-461b-a181-15452916e0e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:01.008064 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de832a1b-209e-461b-a181-15452916e0e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:01.009505 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de832a1b-209e-461b-a181-15452916e0e9 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:01.023751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-de832a1b-209e-461b-a181-15452916e0e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:01.023751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:01.023751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:01.023751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:01.023751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:01.023751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:01.023751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:01.023751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:01.023751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:01.023751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:01.023751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:01.023751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:01.023751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:23:01.023751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:23:01.023751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:23:01.023751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:23:01.024842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:01.024842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:01.024842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:01.024842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:01.024842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:01.024842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:01.024842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:01.024842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:01.024842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:01.024842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:01.024842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:01.024842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:01.024842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:01.024842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:01.024842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:01.024842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:01.024842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:23:01.025878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:23:01.025878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:01.025878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:23:01.025878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 629/1269] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:01.030751 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c44d9-3712-4154-94bc-db2842c8347b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:01.125768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c44d9-3712-4154-94bc-db2842c8347b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:01.159016 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b416a-ac2a-4980-93be-ea6c4a8001ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:01.159601 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b416a-ac2a-4980-93be-ea6c4a8001ec None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:01.159877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b416a-ac2a-4980-93be-ea6c4a8001ec None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:01.160147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b416a-ac2a-4980-93be-ea6c4a8001ec None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:01.160778 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b416a-ac2a-4980-93be-ea6c4a8001ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:01.161085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b416a-ac2a-4980-93be-ea6c4a8001ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:01.162432 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b416a-ac2a-4980-93be-ea6c4a8001ec None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:01.173684 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 641/1270] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:01.179516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de832a1b-209e-461b-a181-15452916e0e9 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:01.210988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:01.280001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de832a1b-209e-461b-a181-15452916e0e9 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:01.314789 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d728f-4045-4442-b4c4-87c16f0cd4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:01.315420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d728f-4045-4442-b4c4-87c16f0cd4cd None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:01.315705 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d728f-4045-4442-b4c4-87c16f0cd4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:01.315978 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d728f-4045-4442-b4c4-87c16f0cd4cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:01.322857 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d728f-4045-4442-b4c4-87c16f0cd4cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:01.324435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d728f-4045-4442-b4c4-87c16f0cd4cd None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:01.336300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-380d728f-4045-4442-b4c4-87c16f0cd4cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:23:01.336300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:01.336300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:01.336300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:01.336300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:01.336300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:01.336300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:01.336300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:01.336300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:01.336300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:01.336300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:01.336300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:01.336300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:23:01.336300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:23:01.336300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:23:01.337374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:23:01.337374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:01.337374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:01.337374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:01.337374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:01.337374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:01.337374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:01.337374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:01.337374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:01.337374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:01.337374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:01.337374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:01.337374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:01.337374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:01.337374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:01.337374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:01.337374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:01.338520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:23:01.338520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:23:01.338520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:23:01.338520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:23:01.338520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:23:01.338520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:23:01.338520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:23:01.338520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:23:01.338520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 630/1271] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:23:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:01.343849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b416a-ac2a-4980-93be-ea6c4a8001ec None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:01.402153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:01.442489 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b416a-ac2a-4980-93be-ea6c4a8001ec None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:01.476662 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679ea4b-72f4-4647-b092-a206b2d9ee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:01.477258 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679ea4b-72f4-4647-b092-a206b2d9ee54 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:01.477536 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679ea4b-72f4-4647-b092-a206b2d9ee54 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:01.477843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679ea4b-72f4-4647-b092-a206b2d9ee54 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:01.478562 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679ea4b-72f4-4647-b092-a206b2d9ee54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:01.478897 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679ea4b-72f4-4647-b092-a206b2d9ee54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:01.480400 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679ea4b-72f4-4647-b092-a206b2d9ee54 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:01.493153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 642/1272] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:23:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:01.499370 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d728f-4045-4442-b4c4-87c16f0cd4cd None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:01.594982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:01.603893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d728f-4045-4442-b4c4-87c16f0cd4cd None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:01.637553 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2dcbb-e9bb-4c38-b2da-6325b2d91038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:01.638202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2dcbb-e9bb-4c38-b2da-6325b2d91038 None admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:01.638481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2dcbb-e9bb-4c38-b2da-6325b2d91038 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:01.638799 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2dcbb-e9bb-4c38-b2da-6325b2d91038 None admin] PATH_INFO: `/v3/projects/9527063094354a99a80822107d2740fb/users/dae8db0856ed44088f0bd3cb93701de0/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:01.640681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2dcbb-e9bb-4c38-b2da-6325b2d91038 None admin] RBAC: Authorizing `identity:create_grant(project_id=9527063094354a99a80822107d2740fb, user_id=dae8db0856ed44088f0bd3cb93701de0, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:01.642128 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2dcbb-e9bb-4c38-b2da-6325b2d91038 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:01.654294 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 631/1273] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Sep 1 16:23:01 2022] PUT /identity/v3/projects/9527063094354a99a80822107d2740fb/users/dae8db0856ed44088f0bd3cb93701de0/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:23:03.502715 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a2058-8d89-4c48-bf12-a6e670cb18d3 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:03.503270 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a2058-8d89-4c48-bf12-a6e670cb18d3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:03.503270 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a2058-8d89-4c48-bf12-a6e670cb18d3 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:03.504587 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 643/1274] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:23:03.509507 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06678992-0cb8-48b0-9cd6-6992b977979b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:03.509899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06678992-0cb8-48b0-9cd6-6992b977979b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:03.510052 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06678992-0cb8-48b0-9cd6-6992b977979b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:03.528163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-06678992-0cb8-48b0-9cd6-6992b977979b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:23:03.529331 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-06678992-0cb8-48b0-9cd6-6992b977979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:23:03.592385 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 632/1275] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:23:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:23:03.854893 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a2058-8d89-4c48-bf12-a6e670cb18d3 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:03.952582 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a2058-8d89-4c48-bf12-a6e670cb18d3 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:03.971568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:03.991099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca37ce-5ff2-42ec-b765-af5c3082668e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:03.991717 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca37ce-5ff2-42ec-b765-af5c3082668e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:03.991991 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca37ce-5ff2-42ec-b765-af5c3082668e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:03.992253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca37ce-5ff2-42ec-b765-af5c3082668e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:04.006440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca37ce-5ff2-42ec-b765-af5c3082668e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:23:04.013740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-bcca37ce-5ff2-42ec-b765-af5c3082668e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:23:04.013740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:04.013740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:04.013740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:04.013740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:04.013740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:04.013740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:04.013740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:04.013740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:04.013740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:04.013740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:04.013740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:04.013740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:23:04.013740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:23:04.013740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:23:04.013740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:23:04.014904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:23:04.014904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:23:04.014904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:23:04.014904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:23:04.014904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:04.014904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:04.014904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:04.014904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:04.014904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:04.014904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:04.014904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:04.014904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:04.014904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:04.014904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:04.014904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:04.014904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:04.015782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:04.015782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:04.015782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:04.015782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:04.015782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:23:04.015782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:23:04.015782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:23:04.015782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:23:04.015782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:23:04.015782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:23:04.015782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:23:04.015782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:23:04.015782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 644/1276] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Sep 1 16:23:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:04.022854 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06678992-0cb8-48b0-9cd6-6992b977979b None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:04.103272 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:04.122488 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06678992-0cb8-48b0-9cd6-6992b977979b None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:04.155142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7a441-3a1f-4f0a-8d9c-5be518eaec5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:04.155735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7a441-3a1f-4f0a-8d9c-5be518eaec5d None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:04.156017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7a441-3a1f-4f0a-8d9c-5be518eaec5d None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:04.156290 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7a441-3a1f-4f0a-8d9c-5be518eaec5d None admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:04.156990 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7a441-3a1f-4f0a-8d9c-5be518eaec5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:04.157293 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7a441-3a1f-4f0a-8d9c-5be518eaec5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:04.158662 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7a441-3a1f-4f0a-8d9c-5be518eaec5d None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:04.166382 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 633/1277] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Sep 1 16:23:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:04.172724 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca37ce-5ff2-42ec-b765-af5c3082668e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:04.269465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca37ce-5ff2-42ec-b765-af5c3082668e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:04.302245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222615d2-b60c-44e7-94a5-4f85567e3cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:04.302882 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222615d2-b60c-44e7-94a5-4f85567e3cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:04.303159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222615d2-b60c-44e7-94a5-4f85567e3cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:04.303427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222615d2-b60c-44e7-94a5-4f85567e3cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:04.313628 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222615d2-b60c-44e7-94a5-4f85567e3cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:04.315070 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222615d2-b60c-44e7-94a5-4f85567e3cb3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:04.329134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-222615d2-b60c-44e7-94a5-4f85567e3cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:04.329134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:04.329134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:04.329134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:04.329134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:04.329134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:04.329134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:04.329134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:04.329134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:04.329134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:04.329134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:04.329134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:04.329134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:23:04.329134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:23:04.329134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:23:04.329134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:23:04.330276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:04.330276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:04.330276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:04.330276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:04.330276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:04.330276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:04.330276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:04.330276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:04.330276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:04.330276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:04.330276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:04.330276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:04.330276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:04.330276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:04.330276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:04.330276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:04.330276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:23:04.331439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:23:04.331439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:04.331439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:23:04.331439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 645/1278] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:04.336209 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7a441-3a1f-4f0a-8d9c-5be518eaec5d None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:04.430689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7a441-3a1f-4f0a-8d9c-5be518eaec5d None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:04.462258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bc655-2ca7-4523-b3f5-8ec595d44554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:04.462863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bc655-2ca7-4523-b3f5-8ec595d44554 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:04.463141 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bc655-2ca7-4523-b3f5-8ec595d44554 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:04.463409 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bc655-2ca7-4523-b3f5-8ec595d44554 None admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:04.464290 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bc655-2ca7-4523-b3f5-8ec595d44554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:04.464586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bc655-2ca7-4523-b3f5-8ec595d44554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:04.465931 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bc655-2ca7-4523-b3f5-8ec595d44554 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:04.478045 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 634/1279] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:04.483587 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222615d2-b60c-44e7-94a5-4f85567e3cb3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:04.513356 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:04.588589 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222615d2-b60c-44e7-94a5-4f85567e3cb3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:04.621985 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b444af-36ac-4cdf-bcad-4a765cf1c3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:04.622605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b444af-36ac-4cdf-bcad-4a765cf1c3dc None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:04.622905 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b444af-36ac-4cdf-bcad-4a765cf1c3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:04.623661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b444af-36ac-4cdf-bcad-4a765cf1c3dc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:04.631039 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b444af-36ac-4cdf-bcad-4a765cf1c3dc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:04.632449 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b444af-36ac-4cdf-bcad-4a765cf1c3dc None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:04.643623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-c8b444af-36ac-4cdf-bcad-4a765cf1c3dc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:23:04.643623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:04.643623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:04.643623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:04.643623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:04.643623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:04.643623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:04.643623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:04.643623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:04.643623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:04.643623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:04.643623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:04.643623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:23:04.643623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:23:04.643623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:23:04.643623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:04.649248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:04.650309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:04.650309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:04.650309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:23:04.650309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:23:04.650309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:23:04.650309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:23:04.650309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:23:04.650309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:23:04.650309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:23:04.650309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:23:04.650309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 646/1280] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:04.651037 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bc655-2ca7-4523-b3f5-8ec595d44554 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:04.654211 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:04.746075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bc655-2ca7-4523-b3f5-8ec595d44554 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:04.778045 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea792d8-0206-474e-bfd9-0d82853a854b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:04.778647 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea792d8-0206-474e-bfd9-0d82853a854b None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:04.778926 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea792d8-0206-474e-bfd9-0d82853a854b None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:04.779192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea792d8-0206-474e-bfd9-0d82853a854b None admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:04.779904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea792d8-0206-474e-bfd9-0d82853a854b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:04.780200 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea792d8-0206-474e-bfd9-0d82853a854b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:04.781685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea792d8-0206-474e-bfd9-0d82853a854b None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:04.798189 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 635/1281] 10.222.0.71 () {56 vars in 1143 bytes} [Thu Sep 1 16:23:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:23:04.803840 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b444af-36ac-4cdf-bcad-4a765cf1c3dc None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:04.892482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:04.902161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b444af-36ac-4cdf-bcad-4a765cf1c3dc None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:04.941476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0634d4f-58cf-474a-92f7-00ea859419cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:04.942063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0634d4f-58cf-474a-92f7-00ea859419cb None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:04.942337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0634d4f-58cf-474a-92f7-00ea859419cb None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:04.942601 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0634d4f-58cf-474a-92f7-00ea859419cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:05.006663 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0634d4f-58cf-474a-92f7-00ea859419cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:05.008017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0634d4f-58cf-474a-92f7-00ea859419cb None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:05.091303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:05.102043 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 647/1282] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Sep 1 16:23:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:23:05.108053 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea792d8-0206-474e-bfd9-0d82853a854b None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:05.167073 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:05.204757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea792d8-0206-474e-bfd9-0d82853a854b None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:05.236786 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb62ce5-efcc-4d19-a888-bdb885181d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:05.237398 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb62ce5-efcc-4d19-a888-bdb885181d1c None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:05.237668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb62ce5-efcc-4d19-a888-bdb885181d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:05.237934 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb62ce5-efcc-4d19-a888-bdb885181d1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:05.247715 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb62ce5-efcc-4d19-a888-bdb885181d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:05.249127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb62ce5-efcc-4d19-a888-bdb885181d1c None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:05.263920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-bdb62ce5-efcc-4d19-a888-bdb885181d1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:05.263920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:05.263920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:05.263920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:05.263920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:05.263920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:05.263920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:05.263920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:05.263920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:05.263920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:05.263920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:05.263920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:05.263920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:23:05.263920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:23:05.263920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:23:05.263920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:23:05.265111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:05.265111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:05.265111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:05.265111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:05.265111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:05.265111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:05.265111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:05.265111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:05.265111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:05.265111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:05.265111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:05.265111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:05.265111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:05.265111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:05.265111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:05.265111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:05.265111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:23:05.266593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:23:05.266593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:05.266593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:23:05.266593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 636/1283] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:05.271983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0634d4f-58cf-474a-92f7-00ea859419cb None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:05.373910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0634d4f-58cf-474a-92f7-00ea859419cb None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:05.407046 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86c870-8edd-4549-a135-c72413459f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:05.407637 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86c870-8edd-4549-a135-c72413459f8c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:05.407915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86c870-8edd-4549-a135-c72413459f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:05.408184 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86c870-8edd-4549-a135-c72413459f8c None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:05.408816 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86c870-8edd-4549-a135-c72413459f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:05.409118 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86c870-8edd-4549-a135-c72413459f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:05.410458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86c870-8edd-4549-a135-c72413459f8c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:05.421204 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 648/1284] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Sep 1 16:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:05.426822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb62ce5-efcc-4d19-a888-bdb885181d1c None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:05.524075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb62ce5-efcc-4d19-a888-bdb885181d1c None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:05.536872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:05.556991 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f86cc5-6879-41f2-acc1-1a4ec6296f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:05.557597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f86cc5-6879-41f2-acc1-1a4ec6296f4a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:05.557876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f86cc5-6879-41f2-acc1-1a4ec6296f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:05.558143 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f86cc5-6879-41f2-acc1-1a4ec6296f4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:05.565099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f86cc5-6879-41f2-acc1-1a4ec6296f4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:05.566522 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f86cc5-6879-41f2-acc1-1a4ec6296f4a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:05.577560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application [None req-c9f86cc5-6879-41f2-acc1-1a4ec6296f4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:23:05.577560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:05.577560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:05.577560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:05.577560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:05.577560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:05.577560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:05.577560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:05.577560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:05.577560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:05.577560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:05.577560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:05.577560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:23:05.577560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:23:05.577560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:23:05.578843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:23:05.578843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:05.578843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:05.578843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:05.578843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:05.578843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:05.578843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:05.578843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:05.578843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:05.578843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:05.578843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:05.578843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:05.578843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:05.578843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:05.578843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:05.578843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:05.578843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:05.579909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:23:05.579909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:23:05.579909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:23:05.579909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:23:05.579909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:23:05.579909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:23:05.579909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:23:05.579909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: ERROR keystone.server.flask.application Sep 01 16:23:05.579909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 637/1285] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Sep 1 16:23:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:05.584369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86c870-8edd-4549-a135-c72413459f8c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:05.634216 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:05.683439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86c870-8edd-4549-a135-c72413459f8c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:05.715983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e75377-d330-4c8c-9229-b3bc03d25b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:05.716576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e75377-d330-4c8c-9229-b3bc03d25b08 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:05.716855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e75377-d330-4c8c-9229-b3bc03d25b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:05.717127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e75377-d330-4c8c-9229-b3bc03d25b08 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:05.717808 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e75377-d330-4c8c-9229-b3bc03d25b08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:05.718111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e75377-d330-4c8c-9229-b3bc03d25b08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:05.720109 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e75377-d330-4c8c-9229-b3bc03d25b08 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:05.731538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 649/1286] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Sep 1 16:23:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:05.737601 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f86cc5-6879-41f2-acc1-1a4ec6296f4a None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:05.832766 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f86cc5-6879-41f2-acc1-1a4ec6296f4a None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:05.864825 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b81807-c5c6-4a08-b457-8a7e5ac8e5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:05.865396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b81807-c5c6-4a08-b457-8a7e5ac8e5ca None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:05.865669 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b81807-c5c6-4a08-b457-8a7e5ac8e5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:05.865932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b81807-c5c6-4a08-b457-8a7e5ac8e5ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:05.866658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b81807-c5c6-4a08-b457-8a7e5ac8e5ca None admin] RBAC: Adding query filter params (role.id=3cd61239237441418529e9028ef801e4, scope.project.id=9527063094354a99a80822107d2740fb, user.id=dae8db0856ed44088f0bd3cb93701de0) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:05.866963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b81807-c5c6-4a08-b457-8a7e5ac8e5ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:05.868367 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b81807-c5c6-4a08-b457-8a7e5ac8e5ca None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:05.873820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 638/1287] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Sep 1 16:23:05 2022] GET /identity/v3/role_assignments?user.id=dae8db0856ed44088f0bd3cb93701de0&scope.project.id=9527063094354a99a80822107d2740fb&role.id=3cd61239237441418529e9028ef801e4 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:07.789344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686e384-d9c8-4a4a-8961-3e919c628546 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:07.789968 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686e384-d9c8-4a4a-8961-3e919c628546 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:07.789968 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686e384-d9c8-4a4a-8961-3e919c628546 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:07.791261 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 650/1288] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:23:07.796435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f6018-fac0-4579-a3e7-e5a4c149c724 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:07.797671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f6018-fac0-4579-a3e7-e5a4c149c724 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:07.797671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f6018-fac0-4579-a3e7-e5a4c149c724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:07.816324 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-c58f6018-fac0-4579-a3e7-e5a4c149c724 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:23:07.817490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c58f6018-fac0-4579-a3e7-e5a4c149c724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:23:07.846532 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:07.883230 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 639/1289] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:23:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:23:08.152034 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686e384-d9c8-4a4a-8961-3e919c628546 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:08.251276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686e384-d9c8-4a4a-8961-3e919c628546 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:08.261484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:08.284928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac6108-75ec-46bd-9efa-ad8e5aa7c2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:08.285547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac6108-75ec-46bd-9efa-ad8e5aa7c2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:08.285824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac6108-75ec-46bd-9efa-ad8e5aa7c2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:08.286097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac6108-75ec-46bd-9efa-ad8e5aa7c2b0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:08.286704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac6108-75ec-46bd-9efa-ad8e5aa7c2b0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:08.288052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac6108-75ec-46bd-9efa-ad8e5aa7c2b0 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:08.296859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-d0ac6108-75ec-46bd-9efa-ad8e5aa7c2b0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:23:08.296859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:08.296859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:23:08.296859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:23:08.296859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:23:08.296859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:23:08.296859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:23:08.296859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:23:08.296859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:23:08.296859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:23:08.296859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:23:08.296859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:23:08.296859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:08.296859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:08.296859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:08.296859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:08.296859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:08.298058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:08.298058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:08.298058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:08.298058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:08.298058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:08.298058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:08.298058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:23:08.298058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:23:08.298058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:23:08.298058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:23:08.298058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:08.298058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:08.298058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:08.298058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:08.298058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:08.298058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:08.299137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:08.299137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:08.299137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:08.299137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:08.299137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:08.299137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:08.299137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:08.299137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:08.299137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:08.299137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:08.299137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:23:08.299137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:23:08.299137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:23:08.299137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:23:08.299137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 651/1290] 10.222.0.71 () {56 vars in 1117 bytes} [Thu Sep 1 16:23:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:08.304044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f6018-fac0-4579-a3e7-e5a4c149c724 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:08.398589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f6018-fac0-4579-a3e7-e5a4c149c724 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:08.430668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73f082-a1ed-4b7c-93b6-c6407403b948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:08.431198 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73f082-a1ed-4b7c-93b6-c6407403b948 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:08.431472 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73f082-a1ed-4b7c-93b6-c6407403b948 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:08.431738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73f082-a1ed-4b7c-93b6-c6407403b948 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:08.432361 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73f082-a1ed-4b7c-93b6-c6407403b948 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:08.432658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73f082-a1ed-4b7c-93b6-c6407403b948 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:08.433997 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73f082-a1ed-4b7c-93b6-c6407403b948 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:08.439118 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 640/1291] 10.222.0.71 () {56 vars in 1116 bytes} [Thu Sep 1 16:23:08 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:08.444868 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac6108-75ec-46bd-9efa-ad8e5aa7c2b0 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:08.541249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac6108-75ec-46bd-9efa-ad8e5aa7c2b0 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:08.573259 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9080d2-d746-4d03-9893-08f83a9bf4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:08.573842 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9080d2-d746-4d03-9893-08f83a9bf4ba None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:08.574120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9080d2-d746-4d03-9893-08f83a9bf4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:08.574391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9080d2-d746-4d03-9893-08f83a9bf4ba None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:08.575039 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9080d2-d746-4d03-9893-08f83a9bf4ba None admin] RBAC: Adding query filter params (type=placement) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:08.575342 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9080d2-d746-4d03-9893-08f83a9bf4ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:08.576684 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9080d2-d746-4d03-9893-08f83a9bf4ba None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:08.581430 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 652/1292] 10.222.0.71 () {56 vars in 1116 bytes} [Thu Sep 1 16:23:08 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:10.490914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769f80f-a7ba-4ebe-9ac7-fdb0e2540cb3 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:10.491497 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769f80f-a7ba-4ebe-9ac7-fdb0e2540cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:10.491497 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769f80f-a7ba-4ebe-9ac7-fdb0e2540cb3 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:10.492803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 641/1293] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:23:10.497936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95abce1-dff4-44e6-bcc7-75f521c2acc8 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:10.498331 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95abce1-dff4-44e6-bcc7-75f521c2acc8 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:10.498479 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95abce1-dff4-44e6-bcc7-75f521c2acc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:10.516163 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f95abce1-dff4-44e6-bcc7-75f521c2acc8 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:23:10.517332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f95abce1-dff4-44e6-bcc7-75f521c2acc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:23:10.546196 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:10.582995 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 653/1294] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:23:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:23:10.852209 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769f80f-a7ba-4ebe-9ac7-fdb0e2540cb3 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:10.883958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:10.951926 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769f80f-a7ba-4ebe-9ac7-fdb0e2540cb3 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:10.989686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e7e42-8510-49b6-a797-d781ab4bd195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:10.990541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7e42-8510-49b6-a797-d781ab4bd195 None admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:10.990952 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7e42-8510-49b6-a797-d781ab4bd195 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:10.991386 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7e42-8510-49b6-a797-d781ab4bd195 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:10.992400 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e7e42-8510-49b6-a797-d781ab4bd195 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:10.994416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e7e42-8510-49b6-a797-d781ab4bd195 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:11.014599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 642/1295] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Sep 1 16:23:10 2022] POST /identity/v3/services => generated 246 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:23:12.894173 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a02c9-8192-4ac7-b26b-b7ccb003c8a4 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:12.894924 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a02c9-8192-4ac7-b26b-b7ccb003c8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:12.894924 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a02c9-8192-4ac7-b26b-b7ccb003c8a4 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:12.896058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 654/1296] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:23:12.901207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463bbb7-a970-46e6-be59-1bef5eb0095a None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:12.901600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463bbb7-a970-46e6-be59-1bef5eb0095a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:12.901758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463bbb7-a970-46e6-be59-1bef5eb0095a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:12.919890 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-6463bbb7-a970-46e6-be59-1bef5eb0095a None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:23:12.921078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6463bbb7-a970-46e6-be59-1bef5eb0095a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:23:12.994597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 643/1297] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:23:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:23:13.259471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a02c9-8192-4ac7-b26b-b7ccb003c8a4 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:13.357466 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a02c9-8192-4ac7-b26b-b7ccb003c8a4 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:13.391177 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b984b16-9858-4347-bd18-150667a8e400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:13.391792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b984b16-9858-4347-bd18-150667a8e400 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:13.392062 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b984b16-9858-4347-bd18-150667a8e400 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:13.392322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b984b16-9858-4347-bd18-150667a8e400 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:13.392887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b984b16-9858-4347-bd18-150667a8e400 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:13.394234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b984b16-9858-4347-bd18-150667a8e400 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:13.402800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-2b984b16-9858-4347-bd18-150667a8e400 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:23:13.402800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:13.402800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:23:13.402800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:23:13.402800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:23:13.402800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:23:13.402800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:23:13.402800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:23:13.402800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:23:13.402800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:23:13.402800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:23:13.402800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:23:13.402800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:13.402800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:13.402800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:13.402800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:13.402800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:13.404110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:13.404110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:13.404110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:13.404110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:13.404110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:13.404110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:13.404110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:23:13.404110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:23:13.404110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:23:13.404110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:23:13.404110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:13.404110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:13.404110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:13.404110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:13.404110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:13.404110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:13.405267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:13.405267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:13.405267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:13.405267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:13.405267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:13.405267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:13.405267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:13.405267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:13.405267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:13.405267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:13.405267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:23:13.405267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:23:13.405267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:23:13.405267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:23:13.405267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 655/1298] 10.222.0.71 () {56 vars in 1117 bytes} [Thu Sep 1 16:23:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:13.410475 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463bbb7-a970-46e6-be59-1bef5eb0095a None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:13.428645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:13.506453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463bbb7-a970-46e6-be59-1bef5eb0095a None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:13.538855 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffd83d-cf8c-4c49-8790-26ceaee00681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:13.539443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd83d-cf8c-4c49-8790-26ceaee00681 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:13.539722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd83d-cf8c-4c49-8790-26ceaee00681 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:13.539995 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd83d-cf8c-4c49-8790-26ceaee00681 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:13.540619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffd83d-cf8c-4c49-8790-26ceaee00681 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:13.540920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffd83d-cf8c-4c49-8790-26ceaee00681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:13.542269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffd83d-cf8c-4c49-8790-26ceaee00681 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:13.547747 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 644/1299] 10.222.0.71 () {56 vars in 1116 bytes} [Thu Sep 1 16:23:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:13.553611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b984b16-9858-4347-bd18-150667a8e400 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:13.583575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:13.650743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b984b16-9858-4347-bd18-150667a8e400 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:13.681795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b13974-145f-4112-aacb-a7e48673f31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:13.682377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b13974-145f-4112-aacb-a7e48673f31e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:13.682671 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b13974-145f-4112-aacb-a7e48673f31e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:13.682938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b13974-145f-4112-aacb-a7e48673f31e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:13.683619 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b13974-145f-4112-aacb-a7e48673f31e None admin] RBAC: Adding query filter params (interface=public, service_id=57a5081038004a659afa29c988854947, region_id=RegionOne) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:13.683919 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b13974-145f-4112-aacb-a7e48673f31e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:13.685250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b13974-145f-4112-aacb-a7e48673f31e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:13.690473 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 656/1300] 10.222.0.71 () {56 vars in 1251 bytes} [Thu Sep 1 16:23:13 2022] GET /identity/v3/endpoints?service_id=57a5081038004a659afa29c988854947&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:13.696181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffd83d-cf8c-4c49-8790-26ceaee00681 None admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:13.779721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:13.798112 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffd83d-cf8c-4c49-8790-26ceaee00681 None admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:13.830505 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98237696-92e7-4e40-ad95-f4578bba394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:13.831129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98237696-92e7-4e40-ad95-f4578bba394a None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:13.831411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98237696-92e7-4e40-ad95-f4578bba394a None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:13.831687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98237696-92e7-4e40-ad95-f4578bba394a None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:13.832289 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98237696-92e7-4e40-ad95-f4578bba394a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:13.833643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98237696-92e7-4e40-ad95-f4578bba394a None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:13.840497 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 645/1301] 10.222.0.71 () {56 vars in 1087 bytes} [Thu Sep 1 16:23:13 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:23:15.717585 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54045a8-56c1-491d-b7f1-ca947a5e6b38 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:15.718089 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54045a8-56c1-491d-b7f1-ca947a5e6b38 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:15.718190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54045a8-56c1-491d-b7f1-ca947a5e6b38 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:15.719985 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 657/1302] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:23:15.725070 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd664a0-8353-42d1-89f9-1893c4bb1796 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:15.725485 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd664a0-8353-42d1-89f9-1893c4bb1796 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:15.725609 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd664a0-8353-42d1-89f9-1893c4bb1796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:15.744509 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-4cd664a0-8353-42d1-89f9-1893c4bb1796 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:23:15.745676 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4cd664a0-8353-42d1-89f9-1893c4bb1796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:23:15.808194 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 646/1303] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:23:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:23:16.089729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54045a8-56c1-491d-b7f1-ca947a5e6b38 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:16.182332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:16.192259 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54045a8-56c1-491d-b7f1-ca947a5e6b38 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:16.230194 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0865730-e764-4508-ab54-c39e1db73f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:16.230832 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0865730-e764-4508-ab54-c39e1db73f36 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:16.231107 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0865730-e764-4508-ab54-c39e1db73f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:16.231369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0865730-e764-4508-ab54-c39e1db73f36 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:16.231938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0865730-e764-4508-ab54-c39e1db73f36 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:16.233288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0865730-e764-4508-ab54-c39e1db73f36 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:16.241794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-e0865730-e764-4508-ab54-c39e1db73f36 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:23:16.241794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:16.241794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:23:16.241794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:23:16.241794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:23:16.241794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:23:16.241794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:23:16.241794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:23:16.241794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:23:16.241794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:23:16.241794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:23:16.241794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:23:16.241794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:16.241794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:16.241794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:16.241794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:16.241794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:16.242962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:16.242962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:16.242962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:16.242962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:16.242962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:16.242962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:16.242962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:23:16.242962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:23:16.242962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:23:16.242962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:23:16.242962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:16.242962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:16.242962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:16.242962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:16.242962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:16.242962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:16.243846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:16.243846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:16.243846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:16.243846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:16.243846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:16.243846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:16.243846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:16.243846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:16.243846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:16.243846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:16.243846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:23:16.243846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:23:16.243846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:23:16.243846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 16:23:16.243846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 658/1304] 10.222.0.71 () {56 vars in 1117 bytes} [Thu Sep 1 16:23:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:23:16.248833 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd664a0-8353-42d1-89f9-1893c4bb1796 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:16.322496 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:16.346238 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd664a0-8353-42d1-89f9-1893c4bb1796 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:16.378976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfa1e1-9757-4dfe-9108-e655408f8d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:16.379569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfa1e1-9757-4dfe-9108-e655408f8d80 None admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:16.379849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfa1e1-9757-4dfe-9108-e655408f8d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:16.380120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfa1e1-9757-4dfe-9108-e655408f8d80 None admin] PATH_INFO: `/v3/services` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:16.380740 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfa1e1-9757-4dfe-9108-e655408f8d80 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:16.381057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfa1e1-9757-4dfe-9108-e655408f8d80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:16.382437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfa1e1-9757-4dfe-9108-e655408f8d80 None admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:16.387476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 647/1305] 10.222.0.71 () {56 vars in 1116 bytes} [Thu Sep 1 16:23:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:16.393093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0865730-e764-4508-ab54-c39e1db73f36 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:16.491293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0865730-e764-4508-ab54-c39e1db73f36 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:16.524020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941952b-7270-4c61-89c7-1cb8a8aa78a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:16.524606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941952b-7270-4c61-89c7-1cb8a8aa78a8 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:16.524882 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941952b-7270-4c61-89c7-1cb8a8aa78a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:16.525151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941952b-7270-4c61-89c7-1cb8a8aa78a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:16.525804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941952b-7270-4c61-89c7-1cb8a8aa78a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:16.527185 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941952b-7270-4c61-89c7-1cb8a8aa78a8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:16.546218 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 659/1306] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:23:16 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:23:26.384485 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=30 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:26.542041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:20.001428 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bd575-606e-4837-9d69-de2216955b04 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:20.001976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bd575-606e-4837-9d69-de2216955b04 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:20.001976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bd575-606e-4837-9d69-de2216955b04 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:20.006916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 648/1307] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:24:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:24:20.008299 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020b60f-e4e8-4c15-8dac-9f36880e1fd3 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:20.008733 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020b60f-e4e8-4c15-8dac-9f36880e1fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:20.008829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020b60f-e4e8-4c15-8dac-9f36880e1fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:20.141722 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b020b60f-e4e8-4c15-8dac-9f36880e1fd3 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:20.142976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b020b60f-e4e8-4c15-8dac-9f36880e1fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:20.265543 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 660/1308] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:24:20.557678 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c6e69-7c7e-4e3c-aed3-334e0b062f12 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:20.558589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c6e69-7c7e-4e3c-aed3-334e0b062f12 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:20.558836 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c6e69-7c7e-4e3c-aed3-334e0b062f12 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:20.560315 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 649/1309] 10.222.0.71 () {54 vars in 965 bytes} [Thu Sep 1 16:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:24:20.566084 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f382a3-693e-4c84-8458-f006a5f8671d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:20.566445 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f382a3-693e-4c84-8458-f006a5f8671d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:20.566848 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f382a3-693e-4c84-8458-f006a5f8671d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:20.649858 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-15f382a3-693e-4c84-8458-f006a5f8671d None None] MFA Rules not processed for user `d494fd310b1f40839f113d045f0bdcb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:20.651201 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-15f382a3-693e-4c84-8458-f006a5f8671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:20.673304 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:20.732476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 661/1310] 10.222.0.71 () {58 vars in 1062 bytes} [Thu Sep 1 16:24:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:24:20.741441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c6e69-7c7e-4e3c-aed3-334e0b062f12 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:20.743220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b04c6e69-7c7e-4e3c-aed3-334e0b062f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:20.865439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c6e69-7c7e-4e3c-aed3-334e0b062f12 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:20.949645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e85d3-75fa-456e-bfd0-0a7a1f034793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:20.950281 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e85d3-75fa-456e-bfd0-0a7a1f034793 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:20.951125 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e85d3-75fa-456e-bfd0-0a7a1f034793 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:20.951402 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e85d3-75fa-456e-bfd0-0a7a1f034793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:20.953292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ad3e85d3-75fa-456e-bfd0-0a7a1f034793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:21.019357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:21.084882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e85d3-75fa-456e-bfd0-0a7a1f034793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:21.086651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e85d3-75fa-456e-bfd0-0a7a1f034793 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:21.108237 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 650/1311] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:24:23.318270 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8133d7-4cdd-49cb-9659-7b6d8f49ac63 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:23.318845 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8133d7-4cdd-49cb-9659-7b6d8f49ac63 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:23.318845 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8133d7-4cdd-49cb-9659-7b6d8f49ac63 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:23.320242 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 662/1312] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:24:23.326348 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfa559-9b31-41cd-906e-8661a65cd609 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:23.326866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfa559-9b31-41cd-906e-8661a65cd609 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:23.326985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfa559-9b31-41cd-906e-8661a65cd609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:23.412769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-5adfa559-9b31-41cd-906e-8661a65cd609 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:23.413992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5adfa559-9b31-41cd-906e-8661a65cd609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:23.509674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 651/1313] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:24:23.806296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514136cb-4a75-4b03-a59a-654ae2863c03 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:23.806571 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514136cb-4a75-4b03-a59a-654ae2863c03 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:23.806860 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514136cb-4a75-4b03-a59a-654ae2863c03 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:23.808193 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 663/1314] 10.222.0.71 () {54 vars in 965 bytes} [Thu Sep 1 16:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:24:23.814108 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8caeeb-428b-4bd9-8756-dff99657d473 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:23.814388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8caeeb-428b-4bd9-8756-dff99657d473 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:23.814680 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8caeeb-428b-4bd9-8756-dff99657d473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:23.827306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:23.892489 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-2f8caeeb-428b-4bd9-8756-dff99657d473 None None] MFA Rules not processed for user `d494fd310b1f40839f113d045f0bdcb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:23.893617 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2f8caeeb-428b-4bd9-8756-dff99657d473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:23.967988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 652/1315] 10.222.0.71 () {58 vars in 1062 bytes} [Thu Sep 1 16:24:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:24:23.977067 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514136cb-4a75-4b03-a59a-654ae2863c03 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:23.978690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-514136cb-4a75-4b03-a59a-654ae2863c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:24.080419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514136cb-4a75-4b03-a59a-654ae2863c03 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:24.151089 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:24.153895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1769302-3483-4d75-8886-d8b5d3962e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:24.154667 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1769302-3483-4d75-8886-d8b5d3962e0c service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:24.155007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1769302-3483-4d75-8886-d8b5d3962e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:24.155440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1769302-3483-4d75-8886-d8b5d3962e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:24.157064 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b1769302-3483-4d75-8886-d8b5d3962e0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:24.261813 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1769302-3483-4d75-8886-d8b5d3962e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:24.263271 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1769302-3483-4d75-8886-d8b5d3962e0c service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:24.280657 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 664/1316] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:24:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:24:26.707714 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f9858-641e-423c-955e-fd187d05199c None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:26.708238 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f9858-641e-423c-955e-fd187d05199c None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:26.708414 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f9858-641e-423c-955e-fd187d05199c None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:26.709847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 653/1317] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:24:26.716016 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07099a88-3436-42ad-8c2a-235509b80ef2 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:26.716419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07099a88-3436-42ad-8c2a-235509b80ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:26.716571 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07099a88-3436-42ad-8c2a-235509b80ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:26.779874 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-07099a88-3436-42ad-8c2a-235509b80ef2 None None] MFA Rules not processed for user `f6ba851c651742d19299e159edabe065`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:26.781060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-07099a88-3436-42ad-8c2a-235509b80ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:26.830139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:26.874120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 665/1318] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:24:26 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:24:27.160019 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f9858-641e-423c-955e-fd187d05199c None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:27.161563 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-023f9858-641e-423c-955e-fd187d05199c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:27.264690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f9858-641e-423c-955e-fd187d05199c None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:27.267491 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:27.336922 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446891c5-ab8c-4d92-afef-db33b970e940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:27.337519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446891c5-ab8c-4d92-afef-db33b970e940 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:27.337794 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446891c5-ab8c-4d92-afef-db33b970e940 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:27.338064 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446891c5-ab8c-4d92-afef-db33b970e940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:27.339691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-446891c5-ab8c-4d92-afef-db33b970e940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:27.451700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446891c5-ab8c-4d92-afef-db33b970e940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:27.453047 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446891c5-ab8c-4d92-afef-db33b970e940 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:27.471136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 654/1319] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:24:27 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:24:29.925265 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8894b-e963-4812-a569-5dd121c72cac None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:29.925801 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8894b-e963-4812-a569-5dd121c72cac None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:29.925801 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8894b-e963-4812-a569-5dd121c72cac None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:29.927124 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 666/1320] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:24:29.932232 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc9adf-1e33-4bf8-9613-61b58bd4f5b2 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:29.933189 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc9adf-1e33-4bf8-9613-61b58bd4f5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:29.933287 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc9adf-1e33-4bf8-9613-61b58bd4f5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:29.974132 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:29.999612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-bcdc9adf-1e33-4bf8-9613-61b58bd4f5b2 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:30.000844 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-bcdc9adf-1e33-4bf8-9613-61b58bd4f5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:30.096451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 655/1321] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:24:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:24:30.376654 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8894b-e963-4812-a569-5dd121c72cac None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:30.378188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6df8894b-e963-4812-a569-5dd121c72cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:30.484920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8894b-e963-4812-a569-5dd121c72cac None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:30.555449 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57137da8-6657-4212-bcde-2db82de531da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:30.556045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57137da8-6657-4212-bcde-2db82de531da service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:30.556318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57137da8-6657-4212-bcde-2db82de531da service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:30.556584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57137da8-6657-4212-bcde-2db82de531da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:30.558952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-57137da8-6657-4212-bcde-2db82de531da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:30.566174 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:30.670444 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57137da8-6657-4212-bcde-2db82de531da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:30.671936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57137da8-6657-4212-bcde-2db82de531da service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:30.689293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 667/1322] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:24:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:24:33.217366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2652751-c3b3-4cd8-9e84-6193e09144f6 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:33.217891 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2652751-c3b3-4cd8-9e84-6193e09144f6 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:33.218009 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2652751-c3b3-4cd8-9e84-6193e09144f6 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:33.219345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 656/1323] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:24:33.224565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ab0ca-a163-4ec2-a7c6-0175a5fe5aef None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:33.224985 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ab0ca-a163-4ec2-a7c6-0175a5fe5aef None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:33.225111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ab0ca-a163-4ec2-a7c6-0175a5fe5aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:33.290572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-326ab0ca-a163-4ec2-a7c6-0175a5fe5aef None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:33.291795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-326ab0ca-a163-4ec2-a7c6-0175a5fe5aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:33.348344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:33.387709 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 668/1324] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:24:33.667005 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2652751-c3b3-4cd8-9e84-6193e09144f6 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:33.668670 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c2652751-c3b3-4cd8-9e84-6193e09144f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:33.776418 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2652751-c3b3-4cd8-9e84-6193e09144f6 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:33.788357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:33.850775 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22b280-251f-482a-8e87-e337830beda2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:33.851402 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22b280-251f-482a-8e87-e337830beda2 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:33.851679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22b280-251f-482a-8e87-e337830beda2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:33.851944 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22b280-251f-482a-8e87-e337830beda2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:33.853584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1d22b280-251f-482a-8e87-e337830beda2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:33.970055 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22b280-251f-482a-8e87-e337830beda2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:33.971415 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22b280-251f-482a-8e87-e337830beda2 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:33.991307 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 657/1325] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:24:35.958462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0df4f-ee7a-4572-be11-d657af03e61c None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:35.959010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0df4f-ee7a-4572-be11-d657af03e61c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:35.959010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0df4f-ee7a-4572-be11-d657af03e61c None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:35.960548 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 669/1326] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:24:35.966124 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2eeaac-0ed7-4482-bcf9-703a10332247 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:35.966549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2eeaac-0ed7-4482-bcf9-703a10332247 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:35.966676 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2eeaac-0ed7-4482-bcf9-703a10332247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:36.017066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:36.035154 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-bd2eeaac-0ed7-4482-bcf9-703a10332247 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:36.036359 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-bd2eeaac-0ed7-4482-bcf9-703a10332247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:36.131981 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 658/1327] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:24:36.410684 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0df4f-ee7a-4572-be11-d657af03e61c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:36.412192 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a4a0df4f-ee7a-4572-be11-d657af03e61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:36.514402 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0df4f-ee7a-4572-be11-d657af03e61c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:36.595928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387517b2-62cb-4565-9b87-5261b02f7238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:36.596535 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387517b2-62cb-4565-9b87-5261b02f7238 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:36.596811 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387517b2-62cb-4565-9b87-5261b02f7238 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:36.597085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387517b2-62cb-4565-9b87-5261b02f7238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:36.598719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-387517b2-62cb-4565-9b87-5261b02f7238 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:36.616697 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:36.708704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387517b2-62cb-4565-9b87-5261b02f7238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:36.710142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387517b2-62cb-4565-9b87-5261b02f7238 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:36.729786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 670/1328] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:24:38.669001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6c7f7-108e-4081-b1c8-bc5e51c34ed6 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:38.669526 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6c7f7-108e-4081-b1c8-bc5e51c34ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:38.669621 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6c7f7-108e-4081-b1c8-bc5e51c34ed6 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:38.671187 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 659/1329] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:24:38.676625 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48bf64-bf3f-41e1-ae52-5e1ded0ec8a7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:38.677064 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48bf64-bf3f-41e1-ae52-5e1ded0ec8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:38.677159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48bf64-bf3f-41e1-ae52-5e1ded0ec8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:38.747557 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ea48bf64-bf3f-41e1-ae52-5e1ded0ec8a7 None None] MFA Rules not processed for user `f6ba851c651742d19299e159edabe065`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:38.748785 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ea48bf64-bf3f-41e1-ae52-5e1ded0ec8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:38.817867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:38.849962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 671/1330] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:24:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:24:39.134718 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6c7f7-108e-4081-b1c8-bc5e51c34ed6 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:39.136299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-09f6c7f7-108e-4081-b1c8-bc5e51c34ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:39.263662 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6c7f7-108e-4081-b1c8-bc5e51c34ed6 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:39.284724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:39.337488 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f7cd8-819a-473b-8cfc-37967ec4d1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:39.338641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f7cd8-819a-473b-8cfc-37967ec4d1aa service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:39.338944 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f7cd8-819a-473b-8cfc-37967ec4d1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:39.339212 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f7cd8-819a-473b-8cfc-37967ec4d1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:39.340802 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6d2f7cd8-819a-473b-8cfc-37967ec4d1aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:39.450996 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f7cd8-819a-473b-8cfc-37967ec4d1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:39.452348 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f7cd8-819a-473b-8cfc-37967ec4d1aa service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:39.470552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 660/1331] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:24:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:24:41.833138 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a730b0-7886-4d19-b4dc-1d21a20f1272 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:41.833685 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a730b0-7886-4d19-b4dc-1d21a20f1272 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:41.833685 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a730b0-7886-4d19-b4dc-1d21a20f1272 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:41.835066 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 672/1332] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:24:41.841109 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102c8e7-eec0-4dbf-8883-2ff33fa1f776 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:41.841539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102c8e7-eec0-4dbf-8883-2ff33fa1f776 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:41.841665 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102c8e7-eec0-4dbf-8883-2ff33fa1f776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:41.904209 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:41.906857 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-a102c8e7-eec0-4dbf-8883-2ff33fa1f776 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:41.908751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a102c8e7-eec0-4dbf-8883-2ff33fa1f776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:42.008647 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 661/1333] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:24:42.290670 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a730b0-7886-4d19-b4dc-1d21a20f1272 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:42.295001 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a5a730b0-7886-4d19-b4dc-1d21a20f1272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:42.396299 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a730b0-7886-4d19-b4dc-1d21a20f1272 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:42.466816 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a16266-ba02-4ac8-bdda-c25b3f8be422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:42.467413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a16266-ba02-4ac8-bdda-c25b3f8be422 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:42.467680 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a16266-ba02-4ac8-bdda-c25b3f8be422 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:42.467945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a16266-ba02-4ac8-bdda-c25b3f8be422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:42.469523 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-44a16266-ba02-4ac8-bdda-c25b3f8be422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:42.496374 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:42.574503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a16266-ba02-4ac8-bdda-c25b3f8be422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:42.575878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a16266-ba02-4ac8-bdda-c25b3f8be422 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:42.593338 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 673/1334] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:24:44.532908 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45821519-1c0e-4e07-b7c5-bea3d907af62 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:44.533508 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45821519-1c0e-4e07-b7c5-bea3d907af62 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:44.533508 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45821519-1c0e-4e07-b7c5-bea3d907af62 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:44.534842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 662/1335] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:24:44.539928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aea9c-e7c6-4039-9053-ea6cbc34803e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:44.540349 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aea9c-e7c6-4039-9053-ea6cbc34803e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:44.540478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aea9c-e7c6-4039-9053-ea6cbc34803e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:44.605327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d77aea9c-e7c6-4039-9053-ea6cbc34803e None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:44.606524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d77aea9c-e7c6-4039-9053-ea6cbc34803e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:44.679526 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:44.701932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 674/1336] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:24:44.984596 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45821519-1c0e-4e07-b7c5-bea3d907af62 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:44.986135 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-45821519-1c0e-4e07-b7c5-bea3d907af62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:45.086967 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45821519-1c0e-4e07-b7c5-bea3d907af62 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:45.114064 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:45.159194 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7fe85-8260-4bba-9e37-7fc075a861b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:45.159785 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7fe85-8260-4bba-9e37-7fc075a861b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:45.160062 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7fe85-8260-4bba-9e37-7fc075a861b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:45.160330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7fe85-8260-4bba-9e37-7fc075a861b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:45.161896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b3c7fe85-8260-4bba-9e37-7fc075a861b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:45.268275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7fe85-8260-4bba-9e37-7fc075a861b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:45.269621 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7fe85-8260-4bba-9e37-7fc075a861b3 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:45.288725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 663/1337] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:24:47.493464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab04b07-5d44-49b4-aa46-d775fbe82741 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:47.494506 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab04b07-5d44-49b4-aa46-d775fbe82741 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:47.494506 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab04b07-5d44-49b4-aa46-d775fbe82741 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:47.495836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 675/1338] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:24:47.501045 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fca790-a80a-4379-a3f4-610d71abb700 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:47.501456 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fca790-a80a-4379-a3f4-610d71abb700 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:47.501587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fca790-a80a-4379-a3f4-610d71abb700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:47.566219 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-81fca790-a80a-4379-a3f4-610d71abb700 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:47.567460 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-81fca790-a80a-4379-a3f4-610d71abb700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:47.576165 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:47.665372 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 664/1339] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:24:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:24:47.945443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab04b07-5d44-49b4-aa46-d775fbe82741 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:47.947053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7ab04b07-5d44-49b4-aa46-d775fbe82741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:48.054881 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab04b07-5d44-49b4-aa46-d775fbe82741 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:48.125889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c079e9f-5092-4957-9c18-2b39213e7a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:48.126480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079e9f-5092-4957-9c18-2b39213e7a78 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:48.126790 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079e9f-5092-4957-9c18-2b39213e7a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:48.127054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079e9f-5092-4957-9c18-2b39213e7a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:48.128682 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5c079e9f-5092-4957-9c18-2b39213e7a78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:48.162370 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:48.235478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c079e9f-5092-4957-9c18-2b39213e7a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:48.236810 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c079e9f-5092-4957-9c18-2b39213e7a78 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:48.254494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 676/1340] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:24:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:24:52.178132 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc97b4c-d2ab-4299-997e-e88af4e7570d None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:52.178707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc97b4c-d2ab-4299-997e-e88af4e7570d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:52.178707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc97b4c-d2ab-4299-997e-e88af4e7570d None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:52.180085 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 665/1341] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:24:52.185297 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff1b1e-7a4e-40c4-82a6-be5faea634c7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:52.185712 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff1b1e-7a4e-40c4-82a6-be5faea634c7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:52.185969 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff1b1e-7a4e-40c4-82a6-be5faea634c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:52.252516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-dcff1b1e-7a4e-40c4-82a6-be5faea634c7 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:52.253716 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-dcff1b1e-7a4e-40c4-82a6-be5faea634c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:52.339431 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:52.351366 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 677/1342] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:24:52.639541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc97b4c-d2ab-4299-997e-e88af4e7570d None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:52.641175 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5bc97b4c-d2ab-4299-997e-e88af4e7570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:52.744668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc97b4c-d2ab-4299-997e-e88af4e7570d None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:52.781989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:52.818800 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1996a-d571-4d21-8d76-1fbf01c80440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:52.819402 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1996a-d571-4d21-8d76-1fbf01c80440 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:52.819682 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1996a-d571-4d21-8d76-1fbf01c80440 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:52.819969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1996a-d571-4d21-8d76-1fbf01c80440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:52.822101 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7ce1996a-d571-4d21-8d76-1fbf01c80440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:52.930401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1996a-d571-4d21-8d76-1fbf01c80440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:52.931788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1996a-d571-4d21-8d76-1fbf01c80440 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:52.957416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 666/1343] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:24:55.511796 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd05d90-c19f-4c97-a891-4ca809c13015 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:55.512230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd05d90-c19f-4c97-a891-4ca809c13015 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:55.512334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd05d90-c19f-4c97-a891-4ca809c13015 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:55.513695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 678/1344] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:24:55.518956 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3626c-e507-428e-a007-366ae82c7c88 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:55.519401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3626c-e507-428e-a007-366ae82c7c88 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:55.519540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3626c-e507-428e-a007-366ae82c7c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:55.588563 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-3ba3626c-e507-428e-a007-366ae82c7c88 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:55.589770 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-3ba3626c-e507-428e-a007-366ae82c7c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:55.608633 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:55.696067 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 667/1345] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:24:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:24:55.988961 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd05d90-c19f-4c97-a891-4ca809c13015 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:55.990839 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6bd05d90-c19f-4c97-a891-4ca809c13015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:56.104874 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd05d90-c19f-4c97-a891-4ca809c13015 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:56.178775 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7dc4a-b6ec-4042-9af9-2c959a12568f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:56.179384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7dc4a-b6ec-4042-9af9-2c959a12568f service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:56.179656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7dc4a-b6ec-4042-9af9-2c959a12568f service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:56.179921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7dc4a-b6ec-4042-9af9-2c959a12568f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:56.181524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-20f7dc4a-b6ec-4042-9af9-2c959a12568f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:56.230440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:56.299442 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7dc4a-b6ec-4042-9af9-2c959a12568f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:56.300866 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7dc4a-b6ec-4042-9af9-2c959a12568f service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:56.319340 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 679/1346] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:24:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:00.579517 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5daa6-f953-4561-a3b2-c45485c0c576 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:00.579959 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5daa6-f953-4561-a3b2-c45485c0c576 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:00.580057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5daa6-f953-4561-a3b2-c45485c0c576 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:00.581427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 668/1347] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:00.587459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474a3ad-ae06-4092-9111-680d2236625d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:00.587945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474a3ad-ae06-4092-9111-680d2236625d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:00.588127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474a3ad-ae06-4092-9111-680d2236625d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:00.669072 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5474a3ad-ae06-4092-9111-680d2236625d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:00.670293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5474a3ad-ae06-4092-9111-680d2236625d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:00.768008 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:00.771493 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 680/1348] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:01.054639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5daa6-f953-4561-a3b2-c45485c0c576 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:01.056831 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0da5daa6-f953-4561-a3b2-c45485c0c576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:01.157087 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5daa6-f953-4561-a3b2-c45485c0c576 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:01.203611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:01.229880 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a3d9b-71ed-4398-9f9a-e2c4f3ca8410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:01.230469 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a3d9b-71ed-4398-9f9a-e2c4f3ca8410 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:01.230790 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a3d9b-71ed-4398-9f9a-e2c4f3ca8410 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:01.231061 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a3d9b-71ed-4398-9f9a-e2c4f3ca8410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:01.232632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-622a3d9b-71ed-4398-9f9a-e2c4f3ca8410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:01.339869 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a3d9b-71ed-4398-9f9a-e2c4f3ca8410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:01.341295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a3d9b-71ed-4398-9f9a-e2c4f3ca8410 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:01.359784 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 669/1349] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:06.292607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e37602-898e-4335-9668-c5075628b7a2 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:06.293127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e37602-898e-4335-9668-c5075628b7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:06.293127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e37602-898e-4335-9668-c5075628b7a2 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:06.294779 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 681/1350] 10.222.0.71 () {54 vars in 921 bytes} [Thu Sep 1 16:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:06.300150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c076d2-26a9-4dfe-9c56-25a3a0f1aa8a None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:06.300150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c076d2-26a9-4dfe-9c56-25a3a0f1aa8a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:06.300943 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c076d2-26a9-4dfe-9c56-25a3a0f1aa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:06.432381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-d2c076d2-26a9-4dfe-9c56-25a3a0f1aa8a None None] MFA Rules not processed for user `dae8db0856ed44088f0bd3cb93701de0`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:06.433603 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d2c076d2-26a9-4dfe-9c56-25a3a0f1aa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:06.460531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:06.562818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 670/1351] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Sep 1 16:25:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:10.981190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28550a85-9d0d-4043-9e2c-399900050a77 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:10.981688 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28550a85-9d0d-4043-9e2c-399900050a77 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:10.981688 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28550a85-9d0d-4043-9e2c-399900050a77 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:10.984116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 682/1352] 10.222.0.71 () {54 vars in 921 bytes} [Thu Sep 1 16:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:10.989326 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c116b1-df90-41ac-bd55-0dcc0075e22d None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:10.989719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c116b1-df90-41ac-bd55-0dcc0075e22d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:10.989923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c116b1-df90-41ac-bd55-0dcc0075e22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:11.072572 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-17c116b1-df90-41ac-bd55-0dcc0075e22d None None] MFA Rules not processed for user `dae8db0856ed44088f0bd3cb93701de0`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:11.073793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-17c116b1-df90-41ac-bd55-0dcc0075e22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:11.153006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:11.194675 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 671/1353] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Sep 1 16:25:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:12.634895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c8271-facc-4930-84a9-9985af7b2c47 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:12.635399 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c8271-facc-4930-84a9-9985af7b2c47 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:12.635534 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c8271-facc-4930-84a9-9985af7b2c47 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:12.637096 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 683/1354] 10.222.0.71 () {54 vars in 921 bytes} [Thu Sep 1 16:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:12.642076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e953cff-38ef-43d6-9838-73f0edc944fb None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:12.642513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e953cff-38ef-43d6-9838-73f0edc944fb None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:12.642740 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e953cff-38ef-43d6-9838-73f0edc944fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:12.729143 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-1e953cff-38ef-43d6-9838-73f0edc944fb None None] MFA Rules not processed for user `dae8db0856ed44088f0bd3cb93701de0`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:12.730343 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1e953cff-38ef-43d6-9838-73f0edc944fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:12.837535 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 672/1355] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Sep 1 16:25:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:15.915280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123f4ce-cf5b-48f8-a7f3-4b9a37846c67 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:15.915786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123f4ce-cf5b-48f8-a7f3-4b9a37846c67 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:15.915883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123f4ce-cf5b-48f8-a7f3-4b9a37846c67 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:15.917323 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 684/1356] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:15.922845 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74ecb7-bf96-42cd-8da3-c581a6a4e603 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:15.923293 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74ecb7-bf96-42cd-8da3-c581a6a4e603 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:15.923407 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74ecb7-bf96-42cd-8da3-c581a6a4e603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:15.965552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:16.004207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-bd74ecb7-bf96-42cd-8da3-c581a6a4e603 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:16.005427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-bd74ecb7-bf96-42cd-8da3-c581a6a4e603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:16.140222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 673/1357] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:16.446319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f1498-6ae8-459b-a380-b8c21ff73bd5 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:16.447151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f1498-6ae8-459b-a380-b8c21ff73bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:16.447645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f1498-6ae8-459b-a380-b8c21ff73bd5 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:16.449680 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 685/1358] 10.222.0.71 () {54 vars in 962 bytes} [Thu Sep 1 16:25:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:16.457848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f224e-9876-4be1-af11-fdac6d46c209 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:16.458138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f224e-9876-4be1-af11-fdac6d46c209 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:16.458416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f224e-9876-4be1-af11-fdac6d46c209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:16.541258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-5b1f224e-9876-4be1-af11-fdac6d46c209 None None] MFA Rules not processed for user `ed71d63cd24f4a6caf6ebba2c30d3608`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:16.542453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5b1f224e-9876-4be1-af11-fdac6d46c209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:16.594828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:16.674481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 674/1359] 10.222.0.71 () {58 vars in 1059 bytes} [Thu Sep 1 16:25:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:16.683060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f1498-6ae8-459b-a380-b8c21ff73bd5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:16.684676 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-522f1498-6ae8-459b-a380-b8c21ff73bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:16.847448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f1498-6ae8-459b-a380-b8c21ff73bd5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:16.927076 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:16.971270 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa573a-6b4b-42d6-811e-9766e42a7a98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:16.971874 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa573a-6b4b-42d6-811e-9766e42a7a98 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:16.972171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa573a-6b4b-42d6-811e-9766e42a7a98 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:16.972424 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa573a-6b4b-42d6-811e-9766e42a7a98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:16.974014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2eaa573a-6b4b-42d6-811e-9766e42a7a98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:17.076469 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa573a-6b4b-42d6-811e-9766e42a7a98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:17.078368 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa573a-6b4b-42d6-811e-9766e42a7a98 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:17.101844 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 686/1360] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:19.229148 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28790a-42de-4394-b4d6-129b60670971 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:19.229630 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28790a-42de-4394-b4d6-129b60670971 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:19.229630 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28790a-42de-4394-b4d6-129b60670971 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:19.231145 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 675/1361] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:19.236284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b175f-2039-44df-9b89-dbd6759ffdcb None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:19.236723 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b175f-2039-44df-9b89-dbd6759ffdcb None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:19.236831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b175f-2039-44df-9b89-dbd6759ffdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:19.305098 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5c3b175f-2039-44df-9b89-dbd6759ffdcb None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:19.306285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5c3b175f-2039-44df-9b89-dbd6759ffdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:19.345004 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:19.408124 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 687/1362] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:19.698221 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28790a-42de-4394-b4d6-129b60670971 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:19.699864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-fb28790a-42de-4394-b4d6-129b60670971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:19.853616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28790a-42de-4394-b4d6-129b60670971 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:19.863702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:19.976402 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5364df-1536-40f7-9824-ef79e0cb1a7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:19.977007 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5364df-1536-40f7-9824-ef79e0cb1a7e service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:19.977280 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5364df-1536-40f7-9824-ef79e0cb1a7e service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:19.977544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5364df-1536-40f7-9824-ef79e0cb1a7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:19.979153 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-fa5364df-1536-40f7-9824-ef79e0cb1a7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:20.077060 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5364df-1536-40f7-9824-ef79e0cb1a7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:20.080397 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5364df-1536-40f7-9824-ef79e0cb1a7e service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:20.100234 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 676/1363] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:22.329486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3985720-b6da-4ad4-aac0-a7363649cf44 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:22.329997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3985720-b6da-4ad4-aac0-a7363649cf44 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:22.329997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3985720-b6da-4ad4-aac0-a7363649cf44 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:22.331635 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 688/1364] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:22.338333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb3a38-c810-43a2-b02f-3f6bb00c12a0 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:22.338915 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb3a38-c810-43a2-b02f-3f6bb00c12a0 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:22.339122 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb3a38-c810-43a2-b02f-3f6bb00c12a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:22.360145 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:22.417639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-bccb3a38-c810-43a2-b02f-3f6bb00c12a0 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:22.419040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-bccb3a38-c810-43a2-b02f-3f6bb00c12a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:22.522423 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 677/1365] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:22.812771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103881b-dbeb-4be3-9356-4f4738e32d7f None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:22.813497 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103881b-dbeb-4be3-9356-4f4738e32d7f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:22.813876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103881b-dbeb-4be3-9356-4f4738e32d7f None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:22.815565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 689/1366] 10.222.0.71 () {54 vars in 962 bytes} [Thu Sep 1 16:25:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:22.822361 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97a6dc-afa3-4f93-b5ae-de58b08c8a1c None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:22.822688 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97a6dc-afa3-4f93-b5ae-de58b08c8a1c None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:22.822965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97a6dc-afa3-4f93-b5ae-de58b08c8a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:22.905927 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-ea97a6dc-afa3-4f93-b5ae-de58b08c8a1c None None] MFA Rules not processed for user `ed71d63cd24f4a6caf6ebba2c30d3608`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:22.907198 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ea97a6dc-afa3-4f93-b5ae-de58b08c8a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:22.945064 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:23.050784 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 678/1367] 10.222.0.71 () {58 vars in 1059 bytes} [Thu Sep 1 16:25:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:23.054981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103881b-dbeb-4be3-9356-4f4738e32d7f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:23.058868 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3103881b-dbeb-4be3-9356-4f4738e32d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:23.215023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103881b-dbeb-4be3-9356-4f4738e32d7f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:23.235958 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:23.337642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7b42e-a22c-419f-a3b6-7059d5908288 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:23.338332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7b42e-a22c-419f-a3b6-7059d5908288 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:23.338582 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7b42e-a22c-419f-a3b6-7059d5908288 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:23.338797 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7b42e-a22c-419f-a3b6-7059d5908288 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:23.340369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c9c7b42e-a22c-419f-a3b6-7059d5908288 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:23.433166 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7b42e-a22c-419f-a3b6-7059d5908288 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:23.434781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7b42e-a22c-419f-a3b6-7059d5908288 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:23.452978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 690/1368] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:24.165033 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d6b9-8b49-44d2-9cdd-7aad642e4b23 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:24.165567 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d6b9-8b49-44d2-9cdd-7aad642e4b23 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:24.165567 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d6b9-8b49-44d2-9cdd-7aad642e4b23 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:24.167122 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 679/1369] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:24.172129 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199bf99-8318-4660-a0e9-1847c5f21953 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:24.172416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199bf99-8318-4660-a0e9-1847c5f21953 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:24.172690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199bf99-8318-4660-a0e9-1847c5f21953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:24.204332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:24.243033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-6199bf99-8318-4660-a0e9-1847c5f21953 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:24.244250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6199bf99-8318-4660-a0e9-1847c5f21953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:24.352546 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 691/1370] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:24.931450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880971db-efa0-4011-8eba-bfb677c62087 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:24.931450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880971db-efa0-4011-8eba-bfb677c62087 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:24.931450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880971db-efa0-4011-8eba-bfb677c62087 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:24.932593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 680/1371] 10.222.0.71 () {54 vars in 964 bytes} [Thu Sep 1 16:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:24.938250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c980eef-cd5e-4753-a895-b84e14dd9d05 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:24.938639 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c980eef-cd5e-4753-a895-b84e14dd9d05 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:24.938986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c980eef-cd5e-4753-a895-b84e14dd9d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:25.022254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7c980eef-cd5e-4753-a895-b84e14dd9d05 None None] MFA Rules not processed for user `5a0dece90fc54641be30cdc2ddad9cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:25.023522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7c980eef-cd5e-4753-a895-b84e14dd9d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:25.071937 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:25.104426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 692/1372] 10.222.0.71 () {58 vars in 1061 bytes} [Thu Sep 1 16:25:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:25.111958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880971db-efa0-4011-8eba-bfb677c62087 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:25.113605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-880971db-efa0-4011-8eba-bfb677c62087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:25.224736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880971db-efa0-4011-8eba-bfb677c62087 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:25.267533 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:25.305399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330228a7-8fd9-462f-b08a-bc8a7b78a64a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:25.306015 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330228a7-8fd9-462f-b08a-bc8a7b78a64a service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:25.306295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330228a7-8fd9-462f-b08a-bc8a7b78a64a service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:25.306728 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330228a7-8fd9-462f-b08a-bc8a7b78a64a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:25.308272 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-330228a7-8fd9-462f-b08a-bc8a7b78a64a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:25.424164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330228a7-8fd9-462f-b08a-bc8a7b78a64a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:25.425619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330228a7-8fd9-462f-b08a-bc8a7b78a64a service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:25.445289 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 681/1373] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:25.448134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b41c46-cf00-4f46-bde0-c5044debe2f0 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:25.448134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b41c46-cf00-4f46-bde0-c5044debe2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:25.448760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b41c46-cf00-4f46-bde0-c5044debe2f0 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:25.449928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 693/1374] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:25.456748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc04db9-7bda-4d25-9382-acfc4de08e74 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:25.457321 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc04db9-7bda-4d25-9382-acfc4de08e74 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:25.457761 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc04db9-7bda-4d25-9382-acfc4de08e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:25.543557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-8fc04db9-7bda-4d25-9382-acfc4de08e74 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:25.544575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-8fc04db9-7bda-4d25-9382-acfc4de08e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:25.568437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:25.667047 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 682/1375] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:25.953219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b41c46-cf00-4f46-bde0-c5044debe2f0 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:25.954767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-64b41c46-cf00-4f46-bde0-c5044debe2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:26.101277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b41c46-cf00-4f46-bde0-c5044debe2f0 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:26.155614 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:26.220209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a6b93-de21-4e9f-8604-125e6e3a1079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:26.220732 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a6b93-de21-4e9f-8604-125e6e3a1079 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:26.221010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a6b93-de21-4e9f-8604-125e6e3a1079 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:26.221272 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a6b93-de21-4e9f-8604-125e6e3a1079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:26.222956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d57a6b93-de21-4e9f-8604-125e6e3a1079 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:26.311653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a6b93-de21-4e9f-8604-125e6e3a1079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:26.313324 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a6b93-de21-4e9f-8604-125e6e3a1079 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:26.332752 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 694/1376] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:28.286443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07df9c7-ad2c-4c38-826f-5475fae02586 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:28.286997 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07df9c7-ad2c-4c38-826f-5475fae02586 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:28.287083 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07df9c7-ad2c-4c38-826f-5475fae02586 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:28.288546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 683/1377] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:28.293623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50abf8-9ac3-41e7-8066-cdb4f95e51b3 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:28.294010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50abf8-9ac3-41e7-8066-cdb4f95e51b3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:28.294150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50abf8-9ac3-41e7-8066-cdb4f95e51b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:28.359418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ee50abf8-9ac3-41e7-8066-cdb4f95e51b3 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:28.360665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ee50abf8-9ac3-41e7-8066-cdb4f95e51b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:28.377191 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:28.472262 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 695/1378] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:28.764361 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07df9c7-ad2c-4c38-826f-5475fae02586 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:28.765961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a07df9c7-ad2c-4c38-826f-5475fae02586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:28.951846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07df9c7-ad2c-4c38-826f-5475fae02586 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:28.956476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:29.106041 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638ea97-e3f7-49fd-9c81-7e278fafc7d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:29.106674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638ea97-e3f7-49fd-9c81-7e278fafc7d3 service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:29.106960 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638ea97-e3f7-49fd-9c81-7e278fafc7d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:29.107221 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638ea97-e3f7-49fd-9c81-7e278fafc7d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:29.108782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-8638ea97-e3f7-49fd-9c81-7e278fafc7d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:29.204371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638ea97-e3f7-49fd-9c81-7e278fafc7d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:29.206019 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638ea97-e3f7-49fd-9c81-7e278fafc7d3 service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:29.226329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 684/1379] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:31.176712 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c096c-1de1-4349-95de-09c5ea643b42 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:31.177276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c096c-1de1-4349-95de-09c5ea643b42 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:31.177375 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c096c-1de1-4349-95de-09c5ea643b42 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:31.182091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 696/1380] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:31.187826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6647ee2-1345-43a2-bfea-b615c1724611 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:31.188263 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6647ee2-1345-43a2-bfea-b615c1724611 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:31.188368 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6647ee2-1345-43a2-bfea-b615c1724611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:31.200789 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:31.260362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-f6647ee2-1345-43a2-bfea-b615c1724611 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:31.261651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f6647ee2-1345-43a2-bfea-b615c1724611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:31.374058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 685/1381] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:31.666513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c096c-1de1-4349-95de-09c5ea643b42 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:31.668401 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-af8c096c-1de1-4349-95de-09c5ea643b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:31.831420 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:31.843894 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c096c-1de1-4349-95de-09c5ea643b42 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:31.965281 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e91a9-8769-47ad-a4fa-f7db5467d185 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:31.965951 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e91a9-8769-47ad-a4fa-f7db5467d185 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:31.966231 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e91a9-8769-47ad-a4fa-f7db5467d185 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:31.966500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e91a9-8769-47ad-a4fa-f7db5467d185 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:31.968150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0d9e91a9-8769-47ad-a4fa-f7db5467d185 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:32.070572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e91a9-8769-47ad-a4fa-f7db5467d185 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:32.072174 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e91a9-8769-47ad-a4fa-f7db5467d185 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:32.083298 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:32.093635 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 697/1382] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:34.122561 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dddd0-3eab-4b8b-873d-fba3179e47bb None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:34.123158 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dddd0-3eab-4b8b-873d-fba3179e47bb None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:34.123261 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dddd0-3eab-4b8b-873d-fba3179e47bb None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:34.124590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 686/1383] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:34.131086 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026f5c0-d079-4057-be78-0f962cf61b10 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:34.131760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026f5c0-d079-4057-be78-0f962cf61b10 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:34.132037 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026f5c0-d079-4057-be78-0f962cf61b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:34.200391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-6026f5c0-d079-4057-be78-0f962cf61b10 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:34.201669 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6026f5c0-d079-4057-be78-0f962cf61b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:34.308391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 698/1384] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:25:34.664402 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9dddd0-3eab-4b8b-873d-fba3179e47bb None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:34.666061 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-fb9dddd0-3eab-4b8b-873d-fba3179e47bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:34.759897 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:34.823859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9dddd0-3eab-4b8b-873d-fba3179e47bb None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:34.943884 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365e538-c2d4-45e6-85c2-e0664253ac70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:34.944503 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365e538-c2d4-45e6-85c2-e0664253ac70 service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:34.944852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365e538-c2d4-45e6-85c2-e0664253ac70 service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:34.945193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365e538-c2d4-45e6-85c2-e0664253ac70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:34.947254 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c365e538-c2d4-45e6-85c2-e0664253ac70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:35.009241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:35.055455 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365e538-c2d4-45e6-85c2-e0664253ac70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:35.057136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365e538-c2d4-45e6-85c2-e0664253ac70 service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:35.076629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 687/1385] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:37.000654 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d3250-24ff-47b9-84ea-fa2f853bef27 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:37.001188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d3250-24ff-47b9-84ea-fa2f853bef27 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:37.001312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d3250-24ff-47b9-84ea-fa2f853bef27 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:37.002681 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 699/1386] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:37.008079 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f8b30-83d0-4295-9448-82fb3ebe06fc None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:37.008506 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f8b30-83d0-4295-9448-82fb3ebe06fc None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:37.008815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f8b30-83d0-4295-9448-82fb3ebe06fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:37.079948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-f60f8b30-83d0-4295-9448-82fb3ebe06fc None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:37.081208 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f60f8b30-83d0-4295-9448-82fb3ebe06fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:37.183295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 688/1387] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:37.467358 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d3250-24ff-47b9-84ea-fa2f853bef27 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:37.468868 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d43d3250-24ff-47b9-84ea-fa2f853bef27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:37.552038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:37.627086 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d3250-24ff-47b9-84ea-fa2f853bef27 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:37.752303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d9237-888a-409b-88f8-50833a5cb854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:37.752853 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d9237-888a-409b-88f8-50833a5cb854 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:37.753153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d9237-888a-409b-88f8-50833a5cb854 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:37.753413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d9237-888a-409b-88f8-50833a5cb854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:37.755121 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ac2d9237-888a-409b-88f8-50833a5cb854 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:37.795740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:37.855845 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d9237-888a-409b-88f8-50833a5cb854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:37.857448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d9237-888a-409b-88f8-50833a5cb854 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:37.876290 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 700/1388] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:39.859061 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160eae3-f699-419e-880e-01281722bbd1 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:39.859587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160eae3-f699-419e-880e-01281722bbd1 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:39.859679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160eae3-f699-419e-880e-01281722bbd1 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:39.861034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 689/1389] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:39.866841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef017e8-3969-4087-bc72-37d5a9bc5a5a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:39.867282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef017e8-3969-4087-bc72-37d5a9bc5a5a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:39.867408 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef017e8-3969-4087-bc72-37d5a9bc5a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:39.934039 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8ef017e8-3969-4087-bc72-37d5a9bc5a5a None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:39.935172 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8ef017e8-3969-4087-bc72-37d5a9bc5a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:40.032541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 701/1390] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:40.329718 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160eae3-f699-419e-880e-01281722bbd1 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:40.331285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a160eae3-f699-419e-880e-01281722bbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:40.367583 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:40.455485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3b400-e6fb-4be3-a188-2fc1e682cb25 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:40.455779 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3b400-e6fb-4be3-a188-2fc1e682cb25 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:40.456052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3b400-e6fb-4be3-a188-2fc1e682cb25 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:40.457390 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 702/1391] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:25:40.463013 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284160b-e936-49f6-a39e-8bcbb5da1b07 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:40.463283 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284160b-e936-49f6-a39e-8bcbb5da1b07 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:40.463550 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284160b-e936-49f6-a39e-8bcbb5da1b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:40.479388 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:40.488842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160eae3-f699-419e-880e-01281722bbd1 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:40.530647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b284160b-e936-49f6-a39e-8bcbb5da1b07 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:40.531861 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b284160b-e936-49f6-a39e-8bcbb5da1b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:40.593999 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:40.610048 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e56b1-fd23-401a-b728-2cfeed4fbddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:40.610683 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e56b1-fd23-401a-b728-2cfeed4fbddb service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:40.610960 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e56b1-fd23-401a-b728-2cfeed4fbddb service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:40.611270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e56b1-fd23-401a-b728-2cfeed4fbddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:40.612947 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c43e56b1-fd23-401a-b728-2cfeed4fbddb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:40.637809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 703/1392] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:25:40.706219 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e56b1-fd23-401a-b728-2cfeed4fbddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:40.707908 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e56b1-fd23-401a-b728-2cfeed4fbddb service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:40.726715 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 690/1393] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:40.945475 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81778a14-2e35-4d8e-ae2a-bcd5175598ad None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:40.945930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81778a14-2e35-4d8e-ae2a-bcd5175598ad None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:40.946053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81778a14-2e35-4d8e-ae2a-bcd5175598ad None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:40.947386 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 704/1394] 10.222.0.71 () {54 vars in 967 bytes} [Thu Sep 1 16:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:40.952485 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb11a28-29ac-44de-b996-8ac438fca0b4 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:40.952948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb11a28-29ac-44de-b996-8ac438fca0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:40.953045 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb11a28-29ac-44de-b996-8ac438fca0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:41.030023 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-7bb11a28-29ac-44de-b996-8ac438fca0b4 None None] MFA Rules not processed for user `b11356a5e3d041729f71515482033dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:41.031243 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7bb11a28-29ac-44de-b996-8ac438fca0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:41.083489 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:41.108020 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 691/1395] 10.222.0.71 () {58 vars in 1064 bytes} [Thu Sep 1 16:25:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:41.116105 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81778a14-2e35-4d8e-ae2a-bcd5175598ad None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:41.117604 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-81778a14-2e35-4d8e-ae2a-bcd5175598ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:41.212688 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:41.220014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81778a14-2e35-4d8e-ae2a-bcd5175598ad None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:41.292279 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd513da-ff0e-4a6f-ad07-789fe1ba78f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11356a5e3d041729f71515482033dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:41.292879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd513da-ff0e-4a6f-ad07-789fe1ba78f1 service glance] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:41.293156 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd513da-ff0e-4a6f-ad07-789fe1ba78f1 service glance] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:41.293427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd513da-ff0e-4a6f-ad07-789fe1ba78f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:41.295051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9bd513da-ff0e-4a6f-ad07-789fe1ba78f1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:41.401942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd513da-ff0e-4a6f-ad07-789fe1ba78f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:41.403404 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd513da-ff0e-4a6f-ad07-789fe1ba78f1 service glance] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:41.421310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 705/1396] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:42.165794 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5337ad8-5936-44cc-ba6c-ac133db72107 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:42.166252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5337ad8-5936-44cc-ba6c-ac133db72107 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:42.166481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5337ad8-5936-44cc-ba6c-ac133db72107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:42.235288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-e5337ad8-5936-44cc-ba6c-ac133db72107 None None] MFA Rules not processed for user `cd0dbb2c140946f69c3f508b4184e998`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:42.236532 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e5337ad8-5936-44cc-ba6c-ac133db72107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:42.321485 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 692/1397] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Sep 1 16:25:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:42.363881 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12637929-ac95-4d03-8f3e-1db2a24dc4c2 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:42.364391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12637929-ac95-4d03-8f3e-1db2a24dc4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:42.364490 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12637929-ac95-4d03-8f3e-1db2a24dc4c2 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:42.365795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 706/1398] 10.222.0.71 () {54 vars in 943 bytes} [Thu Sep 1 16:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:42.372360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faad0a4-8846-46d6-8a9e-31ef819cda7d None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:42.372651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faad0a4-8846-46d6-8a9e-31ef819cda7d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:42.372991 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faad0a4-8846-46d6-8a9e-31ef819cda7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:42.451451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-4faad0a4-8846-46d6-8a9e-31ef819cda7d None None] MFA Rules not processed for user `9f7afa63815643f580c91df4e4c3bafc`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:42.452580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4faad0a4-8846-46d6-8a9e-31ef819cda7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:42.465705 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:42.565824 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 693/1399] 10.222.0.71 () {58 vars in 1040 bytes} [Thu Sep 1 16:25:42 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:42.577649 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12637929-ac95-4d03-8f3e-1db2a24dc4c2 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:42.579277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-12637929-ac95-4d03-8f3e-1db2a24dc4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:42.604485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:42.712457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be0067-2822-4424-9a1e-41f38ad46a31 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:42.712746 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be0067-2822-4424-9a1e-41f38ad46a31 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:42.713088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be0067-2822-4424-9a1e-41f38ad46a31 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:42.714577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 694/1400] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:25:42.719537 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3860cbb-dfe9-4781-bcf0-6cab3a3f446e None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:42.719816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3860cbb-dfe9-4781-bcf0-6cab3a3f446e None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:42.720092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3860cbb-dfe9-4781-bcf0-6cab3a3f446e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:42.726063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12637929-ac95-4d03-8f3e-1db2a24dc4c2 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:42.786382 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-c3860cbb-dfe9-4781-bcf0-6cab3a3f446e None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:42.787637 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c3860cbb-dfe9-4781-bcf0-6cab3a3f446e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:42.831355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1df106-0da4-454a-bbd7-8b99236d68af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f7afa63815643f580c91df4e4c3bafc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:42.831954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1df106-0da4-454a-bbd7-8b99236d68af service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:42.832227 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1df106-0da4-454a-bbd7-8b99236d68af service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:42.832493 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1df106-0da4-454a-bbd7-8b99236d68af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:42.834481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7c1df106-0da4-454a-bbd7-8b99236d68af service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:42.841816 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:42.863628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:42.886202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 695/1401] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:42.922640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1df106-0da4-454a-bbd7-8b99236d68af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:42.922640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1df106-0da4-454a-bbd7-8b99236d68af service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:42.928824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 707/1402] 10.222.0.71 () {60 vars in 1384 bytes} [Thu Sep 1 16:25:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:25:43.175854 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3860cbb-dfe9-4781-bcf0-6cab3a3f446e None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:43.177784 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c3860cbb-dfe9-4781-bcf0-6cab3a3f446e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:43.308167 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3860cbb-dfe9-4781-bcf0-6cab3a3f446e None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:43.417308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:43.446312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f2619-9940-4bc5-8c5a-001c0a6b3ba4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:43.446952 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f2619-9940-4bc5-8c5a-001c0a6b3ba4 service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:43.447233 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f2619-9940-4bc5-8c5a-001c0a6b3ba4 service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:43.447508 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f2619-9940-4bc5-8c5a-001c0a6b3ba4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:43.453710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1c9f2619-9940-4bc5-8c5a-001c0a6b3ba4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:43.562706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f2619-9940-4bc5-8c5a-001c0a6b3ba4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:43.564664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f2619-9940-4bc5-8c5a-001c0a6b3ba4 service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:43.586806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 696/1403] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:45.566519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc3aef-5f31-4e31-bc98-534e516b49d0 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:45.568628 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc3aef-5f31-4e31-bc98-534e516b49d0 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:45.568916 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc3aef-5f31-4e31-bc98-534e516b49d0 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:45.570559 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 708/1404] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:25:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:45.575521 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cb2fd-c303-4fdf-8d0a-33b223383f25 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:45.575975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cb2fd-c303-4fdf-8d0a-33b223383f25 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:45.576088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cb2fd-c303-4fdf-8d0a-33b223383f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:45.655478 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-b29cb2fd-c303-4fdf-8d0a-33b223383f25 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:45.660417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b29cb2fd-c303-4fdf-8d0a-33b223383f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:45.715844 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:45.766345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 697/1405] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:46.106648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc3aef-5f31-4e31-bc98-534e516b49d0 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:46.109268 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-99dc3aef-5f31-4e31-bc98-534e516b49d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:46.279250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc3aef-5f31-4e31-bc98-534e516b49d0 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:46.282157 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:46.409284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13e85f-5ec6-494d-ba07-bb67eefa12db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:46.409942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13e85f-5ec6-494d-ba07-bb67eefa12db service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:46.410226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13e85f-5ec6-494d-ba07-bb67eefa12db service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:46.410497 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13e85f-5ec6-494d-ba07-bb67eefa12db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:46.412248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5f13e85f-5ec6-494d-ba07-bb67eefa12db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:46.511005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13e85f-5ec6-494d-ba07-bb67eefa12db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:46.512728 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13e85f-5ec6-494d-ba07-bb67eefa12db service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:46.531780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 709/1406] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:48.521017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70414e5-d4b7-4ac3-b5a1-fcb1a5bac10a None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:48.521560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70414e5-d4b7-4ac3-b5a1-fcb1a5bac10a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:48.521560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70414e5-d4b7-4ac3-b5a1-fcb1a5bac10a None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:48.523038 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 698/1407] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:48.528051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c064a69-75a8-4b71-bdd7-fb7b1e6274dc None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:48.528492 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c064a69-75a8-4b71-bdd7-fb7b1e6274dc None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:48.528587 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c064a69-75a8-4b71-bdd7-fb7b1e6274dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:48.538931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:48.602531 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-6c064a69-75a8-4b71-bdd7-fb7b1e6274dc None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:48.603791 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6c064a69-75a8-4b71-bdd7-fb7b1e6274dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:48.727291 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 710/1408] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:49.015940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70414e5-d4b7-4ac3-b5a1-fcb1a5bac10a None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:49.017803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a70414e5-d4b7-4ac3-b5a1-fcb1a5bac10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:49.186103 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70414e5-d4b7-4ac3-b5a1-fcb1a5bac10a None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:49.359119 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:49.456103 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00a56a-9dd2-4409-8119-d809c65f56d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:49.457124 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00a56a-9dd2-4409-8119-d809c65f56d9 service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:49.457631 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00a56a-9dd2-4409-8119-d809c65f56d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:49.457969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00a56a-9dd2-4409-8119-d809c65f56d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:49.460517 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5f00a56a-9dd2-4409-8119-d809c65f56d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:49.558913 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00a56a-9dd2-4409-8119-d809c65f56d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:49.560506 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00a56a-9dd2-4409-8119-d809c65f56d9 service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:49.581902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 699/1409] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:58.724604 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=62 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:59.579447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=82 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:05.169926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67510ac5-a40b-4eb1-b904-d700bb816c30 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:05.170660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67510ac5-a40b-4eb1-b904-d700bb816c30 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:05.170660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67510ac5-a40b-4eb1-b904-d700bb816c30 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:05.171884 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 711/1410] 10.222.0.71 () {54 vars in 918 bytes} [Thu Sep 1 16:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:05.176992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938a048-43b4-4d4c-ab60-66bf7099a1dc None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:05.177449 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938a048-43b4-4d4c-ab60-66bf7099a1dc None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:05.177557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938a048-43b4-4d4c-ab60-66bf7099a1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:05.251887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-3938a048-43b4-4d4c-ab60-66bf7099a1dc None None] MFA Rules not processed for user `dae8db0856ed44088f0bd3cb93701de0`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:05.253080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-3938a048-43b4-4d4c-ab60-66bf7099a1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:05.356188 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 700/1411] 10.222.0.71 () {58 vars in 1015 bytes} [Thu Sep 1 16:26:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:05.371127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53f401-589a-45b0-b197-bb025370bd99 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:05.371503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53f401-589a-45b0-b197-bb025370bd99 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:05.371834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53f401-589a-45b0-b197-bb025370bd99 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:05.373179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 712/1412] 10.222.0.71 () {54 vars in 918 bytes} [Thu Sep 1 16:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:05.377660 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae6b89-90b6-4b95-b5b5-9bfe2370adf8 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:05.377944 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae6b89-90b6-4b95-b5b5-9bfe2370adf8 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:05.378211 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae6b89-90b6-4b95-b5b5-9bfe2370adf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:05.450526 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:05.452998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-d5ae6b89-90b6-4b95-b5b5-9bfe2370adf8 None None] MFA Rules not processed for user `ed71d63cd24f4a6caf6ebba2c30d3608`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:05.454818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d5ae6b89-90b6-4b95-b5b5-9bfe2370adf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:05.566571 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 701/1413] 10.222.0.71 () {58 vars in 1015 bytes} [Thu Sep 1 16:26:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:26:07.938554 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956df46-839b-441b-a9c6-28f2fcb6e888 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:07.939153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956df46-839b-441b-a9c6-28f2fcb6e888 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:07.939153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956df46-839b-441b-a9c6-28f2fcb6e888 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:07.940370 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:07.946127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3b6f2-4e19-4206-b9df-a3a3e74082ac None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:07.946572 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3b6f2-4e19-4206-b9df-a3a3e74082ac None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:07.946720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3b6f2-4e19-4206-b9df-a3a3e74082ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:08.010728 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-82d3b6f2-4e19-4206-b9df-a3a3e74082ac None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:08.011908 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-82d3b6f2-4e19-4206-b9df-a3a3e74082ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:08.065428 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:08.109005 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:26:08.403989 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956df46-839b-441b-a9c6-28f2fcb6e888 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:08.405660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1956df46-839b-441b-a9c6-28f2fcb6e888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:08.547308 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956df46-839b-441b-a9c6-28f2fcb6e888 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:08.617730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:08.658669 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01756b61-bb72-49e3-a754-cdd3de77e0cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:08.659275 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01756b61-bb72-49e3-a754-cdd3de77e0cd service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:08.659553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01756b61-bb72-49e3-a754-cdd3de77e0cd service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:08.659825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01756b61-bb72-49e3-a754-cdd3de77e0cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:08.661465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-01756b61-bb72-49e3-a754-cdd3de77e0cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:08.747005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01756b61-bb72-49e3-a754-cdd3de77e0cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:08.748589 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01756b61-bb72-49e3-a754-cdd3de77e0cd service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:08.766916 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 714/1416] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:09.653454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11b761-6bbd-4cfc-9476-31f6b995a9a7 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:09.653986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11b761-6bbd-4cfc-9476-31f6b995a9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:09.653986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11b761-6bbd-4cfc-9476-31f6b995a9a7 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:09.655421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:09.660626 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74d7e7-a7dd-4556-b85f-50ecd3d02c7d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:09.661040 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74d7e7-a7dd-4556-b85f-50ecd3d02c7d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:09.661165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74d7e7-a7dd-4556-b85f-50ecd3d02c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:09.735032 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ad74d7e7-a7dd-4556-b85f-50ecd3d02c7d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:09.736239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ad74d7e7-a7dd-4556-b85f-50ecd3d02c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:09.763185 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:09.833394 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:09.982319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11b761-6bbd-4cfc-9476-31f6b995a9a7 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:09.983825 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2d11b761-6bbd-4cfc-9476-31f6b995a9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:10.128183 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11b761-6bbd-4cfc-9476-31f6b995a9a7 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:10.167974 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:10.241415 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5e8ad-27da-4814-8ca4-5d47eea2d699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:10.241967 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5e8ad-27da-4814-8ca4-5d47eea2d699 service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:10.242242 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5e8ad-27da-4814-8ca4-5d47eea2d699 service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:10.242541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5e8ad-27da-4814-8ca4-5d47eea2d699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:10.244182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b8a5e8ad-27da-4814-8ca4-5d47eea2d699 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:10.332980 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5e8ad-27da-4814-8ca4-5d47eea2d699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:10.334552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5e8ad-27da-4814-8ca4-5d47eea2d699 service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:10.352318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 704/1419] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:11.233943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc23034-8018-4da0-9daa-ba9cda7db0b7 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:11.234523 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc23034-8018-4da0-9daa-ba9cda7db0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:11.234523 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc23034-8018-4da0-9daa-ba9cda7db0b7 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:11.235888 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:11.241518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcfcbd-d325-4950-983d-366f1de7c2b0 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:11.241919 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcfcbd-d325-4950-983d-366f1de7c2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:11.242058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcfcbd-d325-4950-983d-366f1de7c2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:11.299442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:11.321925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-a7bcfcbd-d325-4950-983d-366f1de7c2b0 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:11.323147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a7bcfcbd-d325-4950-983d-366f1de7c2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:11.417861 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:11.573596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc23034-8018-4da0-9daa-ba9cda7db0b7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:11.575119 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0fc23034-8018-4da0-9daa-ba9cda7db0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:11.718992 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc23034-8018-4da0-9daa-ba9cda7db0b7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:11.731184 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:11.829055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77aed9-c321-4e00-b1d1-d973d3360fde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:11.829572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77aed9-c321-4e00-b1d1-d973d3360fde service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:11.829847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77aed9-c321-4e00-b1d1-d973d3360fde service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:11.830111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77aed9-c321-4e00-b1d1-d973d3360fde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:11.831724 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1a77aed9-c321-4e00-b1d1-d973d3360fde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:11.918063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77aed9-c321-4e00-b1d1-d973d3360fde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:11.919691 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77aed9-c321-4e00-b1d1-d973d3360fde service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:11.937229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 717/1422] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:12.801602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd76822-d5de-4da4-8aa6-90e5a43c1e7f None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:12.802245 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd76822-d5de-4da4-8aa6-90e5a43c1e7f None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:12.802245 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd76822-d5de-4da4-8aa6-90e5a43c1e7f None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:12.803553 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:12.808472 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf3208-a2fb-4800-8ac1-e446cab58085 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:12.808889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf3208-a2fb-4800-8ac1-e446cab58085 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:12.808998 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf3208-a2fb-4800-8ac1-e446cab58085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:12.828568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:12.883375 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b0cf3208-a2fb-4800-8ac1-e446cab58085 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:12.884512 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b0cf3208-a2fb-4800-8ac1-e446cab58085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:12.980110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:13.131750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd76822-d5de-4da4-8aa6-90e5a43c1e7f None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:13.133251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7bd76822-d5de-4da4-8aa6-90e5a43c1e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:13.241712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:13.278013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd76822-d5de-4da4-8aa6-90e5a43c1e7f None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:13.390803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70665b-891b-465f-9f9b-9b2cd2943e95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:13.391402 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70665b-891b-465f-9f9b-9b2cd2943e95 service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:13.391680 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70665b-891b-465f-9f9b-9b2cd2943e95 service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:13.391950 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70665b-891b-465f-9f9b-9b2cd2943e95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:13.393540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-db70665b-891b-465f-9f9b-9b2cd2943e95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:13.467590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:13.481105 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70665b-891b-465f-9f9b-9b2cd2943e95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:13.482703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70665b-891b-465f-9f9b-9b2cd2943e95 service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:13.500807 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 707/1425] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:14.379570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3d40d-57bd-4ebc-9f3a-87dc4b497a8c None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:14.380140 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3d40d-57bd-4ebc-9f3a-87dc4b497a8c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:14.380140 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3d40d-57bd-4ebc-9f3a-87dc4b497a8c None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:14.381450 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:14.386288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a053ec3-324b-4e97-90e5-779c63ba1382 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:14.386784 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a053ec3-324b-4e97-90e5-779c63ba1382 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:14.386889 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a053ec3-324b-4e97-90e5-779c63ba1382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:14.465217 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-6a053ec3-324b-4e97-90e5-779c63ba1382 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:14.466408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6a053ec3-324b-4e97-90e5-779c63ba1382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:14.562170 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:14.712083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3d40d-57bd-4ebc-9f3a-87dc4b497a8c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:14.713516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-82d3d40d-57bd-4ebc-9f3a-87dc4b497a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:14.795253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:14.856617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3d40d-57bd-4ebc-9f3a-87dc4b497a8c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:14.967229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cefba-6489-457b-a43b-b2d6fd4659d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:14.967754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cefba-6489-457b-a43b-b2d6fd4659d5 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:14.968033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cefba-6489-457b-a43b-b2d6fd4659d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:14.968305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cefba-6489-457b-a43b-b2d6fd4659d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:14.969892 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b18cefba-6489-457b-a43b-b2d6fd4659d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:15.018262 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:15.059830 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18cefba-6489-457b-a43b-b2d6fd4659d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:15.061407 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18cefba-6489-457b-a43b-b2d6fd4659d5 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:15.079125 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 720/1428] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:15.881717 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a0ed-4493-47d4-918f-37fd897dfa69 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:15.882241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a0ed-4493-47d4-918f-37fd897dfa69 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:15.882350 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a0ed-4493-47d4-918f-37fd897dfa69 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:15.883678 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:15.888494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f441232-0798-46b4-a518-3aedcebc16dd None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:15.889005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f441232-0798-46b4-a518-3aedcebc16dd None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:15.889005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f441232-0798-46b4-a518-3aedcebc16dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:15.967082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1f441232-0798-46b4-a518-3aedcebc16dd None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:15.968296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1f441232-0798-46b4-a518-3aedcebc16dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:16.064267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:16.215322 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773a0ed-4493-47d4-918f-37fd897dfa69 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:16.216741 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1773a0ed-4493-47d4-918f-37fd897dfa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:16.264557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:16.361212 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773a0ed-4493-47d4-918f-37fd897dfa69 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:16.471483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943b280-0ef1-4be4-9084-3c87b5d0a75c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:16.472013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943b280-0ef1-4be4-9084-3c87b5d0a75c service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:16.472287 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943b280-0ef1-4be4-9084-3c87b5d0a75c service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:16.473085 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943b280-0ef1-4be4-9084-3c87b5d0a75c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:16.474691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c943b280-0ef1-4be4-9084-3c87b5d0a75c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:16.483337 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:16.564469 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943b280-0ef1-4be4-9084-3c87b5d0a75c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:16.566071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943b280-0ef1-4be4-9084-3c87b5d0a75c service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:16.584906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 710/1431] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:17.383550 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad70d63-291b-4155-8e7f-bc1967a0063f None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:17.384111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad70d63-291b-4155-8e7f-bc1967a0063f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:17.384111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad70d63-291b-4155-8e7f-bc1967a0063f None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:17.385385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:17.390163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f158d7a-6da6-4a8a-ac74-c8f0a9b1032d None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:17.390595 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f158d7a-6da6-4a8a-ac74-c8f0a9b1032d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:17.390736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f158d7a-6da6-4a8a-ac74-c8f0a9b1032d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:17.466115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-7f158d7a-6da6-4a8a-ac74-c8f0a9b1032d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:17.467420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7f158d7a-6da6-4a8a-ac74-c8f0a9b1032d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:17.535333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:17.563997 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:17.712833 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad70d63-291b-4155-8e7f-bc1967a0063f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:17.714391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8ad70d63-291b-4155-8e7f-bc1967a0063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:17.731779 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:17.856893 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad70d63-291b-4155-8e7f-bc1967a0063f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:17.942511 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:17.968014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c132e-1017-41cc-9194-d12c43667cd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:17.968617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c132e-1017-41cc-9194-d12c43667cd2 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:17.968895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c132e-1017-41cc-9194-d12c43667cd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:17.969165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c132e-1017-41cc-9194-d12c43667cd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:17.970799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-949c132e-1017-41cc-9194-d12c43667cd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:18.058116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c132e-1017-41cc-9194-d12c43667cd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:18.059733 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c132e-1017-41cc-9194-d12c43667cd2 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:18.077824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 723/1434] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:18.884733 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3ebcf-3f00-4f9b-844a-db763cd1455b None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:18.885199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3ebcf-3f00-4f9b-844a-db763cd1455b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:18.885310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3ebcf-3f00-4f9b-844a-db763cd1455b None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:18.886660 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:18.891657 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46637a-819a-49b5-8084-2ed925ae8ca5 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:18.892089 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46637a-819a-49b5-8084-2ed925ae8ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:18.892197 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46637a-819a-49b5-8084-2ed925ae8ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:18.966851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4b46637a-819a-49b5-8084-2ed925ae8ca5 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:18.968049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4b46637a-819a-49b5-8084-2ed925ae8ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:19.011038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:19.071598 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:19.222927 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3ebcf-3f00-4f9b-844a-db763cd1455b None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:19.224358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0ba3ebcf-3f00-4f9b-844a-db763cd1455b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:19.372315 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3ebcf-3f00-4f9b-844a-db763cd1455b None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:19.427089 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:19.488647 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed3461-3032-4763-9d88-d2402914898b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:19.489181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed3461-3032-4763-9d88-d2402914898b service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:19.489453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed3461-3032-4763-9d88-d2402914898b service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:19.489718 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed3461-3032-4763-9d88-d2402914898b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:19.491319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-84ed3461-3032-4763-9d88-d2402914898b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:19.577951 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed3461-3032-4763-9d88-d2402914898b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:19.579565 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed3461-3032-4763-9d88-d2402914898b service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:19.597788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 713/1437] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:20.392429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f64d61-0fff-4869-8071-1baddc70cd94 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:20.392978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f64d61-0fff-4869-8071-1baddc70cd94 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:20.392978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f64d61-0fff-4869-8071-1baddc70cd94 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:20.394320 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:20.399616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f10150-09bb-4d8e-95b5-573051e89b51 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:20.400053 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f10150-09bb-4d8e-95b5-573051e89b51 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:20.400163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f10150-09bb-4d8e-95b5-573051e89b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:20.474756 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-a9f10150-09bb-4d8e-95b5-573051e89b51 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:20.475935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a9f10150-09bb-4d8e-95b5-573051e89b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:20.477904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:20.569932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:20.720749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f64d61-0fff-4869-8071-1baddc70cd94 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:20.722299 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b9f64d61-0fff-4869-8071-1baddc70cd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:20.868734 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f64d61-0fff-4869-8071-1baddc70cd94 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:20.895082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:20.979889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6c418-2c85-4d8b-a0f2-914c6dcd450f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:20.980488 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6c418-2c85-4d8b-a0f2-914c6dcd450f service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:20.980765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6c418-2c85-4d8b-a0f2-914c6dcd450f service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:20.981035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6c418-2c85-4d8b-a0f2-914c6dcd450f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:20.982647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-dca6c418-2c85-4d8b-a0f2-914c6dcd450f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:21.075486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6c418-2c85-4d8b-a0f2-914c6dcd450f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:21.077097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6c418-2c85-4d8b-a0f2-914c6dcd450f service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:21.095823 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 726/1440] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:22.877682 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ee8f7-c30d-4e4a-94f7-20e006018fe0 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:22.878213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ee8f7-c30d-4e4a-94f7-20e006018fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:22.878213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ee8f7-c30d-4e4a-94f7-20e006018fe0 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:22.879542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:22.884843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61d804-dc70-4585-a37b-a9f8d7982062 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:22.885243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61d804-dc70-4585-a37b-a9f8d7982062 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:22.885386 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61d804-dc70-4585-a37b-a9f8d7982062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:22.927995 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:22.956102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4c61d804-dc70-4585-a37b-a9f8d7982062 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:22.957347 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4c61d804-dc70-4585-a37b-a9f8d7982062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:23.057667 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:23.345955 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ee8f7-c30d-4e4a-94f7-20e006018fe0 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:23.347575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-3c4ee8f7-c30d-4e4a-94f7-20e006018fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:23.458636 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ee8f7-c30d-4e4a-94f7-20e006018fe0 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:23.490031 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:23.532137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5f062-eb74-43ad-8913-48877ba1c1dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:23.532731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5f062-eb74-43ad-8913-48877ba1c1dd service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:23.533005 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5f062-eb74-43ad-8913-48877ba1c1dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:23.533271 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5f062-eb74-43ad-8913-48877ba1c1dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:23.534872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e5e5f062-eb74-43ad-8913-48877ba1c1dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:23.641823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5f062-eb74-43ad-8913-48877ba1c1dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:23.643307 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5f062-eb74-43ad-8913-48877ba1c1dd service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:23.662333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 716/1443] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:25.716101 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bb817-090b-403f-b013-45573fe85ccd None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:25.716570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bb817-090b-403f-b013-45573fe85ccd None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:25.716685 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bb817-090b-403f-b013-45573fe85ccd None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:25.717997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:25.723409 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a602f-39dd-4893-97bc-f9e271f99cee None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:25.723788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a602f-39dd-4893-97bc-f9e271f99cee None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:25.723982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a602f-39dd-4893-97bc-f9e271f99cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:25.788360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-ff1a602f-39dd-4893-97bc-f9e271f99cee None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:25.789549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ff1a602f-39dd-4893-97bc-f9e271f99cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:25.801922 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:25.883434 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:26.162891 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bb817-090b-403f-b013-45573fe85ccd None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:26.164471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ac3bb817-090b-403f-b013-45573fe85ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:26.265430 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bb817-090b-403f-b013-45573fe85ccd None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:26.277789 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:26.338590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019252c-f936-4a77-b624-7e33c31f73ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:26.339210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019252c-f936-4a77-b624-7e33c31f73ed service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:26.339489 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019252c-f936-4a77-b624-7e33c31f73ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:26.339755 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019252c-f936-4a77-b624-7e33c31f73ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:26.341343 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0019252c-f936-4a77-b624-7e33c31f73ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:26.450875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019252c-f936-4a77-b624-7e33c31f73ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:26.452246 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019252c-f936-4a77-b624-7e33c31f73ed service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:26.471226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 729/1446] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:28.696807 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d562ff5-b042-457b-9ddf-69cca3f1b1c2 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:28.697363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d562ff5-b042-457b-9ddf-69cca3f1b1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:28.697363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d562ff5-b042-457b-9ddf-69cca3f1b1c2 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:28.698737 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:28.704231 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc86abb-924f-4ab7-b059-02b56832ea65 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:28.704672 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc86abb-924f-4ab7-b059-02b56832ea65 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:28.704769 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc86abb-924f-4ab7-b059-02b56832ea65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:28.751707 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:28.770066 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1fc86abb-924f-4ab7-b059-02b56832ea65 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:28.771300 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1fc86abb-924f-4ab7-b059-02b56832ea65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:28.866997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:29.153868 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d562ff5-b042-457b-9ddf-69cca3f1b1c2 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:29.155449 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-3d562ff5-b042-457b-9ddf-69cca3f1b1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:29.258820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d562ff5-b042-457b-9ddf-69cca3f1b1c2 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:29.299066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:29.333582 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6cc17-14dd-4b17-8618-252d82a708e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:29.334179 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6cc17-14dd-4b17-8618-252d82a708e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:29.334456 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6cc17-14dd-4b17-8618-252d82a708e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:29.334757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6cc17-14dd-4b17-8618-252d82a708e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:29.336336 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-98a6cc17-14dd-4b17-8618-252d82a708e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:29.444620 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6cc17-14dd-4b17-8618-252d82a708e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:29.445943 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6cc17-14dd-4b17-8618-252d82a708e3 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:29.464758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 719/1449] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:31.491298 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7da52-cd15-4ffc-880b-415eb087f7e3 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:31.491863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7da52-cd15-4ffc-880b-415eb087f7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:31.491863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7da52-cd15-4ffc-880b-415eb087f7e3 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:31.493198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:31.498664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0dec4-9103-43ad-8b1a-a1670603787d None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:31.499089 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0dec4-9103-43ad-8b1a-a1670603787d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:31.499204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0dec4-9103-43ad-8b1a-a1670603787d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:31.573839 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-e1f0dec4-9103-43ad-8b1a-a1670603787d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:31.575071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e1f0dec4-9103-43ad-8b1a-a1670603787d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:31.595343 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:31.670733 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:31.952935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7da52-cd15-4ffc-880b-415eb087f7e3 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:31.954468 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-29d7da52-cd15-4ffc-880b-415eb087f7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:32.058931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7da52-cd15-4ffc-880b-415eb087f7e3 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:32.078177 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:32.133669 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7b052-c009-4a0c-ab6c-bf90f94f29c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:32.134279 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7b052-c009-4a0c-ab6c-bf90f94f29c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:32.134557 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7b052-c009-4a0c-ab6c-bf90f94f29c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:32.134872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7b052-c009-4a0c-ab6c-bf90f94f29c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:32.136466 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-30c7b052-c009-4a0c-ab6c-bf90f94f29c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:32.243611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7b052-c009-4a0c-ab6c-bf90f94f29c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:32.244939 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7b052-c009-4a0c-ab6c-bf90f94f29c3 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:32.262805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 732/1452] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:34.206440 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc7bf8-79ee-408d-9b2d-e3c66d01612a None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:34.207073 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc7bf8-79ee-408d-9b2d-e3c66d01612a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:34.207073 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc7bf8-79ee-408d-9b2d-e3c66d01612a None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:34.208686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:34.213860 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415111a-ac8c-4a1d-9b7e-8f3c6e8fff28 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:34.214270 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415111a-ac8c-4a1d-9b7e-8f3c6e8fff28 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:34.214410 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415111a-ac8c-4a1d-9b7e-8f3c6e8fff28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:34.278007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:34.280976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-0415111a-ac8c-4a1d-9b7e-8f3c6e8fff28 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:34.283303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0415111a-ac8c-4a1d-9b7e-8f3c6e8fff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:34.379903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:26:34.668999 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc7bf8-79ee-408d-9b2d-e3c66d01612a None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:34.670540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-9ddc7bf8-79ee-408d-9b2d-e3c66d01612a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:34.774397 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc7bf8-79ee-408d-9b2d-e3c66d01612a None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:34.821229 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:34.845505 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9923cd4-fccb-4cf8-bd1b-936e0bb63500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:34.846096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9923cd4-fccb-4cf8-bd1b-936e0bb63500 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:34.846363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9923cd4-fccb-4cf8-bd1b-936e0bb63500 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:34.846649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9923cd4-fccb-4cf8-bd1b-936e0bb63500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:34.848242 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a9923cd4-fccb-4cf8-bd1b-936e0bb63500 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:34.959147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9923cd4-fccb-4cf8-bd1b-936e0bb63500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:34.960525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9923cd4-fccb-4cf8-bd1b-936e0bb63500 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:34.978899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 722/1455] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:36.946877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fb0fa-b368-4cb0-afb0-faf6fb172112 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:36.947409 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fb0fa-b368-4cb0-afb0-faf6fb172112 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:36.947409 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fb0fa-b368-4cb0-afb0-faf6fb172112 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:36.948677 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:36.953997 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeff6b-a273-4ea5-9a61-23753b0ae60c None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:36.954387 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeff6b-a273-4ea5-9a61-23753b0ae60c None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:36.954556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeff6b-a273-4ea5-9a61-23753b0ae60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:37.020047 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-abbeff6b-a273-4ea5-9a61-23753b0ae60c None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:37.021252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-abbeff6b-a273-4ea5-9a61-23753b0ae60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:37.049767 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:37.117335 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:37.403832 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fb0fa-b368-4cb0-afb0-faf6fb172112 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:37.405497 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e63fb0fa-b368-4cb0-afb0-faf6fb172112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:37.508675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fb0fa-b368-4cb0-afb0-faf6fb172112 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:37.537259 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:37.581803 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0c5c0-beba-47dc-a25c-919d815bb7fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:37.582921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0c5c0-beba-47dc-a25c-919d815bb7fc service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:37.583205 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0c5c0-beba-47dc-a25c-919d815bb7fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:37.583732 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0c5c0-beba-47dc-a25c-919d815bb7fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:37.585328 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7ce0c5c0-beba-47dc-a25c-919d815bb7fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:37.693320 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0c5c0-beba-47dc-a25c-919d815bb7fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:37.694853 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0c5c0-beba-47dc-a25c-919d815bb7fc service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:37.713192 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 735/1458] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:39.658266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00bc75-7685-43ea-804d-912efc44cee1 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:39.658809 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00bc75-7685-43ea-804d-912efc44cee1 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:39.658911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00bc75-7685-43ea-804d-912efc44cee1 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:39.660790 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:39.666083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac521951-667e-480f-a716-31f455e71df2 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:39.666517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac521951-667e-480f-a716-31f455e71df2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:39.666645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac521951-667e-480f-a716-31f455e71df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:39.731318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ac521951-667e-480f-a716-31f455e71df2 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:39.732517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ac521951-667e-480f-a716-31f455e71df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:39.740621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:39.827533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:40.108189 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00bc75-7685-43ea-804d-912efc44cee1 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:40.109727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2f00bc75-7685-43ea-804d-912efc44cee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:40.211314 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00bc75-7685-43ea-804d-912efc44cee1 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:40.265056 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:40.282806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6705ee-e43e-4965-9cae-50609b502383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:40.283413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6705ee-e43e-4965-9cae-50609b502383 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:40.283689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6705ee-e43e-4965-9cae-50609b502383 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:40.283964 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6705ee-e43e-4965-9cae-50609b502383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:40.286079 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-bd6705ee-e43e-4965-9cae-50609b502383 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:40.392978 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6705ee-e43e-4965-9cae-50609b502383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:40.394336 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6705ee-e43e-4965-9cae-50609b502383 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:40.414395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 725/1461] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:42.371212 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b1616-5bbb-4b88-b09a-6a4259c46a9b None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:42.371757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b1616-5bbb-4b88-b09a-6a4259c46a9b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:42.371757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b1616-5bbb-4b88-b09a-6a4259c46a9b None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:42.373121 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:42.378243 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088c11a-5b57-41bb-a129-22f10fa90c90 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:42.378710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088c11a-5b57-41bb-a129-22f10fa90c90 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:42.378824 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088c11a-5b57-41bb-a129-22f10fa90c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:42.443461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-0088c11a-5b57-41bb-a129-22f10fa90c90 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:42.444656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0088c11a-5b57-41bb-a129-22f10fa90c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:42.482317 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:42.540143 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:42.826072 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b1616-5bbb-4b88-b09a-6a4259c46a9b None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:42.827630 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-113b1616-5bbb-4b88-b09a-6a4259c46a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:42.929570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b1616-5bbb-4b88-b09a-6a4259c46a9b None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:42.966490 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:43.002169 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da40b66-d285-4e70-b462-ada517796448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:43.002788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da40b66-d285-4e70-b462-ada517796448 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:43.003064 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da40b66-d285-4e70-b462-ada517796448 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:43.003327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da40b66-d285-4e70-b462-ada517796448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:43.005399 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6da40b66-d285-4e70-b462-ada517796448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:43.112122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da40b66-d285-4e70-b462-ada517796448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:43.113617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da40b66-d285-4e70-b462-ada517796448 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:43.132093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 738/1464] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:45.067192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da394119-870a-457f-8262-d32fa85a7f50 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:45.067722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da394119-870a-457f-8262-d32fa85a7f50 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:45.067722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da394119-870a-457f-8262-d32fa85a7f50 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:45.069101 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:45.074384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310593-0147-40db-a176-46c1f57e96b5 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:45.074811 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310593-0147-40db-a176-46c1f57e96b5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:45.074972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310593-0147-40db-a176-46c1f57e96b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:45.140172 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ee310593-0147-40db-a176-46c1f57e96b5 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:45.141376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ee310593-0147-40db-a176-46c1f57e96b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:45.159705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:45.238592 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:45.529415 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da394119-870a-457f-8262-d32fa85a7f50 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:45.531002 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-da394119-870a-457f-8262-d32fa85a7f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:45.635202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da394119-870a-457f-8262-d32fa85a7f50 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:45.702630 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:45.710159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b05558-32cb-4849-ab90-7cbc5c66e7fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:45.710803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b05558-32cb-4849-ab90-7cbc5c66e7fd service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:45.711094 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b05558-32cb-4849-ab90-7cbc5c66e7fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:45.711363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b05558-32cb-4849-ab90-7cbc5c66e7fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:45.712965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-38b05558-32cb-4849-ab90-7cbc5c66e7fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:45.821230 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b05558-32cb-4849-ab90-7cbc5c66e7fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:45.822658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b05558-32cb-4849-ab90-7cbc5c66e7fd service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:45.845545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 728/1467] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:47.745787 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00ef5a-4135-48dd-8310-918b50dd6cdd None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:47.746332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00ef5a-4135-48dd-8310-918b50dd6cdd None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:47.746332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00ef5a-4135-48dd-8310-918b50dd6cdd None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:47.747691 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:47.752881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf06a8d-0142-4b6a-8d15-98731043e464 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:47.753338 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf06a8d-0142-4b6a-8d15-98731043e464 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:47.753470 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf06a8d-0142-4b6a-8d15-98731043e464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:47.820887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-eaf06a8d-0142-4b6a-8d15-98731043e464 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:47.822098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-eaf06a8d-0142-4b6a-8d15-98731043e464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:47.870865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:47.919426 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:26:48.199376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00ef5a-4135-48dd-8310-918b50dd6cdd None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:48.200904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2b00ef5a-4135-48dd-8310-918b50dd6cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:48.303457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00ef5a-4135-48dd-8310-918b50dd6cdd None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:48.350323 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:48.376379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d0e66-c442-498e-9296-300b767974c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:48.376975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d0e66-c442-498e-9296-300b767974c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:48.377253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d0e66-c442-498e-9296-300b767974c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:48.377531 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d0e66-c442-498e-9296-300b767974c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:48.379648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-741d0e66-c442-498e-9296-300b767974c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:48.484622 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d0e66-c442-498e-9296-300b767974c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:48.485952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d0e66-c442-498e-9296-300b767974c3 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:48.503184 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 741/1470] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:57.917306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=22 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:58.500983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=66 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:08.038858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9eb06-bbb6-420e-a399-e92b13883762 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.039401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9eb06-bbb6-420e-a399-e92b13883762 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.039401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9eb06-bbb6-420e-a399-e92b13883762 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.040770 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 730/1471] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:08.046000 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fb4c8-12b8-4ce5-9fd0-93cca629f99d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.046397 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fb4c8-12b8-4ce5-9fd0-93cca629f99d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.046538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fb4c8-12b8-4ce5-9fd0-93cca629f99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.111517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-427fb4c8-12b8-4ce5-9fd0-93cca629f99d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:08.112709 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-427fb4c8-12b8-4ce5-9fd0-93cca629f99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:08.207513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 742/1472] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:08.506742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0f722-f519-411e-ae89-205a50a0b08a None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.507049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0f722-f519-411e-ae89-205a50a0b08a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.507326 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0f722-f519-411e-ae89-205a50a0b08a None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.508658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 731/1473] 10.222.0.71 () {54 vars in 967 bytes} [Thu Sep 1 16:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:08.513335 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d625-7bb2-4d74-9e0e-74f3364ddfb9 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.513622 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d625-7bb2-4d74-9e0e-74f3364ddfb9 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.513898 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d625-7bb2-4d74-9e0e-74f3364ddfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.587418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f5f2d625-7bb2-4d74-9e0e-74f3364ddfb9 None None] MFA Rules not processed for user `b11356a5e3d041729f71515482033dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:08.588605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f5f2d625-7bb2-4d74-9e0e-74f3364ddfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:08.609561 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:08.664410 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 743/1474] 10.222.0.71 () {58 vars in 1064 bytes} [Thu Sep 1 16:27:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:08.671899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0f722-f519-411e-ae89-205a50a0b08a None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:08.673444 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-bdc0f722-f519-411e-ae89-205a50a0b08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:08.776234 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0f722-f519-411e-ae89-205a50a0b08a None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:08.846820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335682a-06d9-4e16-ab79-4661afa35f69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11356a5e3d041729f71515482033dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:08.847407 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335682a-06d9-4e16-ab79-4661afa35f69 service glance] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.848229 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335682a-06d9-4e16-ab79-4661afa35f69 service glance] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.848500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335682a-06d9-4e16-ab79-4661afa35f69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.850068 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7335682a-06d9-4e16-ab79-4661afa35f69 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:08.902819 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:08.956833 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335682a-06d9-4e16-ab79-4661afa35f69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:08.958801 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335682a-06d9-4e16-ab79-4661afa35f69 service glance] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:08.977628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 732/1475] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:10.965461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521aacd-54a3-4620-8a12-e0db3ecf64f8 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:10.965998 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521aacd-54a3-4620-8a12-e0db3ecf64f8 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:10.965998 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521aacd-54a3-4620-8a12-e0db3ecf64f8 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:10.967288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 744/1476] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:10.972491 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f9fe6-2024-48a5-8a47-6ad47a8231f9 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:10.973424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f9fe6-2024-48a5-8a47-6ad47a8231f9 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:10.973530 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f9fe6-2024-48a5-8a47-6ad47a8231f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:11.039772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-548f9fe6-2024-48a5-8a47-6ad47a8231f9 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:11.040980 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-548f9fe6-2024-48a5-8a47-6ad47a8231f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:11.135558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 733/1477] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:11.417158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521aacd-54a3-4620-8a12-e0db3ecf64f8 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:11.418734 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4521aacd-54a3-4620-8a12-e0db3ecf64f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:11.545708 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521aacd-54a3-4620-8a12-e0db3ecf64f8 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:11.593913 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:11.641336 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa51c37-9c83-467f-a6a1-281934b4be35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:11.641942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa51c37-9c83-467f-a6a1-281934b4be35 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:11.642219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa51c37-9c83-467f-a6a1-281934b4be35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:11.642486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa51c37-9c83-467f-a6a1-281934b4be35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:11.643166 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa51c37-9c83-467f-a6a1-281934b4be35 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:11.644954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: WARNING py.warnings [None req-8fa51c37-9c83-467f-a6a1-281934b4be35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:27:11.644954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: warnings.warn(msg) Sep 01 16:27:11.644954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: Sep 01 16:27:11.646089 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa51c37-9c83-467f-a6a1-281934b4be35 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:11.664912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 745/1478] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:11 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:27:13.578513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072a81-4bc6-4d50-8d0d-7d6a7e6a4ab1 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:13.579125 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072a81-4bc6-4d50-8d0d-7d6a7e6a4ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:13.579125 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072a81-4bc6-4d50-8d0d-7d6a7e6a4ab1 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:13.580427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 734/1479] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:13.585914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e3b77-ddc6-4d33-89f3-378b59e82b8a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:13.586350 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e3b77-ddc6-4d33-89f3-378b59e82b8a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:13.586466 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e3b77-ddc6-4d33-89f3-378b59e82b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:13.651020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8a3e3b77-ddc6-4d33-89f3-378b59e82b8a None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:13.652224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8a3e3b77-ddc6-4d33-89f3-378b59e82b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:13.747376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 746/1480] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:14.050066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1072a81-4bc6-4d50-8d0d-7d6a7e6a4ab1 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:14.051977 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a1072a81-4bc6-4d50-8d0d-7d6a7e6a4ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:14.061873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:14.197505 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1072a81-4bc6-4d50-8d0d-7d6a7e6a4ab1 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:14.278272 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:14.313555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd619b2-2e04-4ddf-a19f-055db8cec5d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:14.314064 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd619b2-2e04-4ddf-a19f-055db8cec5d5 service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:14.314335 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd619b2-2e04-4ddf-a19f-055db8cec5d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:14.314602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd619b2-2e04-4ddf-a19f-055db8cec5d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:14.316205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-bfd619b2-2e04-4ddf-a19f-055db8cec5d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:14.407763 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd619b2-2e04-4ddf-a19f-055db8cec5d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:14.409348 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd619b2-2e04-4ddf-a19f-055db8cec5d5 service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:14.427863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 735/1481] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:16.496668 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690c162-4537-4b22-bfe3-b217e61081be None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:16.497263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690c162-4537-4b22-bfe3-b217e61081be None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:16.497263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690c162-4537-4b22-bfe3-b217e61081be None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:16.498573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 747/1482] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:16.503644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabce56-e79c-4531-bc9f-f0ea02efbb2b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:16.504613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabce56-e79c-4531-bc9f-f0ea02efbb2b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:16.504754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabce56-e79c-4531-bc9f-f0ea02efbb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:16.569257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-6eabce56-e79c-4531-bc9f-f0ea02efbb2b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:16.570468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6eabce56-e79c-4531-bc9f-f0ea02efbb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:16.617645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:16.669580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 736/1483] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:16.955885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690c162-4537-4b22-bfe3-b217e61081be None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:16.957978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e690c162-4537-4b22-bfe3-b217e61081be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:16.980986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:17.063971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690c162-4537-4b22-bfe3-b217e61081be None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:17.141113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3f621-a031-4bea-9b83-4e17bec269a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:17.141844 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3f621-a031-4bea-9b83-4e17bec269a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:17.141992 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3f621-a031-4bea-9b83-4e17bec269a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:17.142268 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3f621-a031-4bea-9b83-4e17bec269a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:17.143900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6db3f621-a031-4bea-9b83-4e17bec269a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:17.216499 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:17.250725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3f621-a031-4bea-9b83-4e17bec269a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:17.252153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3f621-a031-4bea-9b83-4e17bec269a1 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:17.272205 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 748/1484] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:19.253318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037e36f-f90a-4d7b-a9b7-7c9eb1842f50 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:19.254421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037e36f-f90a-4d7b-a9b7-7c9eb1842f50 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:19.254421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037e36f-f90a-4d7b-a9b7-7c9eb1842f50 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:19.255759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 737/1485] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:19.260986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dcd30-7c14-4c8a-bcb1-45c40d891d58 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:19.261459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dcd30-7c14-4c8a-bcb1-45c40d891d58 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:19.261459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dcd30-7c14-4c8a-bcb1-45c40d891d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:19.324918 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7f6dcd30-7c14-4c8a-bcb1-45c40d891d58 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:19.326104 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7f6dcd30-7c14-4c8a-bcb1-45c40d891d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:19.418819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 749/1486] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:19.709985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037e36f-f90a-4d7b-a9b7-7c9eb1842f50 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:19.711674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a037e36f-f90a-4d7b-a9b7-7c9eb1842f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:19.815401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037e36f-f90a-4d7b-a9b7-7c9eb1842f50 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:19.886282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:19.888061 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809e156-1d7b-419f-965e-eb7018e8d286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:19.888681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809e156-1d7b-419f-965e-eb7018e8d286 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:19.889155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809e156-1d7b-419f-965e-eb7018e8d286 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:19.889588 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809e156-1d7b-419f-965e-eb7018e8d286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:19.891384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2809e156-1d7b-419f-965e-eb7018e8d286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:19.999648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809e156-1d7b-419f-965e-eb7018e8d286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:20.001069 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809e156-1d7b-419f-965e-eb7018e8d286 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:20.019245 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 738/1487] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:22.087182 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893ddd0-81bc-4e0b-86ba-99d2849f2455 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:22.087751 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893ddd0-81bc-4e0b-86ba-99d2849f2455 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:22.087751 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893ddd0-81bc-4e0b-86ba-99d2849f2455 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:22.089153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 750/1488] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:22.094361 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255c7a8-e185-41bc-9f5d-ea54830746f2 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:22.094788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255c7a8-e185-41bc-9f5d-ea54830746f2 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:22.094962 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255c7a8-e185-41bc-9f5d-ea54830746f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:22.166636 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-6255c7a8-e185-41bc-9f5d-ea54830746f2 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:22.167859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6255c7a8-e185-41bc-9f5d-ea54830746f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:22.221180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:22.265298 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 739/1489] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:22.553352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893ddd0-81bc-4e0b-86ba-99d2849f2455 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:22.554971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2893ddd0-81bc-4e0b-86ba-99d2849f2455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:22.590218 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:22.656675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893ddd0-81bc-4e0b-86ba-99d2849f2455 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:22.729683 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34115bfe-de86-4bbf-ad0c-ed4a2944b7b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:22.730286 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34115bfe-de86-4bbf-ad0c-ed4a2944b7b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:22.730566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34115bfe-de86-4bbf-ad0c-ed4a2944b7b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:22.730868 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34115bfe-de86-4bbf-ad0c-ed4a2944b7b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:22.732470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-34115bfe-de86-4bbf-ad0c-ed4a2944b7b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:22.813502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:22.842726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34115bfe-de86-4bbf-ad0c-ed4a2944b7b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:22.844139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34115bfe-de86-4bbf-ad0c-ed4a2944b7b2 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:22.861443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 751/1490] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:24.945620 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b87a32-b986-463f-a730-78df3e489d23 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:24.946147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b87a32-b986-463f-a730-78df3e489d23 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:24.946147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b87a32-b986-463f-a730-78df3e489d23 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:24.947463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 740/1491] 10.222.0.71 () {54 vars in 927 bytes} [Thu Sep 1 16:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:24.952626 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a5951-2502-4da3-b0ad-bca18f194c01 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:24.953074 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a5951-2502-4da3-b0ad-bca18f194c01 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:24.953181 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a5951-2502-4da3-b0ad-bca18f194c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:25.020329 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-398a5951-2502-4da3-b0ad-bca18f194c01 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:25.021537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-398a5951-2502-4da3-b0ad-bca18f194c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:25.242465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 752/1492] 10.222.0.71 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:25.542937 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b87a32-b986-463f-a730-78df3e489d23 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:25.544464 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-89b87a32-b986-463f-a730-78df3e489d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:25.647213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b87a32-b986-463f-a730-78df3e489d23 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:25.719269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549932c-3617-4720-9afb-16ecd8314f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:25.719869 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549932c-3617-4720-9afb-16ecd8314f1d service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:25.720147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549932c-3617-4720-9afb-16ecd8314f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:25.720414 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549932c-3617-4720-9afb-16ecd8314f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:25.721995 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f549932c-3617-4720-9afb-16ecd8314f1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:25.732568 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:25.831259 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549932c-3617-4720-9afb-16ecd8314f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:25.833170 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549932c-3617-4720-9afb-16ecd8314f1d service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:25.851403 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 741/1493] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:35.240610 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=82 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:35.848953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=50 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:38.018993 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17feb142-0490-4146-97d9-ce265ce5aa83 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:38.019568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17feb142-0490-4146-97d9-ce265ce5aa83 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:38.019568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17feb142-0490-4146-97d9-ce265ce5aa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:38.093587 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-17feb142-0490-4146-97d9-ce265ce5aa83 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:38.094822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-17feb142-0490-4146-97d9-ce265ce5aa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:38.189923 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 753/1494] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:38.198019 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5a2e1-a534-422a-bf77-32afceb5b3f1 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:38.198530 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5a2e1-a534-422a-bf77-32afceb5b3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:38.198679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5a2e1-a534-422a-bf77-32afceb5b3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:38.276456 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-2dd5a2e1-a534-422a-bf77-32afceb5b3f1 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:38.277598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2dd5a2e1-a534-422a-bf77-32afceb5b3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:38.372366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 742/1495] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:38.376928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17feb142-0490-4146-97d9-ce265ce5aa83 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:38.378154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-17feb142-0490-4146-97d9-ce265ce5aa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:38.389268 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17feb142-0490-4146-97d9-ce265ce5aa83 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:38.449363 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:38.483209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9a330-da74-4b34-9fd0-6b927114a4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:38.483806 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9a330-da74-4b34-9fd0-6b927114a4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:38.484088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9a330-da74-4b34-9fd0-6b927114a4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:38.484361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9a330-da74-4b34-9fd0-6b927114a4a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:38.485003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9a330-da74-4b34-9fd0-6b927114a4a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:28:38.485306 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9a330-da74-4b34-9fd0-6b927114a4a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:38.486303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: WARNING py.warnings [None req-9ff9a330-da74-4b34-9fd0-6b927114a4a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:28:38.486303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: warnings.warn(msg) Sep 01 16:28:38.486303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: Sep 01 16:28:38.487204 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9a330-da74-4b34-9fd0-6b927114a4a2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:38.498466 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 754/1496] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:38.507165 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5a2e1-a534-422a-bf77-32afceb5b3f1 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:38.516038 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5a2e1-a534-422a-bf77-32afceb5b3f1 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:38.576773 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:38.610068 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e0b93-816f-4f8e-bbd2-f06245229a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:38.610687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e0b93-816f-4f8e-bbd2-f06245229a8d admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:38.610962 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e0b93-816f-4f8e-bbd2-f06245229a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:38.611226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e0b93-816f-4f8e-bbd2-f06245229a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:38.611846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e0b93-816f-4f8e-bbd2-f06245229a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:38.614104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: WARNING py.warnings [None req-033e0b93-816f-4f8e-bbd2-f06245229a8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:28:38.614104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: warnings.warn(msg) Sep 01 16:28:38.614104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: Sep 01 16:28:38.615312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e0b93-816f-4f8e-bbd2-f06245229a8d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:38.670674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 743/1497] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:28:38 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:28:38.674745 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9a330-da74-4b34-9fd0-6b927114a4a2 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:38.676811 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9ff9a330-da74-4b34-9fd0-6b927114a4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:38.709399 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9a330-da74-4b34-9fd0-6b927114a4a2 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:38.801717 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bf518-a457-42d2-bd7c-39ee177edb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:38.802302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bf518-a457-42d2-bd7c-39ee177edb2a admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:38.802577 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bf518-a457-42d2-bd7c-39ee177edb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:38.802871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bf518-a457-42d2-bd7c-39ee177edb2a admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:38.803486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bf518-a457-42d2-bd7c-39ee177edb2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:38.804474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: WARNING py.warnings [None req-c28bf518-a457-42d2-bd7c-39ee177edb2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:28:38.804474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: warnings.warn(msg) Sep 01 16:28:38.804474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: Sep 01 16:28:38.805649 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bf518-a457-42d2-bd7c-39ee177edb2a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:38.859677 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 755/1498] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:28:38 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:28:38.864370 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e0b93-816f-4f8e-bbd2-f06245229a8d admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:38.865893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-033e0b93-816f-4f8e-bbd2-f06245229a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:38.928809 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e0b93-816f-4f8e-bbd2-f06245229a8d admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:39.013797 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:39.025736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217ad8d-1441-464f-badb-5751b566bbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:39.026336 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217ad8d-1441-464f-badb-5751b566bbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:39.026629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217ad8d-1441-464f-badb-5751b566bbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:39.026910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217ad8d-1441-464f-badb-5751b566bbb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:39.027540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217ad8d-1441-464f-badb-5751b566bbb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:39.028535 dv-cinder-852208-16-smb devstack@keystone.service[81498]: WARNING py.warnings [None req-1217ad8d-1441-464f-badb-5751b566bbb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:28:39.028535 dv-cinder-852208-16-smb devstack@keystone.service[81498]: warnings.warn(msg) Sep 01 16:28:39.028535 dv-cinder-852208-16-smb devstack@keystone.service[81498]: Sep 01 16:28:39.029408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217ad8d-1441-464f-badb-5751b566bbb2 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:39.041958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 744/1499] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:28:39.046126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bf518-a457-42d2-bd7c-39ee177edb2a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:39.047722 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c28bf518-a457-42d2-bd7c-39ee177edb2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:39.059169 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bf518-a457-42d2-bd7c-39ee177edb2a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:39.084075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:39.152729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957acc8-6093-4a91-9982-1db95809762d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:39.153249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957acc8-6093-4a91-9982-1db95809762d admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:39.153525 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957acc8-6093-4a91-9982-1db95809762d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:39.153794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957acc8-6093-4a91-9982-1db95809762d admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:39.154433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957acc8-6093-4a91-9982-1db95809762d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:39.155469 dv-cinder-852208-16-smb devstack@keystone.service[81497]: WARNING py.warnings [None req-4957acc8-6093-4a91-9982-1db95809762d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:28:39.155469 dv-cinder-852208-16-smb devstack@keystone.service[81497]: warnings.warn(msg) Sep 01 16:28:39.155469 dv-cinder-852208-16-smb devstack@keystone.service[81497]: Sep 01 16:28:39.156339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957acc8-6093-4a91-9982-1db95809762d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:39.168921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 756/1500] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:28:39.173254 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217ad8d-1441-464f-badb-5751b566bbb2 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:39.174836 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1217ad8d-1441-464f-badb-5751b566bbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:39.208700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217ad8d-1441-464f-badb-5751b566bbb2 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:39.307384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53d538-9626-4ae2-a1a9-9ee255e7253b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:39.308041 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53d538-9626-4ae2-a1a9-9ee255e7253b admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:39.308322 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53d538-9626-4ae2-a1a9-9ee255e7253b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:39.308597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53d538-9626-4ae2-a1a9-9ee255e7253b admin admin] PATH_INFO: `/v3/projects/c27c5c96a32949e588dc9c1f92e12b8b/users/d3992f40dab94ef7bd58cdc25181832b/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:39.330633 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53d538-9626-4ae2-a1a9-9ee255e7253b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27c5c96a32949e588dc9c1f92e12b8b, user_id=d3992f40dab94ef7bd58cdc25181832b, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:39.332227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: WARNING py.warnings [None req-ac53d538-9626-4ae2-a1a9-9ee255e7253b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:28:39.332227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: warnings.warn(msg) Sep 01 16:28:39.332227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: Sep 01 16:28:39.334135 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53d538-9626-4ae2-a1a9-9ee255e7253b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:39.357893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 745/1501] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:28:39 2022] PUT /identity/v3/projects/c27c5c96a32949e588dc9c1f92e12b8b/users/d3992f40dab94ef7bd58cdc25181832b/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:28:39.370314 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ae0b4-c816-46b7-81ea-c96a36eecdf4 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:39.370656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ae0b4-c816-46b7-81ea-c96a36eecdf4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:39.370937 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ae0b4-c816-46b7-81ea-c96a36eecdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:39.427659 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5c8ae0b4-c816-46b7-81ea-c96a36eecdf4 None None] MFA Rules not processed for user `d3992f40dab94ef7bd58cdc25181832b`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:39.428798 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5c8ae0b4-c816-46b7-81ea-c96a36eecdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:39.507268 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 757/1502] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:28:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:39.521377 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007998d-3fd9-4737-aa89-fe58d6197224 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:39.521664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007998d-3fd9-4737-aa89-fe58d6197224 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:39.521939 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007998d-3fd9-4737-aa89-fe58d6197224 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:39.523318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 746/1503] 10.222.0.71 () {54 vars in 964 bytes} [Thu Sep 1 16:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:39.528045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5b3a8-0130-406d-b9bf-8b1d93a90d7e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:39.528329 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5b3a8-0130-406d-b9bf-8b1d93a90d7e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:39.528598 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5b3a8-0130-406d-b9bf-8b1d93a90d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:39.559849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:39.602871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d8f5b3a8-0130-406d-b9bf-8b1d93a90d7e None None] MFA Rules not processed for user `5a0dece90fc54641be30cdc2ddad9cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:39.604067 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d8f5b3a8-0130-406d-b9bf-8b1d93a90d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:39.680616 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 758/1504] 10.222.0.71 () {58 vars in 1061 bytes} [Thu Sep 1 16:28:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:28:39.690028 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007998d-3fd9-4737-aa89-fe58d6197224 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:39.691720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2007998d-3fd9-4737-aa89-fe58d6197224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:39.742993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:39.799291 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007998d-3fd9-4737-aa89-fe58d6197224 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:39.871981 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76501bb3-c602-4bda-9b79-c396eeee7697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:39.872582 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76501bb3-c602-4bda-9b79-c396eeee7697 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:39.872949 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76501bb3-c602-4bda-9b79-c396eeee7697 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:39.873227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76501bb3-c602-4bda-9b79-c396eeee7697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:39.874849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-76501bb3-c602-4bda-9b79-c396eeee7697 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:39.971106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76501bb3-c602-4bda-9b79-c396eeee7697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:39.973031 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76501bb3-c602-4bda-9b79-c396eeee7697 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:39.976438 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:39.991061 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 747/1505] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:40.035741 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061f6b3-3825-43a5-a3db-f8cbebba06b1 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:40.036029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061f6b3-3825-43a5-a3db-f8cbebba06b1 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:40.036305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061f6b3-3825-43a5-a3db-f8cbebba06b1 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:40.037555 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 759/1506] 10.222.0.71 () {52 vars in 830 bytes} [Thu Sep 1 16:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:40.041234 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76501bb3-c602-4bda-9b79-c396eeee7697 service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:40.042420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-76501bb3-c602-4bda-9b79-c396eeee7697 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:40.139203 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76501bb3-c602-4bda-9b79-c396eeee7697 service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:40.232539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fa481-aae3-4378-a5ad-4a8bd412bb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:40.233167 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fa481-aae3-4378-a5ad-4a8bd412bb94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:40.233346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fa481-aae3-4378-a5ad-4a8bd412bb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:40.233621 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fa481-aae3-4378-a5ad-4a8bd412bb94 admin admin] PATH_INFO: `/v3/users/d3992f40dab94ef7bd58cdc25181832b` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:40.245580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fa481-aae3-4378-a5ad-4a8bd412bb94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3992f40dab94ef7bd58cdc25181832b)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:40.246593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: WARNING py.warnings [None req-749fa481-aae3-4378-a5ad-4a8bd412bb94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:28:40.246593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: warnings.warn(msg) Sep 01 16:28:40.246593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: Sep 01 16:28:40.247827 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fa481-aae3-4378-a5ad-4a8bd412bb94 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:40.257875 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:40.311884 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-749fa481-aae3-4378-a5ad-4a8bd412bb94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3992f40dab94ef7bd58cdc25181832b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:28:40.312310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-749fa481-aae3-4378-a5ad-4a8bd412bb94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3992f40dab94ef7bd58cdc25181832b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:28:40.336691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-749fa481-aae3-4378-a5ad-4a8bd412bb94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3992f40dab94ef7bd58cdc25181832b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:28:40.346077 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-749fa481-aae3-4378-a5ad-4a8bd412bb94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3992f40dab94ef7bd58cdc25181832b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:28:40.360065 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-749fa481-aae3-4378-a5ad-4a8bd412bb94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3992f40dab94ef7bd58cdc25181832b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:28:40.366210 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 748/1507] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:28:40 2022] DELETE /identity/v3/users/d3992f40dab94ef7bd58cdc25181832b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:28:40.370760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a81bff-ad0a-42b5-8696-212f717c9651 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:40.371231 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a81bff-ad0a-42b5-8696-212f717c9651 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:40.371363 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a81bff-ad0a-42b5-8696-212f717c9651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:40.427273 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-34a81bff-ad0a-42b5-8696-212f717c9651 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:40.428468 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-34a81bff-ad0a-42b5-8696-212f717c9651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:40.501780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:40.514651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 760/1508] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:40.525767 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fa481-aae3-4378-a5ad-4a8bd412bb94 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:40.527317 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-749fa481-aae3-4378-a5ad-4a8bd412bb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:40.626948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fa481-aae3-4378-a5ad-4a8bd412bb94 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:40.680763 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:40.700694 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6af65c-b5ba-49c7-927b-8634eccc68ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:40.701306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6af65c-b5ba-49c7-927b-8634eccc68ab service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:40.701583 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6af65c-b5ba-49c7-927b-8634eccc68ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:40.701847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6af65c-b5ba-49c7-927b-8634eccc68ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:40.703459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ec6af65c-b5ba-49c7-927b-8634eccc68ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:40.809585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6af65c-b5ba-49c7-927b-8634eccc68ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:40.811047 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6af65c-b5ba-49c7-927b-8634eccc68ab service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:40.836625 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 749/1509] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:41.187228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a81bff-ad0a-42b5-8696-212f717c9651 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:41.188569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-34a81bff-ad0a-42b5-8696-212f717c9651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:41.200337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a81bff-ad0a-42b5-8696-212f717c9651 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:41.299250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824c052-3811-4ccf-b2fb-b90e3fdeedf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:41.299876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824c052-3811-4ccf-b2fb-b90e3fdeedf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:41.300152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824c052-3811-4ccf-b2fb-b90e3fdeedf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:41.300420 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824c052-3811-4ccf-b2fb-b90e3fdeedf5 admin admin] PATH_INFO: `/v3/projects/c27c5c96a32949e588dc9c1f92e12b8b` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:41.310097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824c052-3811-4ccf-b2fb-b90e3fdeedf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c27c5c96a32949e588dc9c1f92e12b8b)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:41.311132 dv-cinder-852208-16-smb devstack@keystone.service[81497]: WARNING py.warnings [None req-c824c052-3811-4ccf-b2fb-b90e3fdeedf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:28:41.311132 dv-cinder-852208-16-smb devstack@keystone.service[81497]: warnings.warn(msg) Sep 01 16:28:41.311132 dv-cinder-852208-16-smb devstack@keystone.service[81497]: Sep 01 16:28:41.312314 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824c052-3811-4ccf-b2fb-b90e3fdeedf5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:41.368294 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c824c052-3811-4ccf-b2fb-b90e3fdeedf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c27c5c96a32949e588dc9c1f92e12b8b', 'request_id': 'req-c824c052-3811-4ccf-b2fb-b90e3fdeedf5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:28:41.381177 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c824c052-3811-4ccf-b2fb-b90e3fdeedf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c27c5c96a32949e588dc9c1f92e12b8b', 'request_id': 'req-c824c052-3811-4ccf-b2fb-b90e3fdeedf5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:28:41.387217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c824c052-3811-4ccf-b2fb-b90e3fdeedf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c27c5c96a32949e588dc9c1f92e12b8b', 'request_id': 'req-c824c052-3811-4ccf-b2fb-b90e3fdeedf5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:28:41.413518 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c824c052-3811-4ccf-b2fb-b90e3fdeedf5 admin admin] The token cache is being invalidate because project c27c5c96a32949e588dc9c1f92e12b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:28:41.413804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c824c052-3811-4ccf-b2fb-b90e3fdeedf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:28:41.414317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c824c052-3811-4ccf-b2fb-b90e3fdeedf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:28:41.415698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 761/1510] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:28:41 2022] DELETE /identity/v3/projects/c27c5c96a32949e588dc9c1f92e12b8b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:28:50.833729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=62 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:51.411513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:20.656526 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638afb-df28-4b18-8bee-35c64180c678 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:20.657087 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638afb-df28-4b18-8bee-35c64180c678 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:20.657195 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638afb-df28-4b18-8bee-35c64180c678 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:20.658515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:20.663584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082c75d-b64f-45be-84f7-c6b92345a3ba None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:20.664028 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082c75d-b64f-45be-84f7-c6b92345a3ba None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:20.664143 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082c75d-b64f-45be-84f7-c6b92345a3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:20.746632 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-0082c75d-b64f-45be-84f7-c6b92345a3ba None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:20.747837 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0082c75d-b64f-45be-84f7-c6b92345a3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:20.850312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:30:21.003250 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638afb-df28-4b18-8bee-35c64180c678 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:21.005615 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d0638afb-df28-4b18-8bee-35c64180c678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:21.125505 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638afb-df28-4b18-8bee-35c64180c678 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:21.131103 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666db9e-1f4b-467e-8925-489ed7861f9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:21.131706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666db9e-1f4b-467e-8925-489ed7861f9c service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:21.131982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666db9e-1f4b-467e-8925-489ed7861f9c service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:21.132254 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666db9e-1f4b-467e-8925-489ed7861f9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:21.140496 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666db9e-1f4b-467e-8925-489ed7861f9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:21.142600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666db9e-1f4b-467e-8925-489ed7861f9c service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:21.151936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 751/1513] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:21.985122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3702e8-146e-4fad-b505-aa1abb14b4da None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:21.985660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3702e8-146e-4fad-b505-aa1abb14b4da None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:21.985660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3702e8-146e-4fad-b505-aa1abb14b4da None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:21.987060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:21.991838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0fff-a3df-4116-8a67-1222171134bb None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:21.992284 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0fff-a3df-4116-8a67-1222171134bb None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:21.992397 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0fff-a3df-4116-8a67-1222171134bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:22.012231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-f2bc0fff-a3df-4116-8a67-1222171134bb None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:22.013425 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f2bc0fff-a3df-4116-8a67-1222171134bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:22.021795 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:30:22.176046 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3702e8-146e-4fad-b505-aa1abb14b4da None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:22.190793 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3702e8-146e-4fad-b505-aa1abb14b4da None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:22.200117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32a71b-5609-474d-9717-3387f36fcfa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:22.200721 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32a71b-5609-474d-9717-3387f36fcfa4 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:22.201003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32a71b-5609-474d-9717-3387f36fcfa4 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:22.201275 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32a71b-5609-474d-9717-3387f36fcfa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:22.210418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32a71b-5609-474d-9717-3387f36fcfa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:22.212286 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32a71b-5609-474d-9717-3387f36fcfa4 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:22.224183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 764/1516] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:30:22.941635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e800c9-5626-4427-be73-060e529b241b None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:22.941876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e800c9-5626-4427-be73-060e529b241b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:22.942106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e800c9-5626-4427-be73-060e529b241b None None] PATH_INFO: `/v3` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:22.943475 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 753/1517] 10.222.0.59 () {54 vars in 925 bytes} [Thu Sep 1 16:30:22 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:22.950802 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9e1e6-3523-4417-8205-9de418e8e34e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:22.951091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9e1e6-3523-4417-8205-9de418e8e34e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:22.951358 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9e1e6-3523-4417-8205-9de418e8e34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:23.009603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a1b9e1e6-3523-4417-8205-9de418e8e34e None None] MFA Rules not processed for user `dae8db0856ed44088f0bd3cb93701de0`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:23.010824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a1b9e1e6-3523-4417-8205-9de418e8e34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:23.027695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:23.081390 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 765/1518] 10.222.0.59 () {58 vars in 1015 bytes} [Thu Sep 1 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:30:32.007166 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=56 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:32.467792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6d023-8bc7-4202-b864-00d583794eb4 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:32.468075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6d023-8bc7-4202-b864-00d583794eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:32.468369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6d023-8bc7-4202-b864-00d583794eb4 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:32.470263 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 754/1519] 10.222.0.71 () {54 vars in 961 bytes} [Thu Sep 1 16:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:30:32.475478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eeb36f-a806-4509-b6cc-9ec648eccc80 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:32.475955 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eeb36f-a806-4509-b6cc-9ec648eccc80 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:32.476065 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eeb36f-a806-4509-b6cc-9ec648eccc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:32.495951 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a3eeb36f-a806-4509-b6cc-9ec648eccc80 None None] MFA Rules not processed for user `dae8db0856ed44088f0bd3cb93701de0`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:32.497155 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a3eeb36f-a806-4509-b6cc-9ec648eccc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:32.506429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 766/1520] 10.222.0.71 () {58 vars in 1058 bytes} [Thu Sep 1 16:30:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:30:32.514349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6d023-8bc7-4202-b864-00d583794eb4 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:32.529368 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6d023-8bc7-4202-b864-00d583794eb4 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:32.536091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895071e-de4b-43e0-a301-6195184ea4ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae8db0856ed44088f0bd3cb93701de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:32.536595 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895071e-de4b-43e0-a301-6195184ea4ff service placement] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:32.536875 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895071e-de4b-43e0-a301-6195184ea4ff service placement] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:32.537285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895071e-de4b-43e0-a301-6195184ea4ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:32.547317 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895071e-de4b-43e0-a301-6195184ea4ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:32.549088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895071e-de4b-43e0-a301-6195184ea4ff service placement] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:32.561271 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 755/1521] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:30:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:33.488528 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50332076-7374-4ea8-9618-cabf830afd56 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:33.489044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50332076-7374-4ea8-9618-cabf830afd56 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:33.489044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50332076-7374-4ea8-9618-cabf830afd56 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:33.490331 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:33.495506 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11439050-1514-4a9b-b1a9-5d97bdf5c8bc None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:33.495960 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11439050-1514-4a9b-b1a9-5d97bdf5c8bc None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:33.496083 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11439050-1514-4a9b-b1a9-5d97bdf5c8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:33.515845 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-11439050-1514-4a9b-b1a9-5d97bdf5c8bc None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:33.517034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-11439050-1514-4a9b-b1a9-5d97bdf5c8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:33.525073 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:30:33.682771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50332076-7374-4ea8-9618-cabf830afd56 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:33.700593 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50332076-7374-4ea8-9618-cabf830afd56 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:33.706902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8583f-604d-48c8-bc11-7fc9e6229ace service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:33.707508 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8583f-604d-48c8-bc11-7fc9e6229ace service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:33.707784 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8583f-604d-48c8-bc11-7fc9e6229ace service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:33.708060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8583f-604d-48c8-bc11-7fc9e6229ace service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:33.718449 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8583f-604d-48c8-bc11-7fc9e6229ace service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:33.720131 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8583f-604d-48c8-bc11-7fc9e6229ace service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:33.729928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 768/1524] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:34.551488 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80676ce-7cb2-43a7-b034-927f0040ef46 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:34.552034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80676ce-7cb2-43a7-b034-927f0040ef46 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:34.552034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80676ce-7cb2-43a7-b034-927f0040ef46 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:34.553516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:34.558238 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b782726-4cfe-4f8b-86b0-d93fd7830bff None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:34.558767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b782726-4cfe-4f8b-86b0-d93fd7830bff None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:34.558874 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b782726-4cfe-4f8b-86b0-d93fd7830bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:34.579314 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9b782726-4cfe-4f8b-86b0-d93fd7830bff None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:34.580522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9b782726-4cfe-4f8b-86b0-d93fd7830bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:34.588924 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:30:34.746011 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80676ce-7cb2-43a7-b034-927f0040ef46 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:34.761691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80676ce-7cb2-43a7-b034-927f0040ef46 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:34.767726 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626b8df-491d-4948-8a5b-7055370559de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:34.768411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626b8df-491d-4948-8a5b-7055370559de service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:34.768702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626b8df-491d-4948-8a5b-7055370559de service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:34.768967 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626b8df-491d-4948-8a5b-7055370559de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:34.777410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626b8df-491d-4948-8a5b-7055370559de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:34.779355 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626b8df-491d-4948-8a5b-7055370559de service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:34.792768 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 758/1527] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:38.775326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001541e-6633-4f49-8058-135dbf89a8ef None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:38.775856 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001541e-6633-4f49-8058-135dbf89a8ef None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:38.775856 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001541e-6633-4f49-8058-135dbf89a8ef None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:38.777131 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:38.782818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2368878-d291-4adc-b149-1aeffc1b2d41 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:38.783237 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2368878-d291-4adc-b149-1aeffc1b2d41 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:38.783367 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2368878-d291-4adc-b149-1aeffc1b2d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:38.802915 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-c2368878-d291-4adc-b149-1aeffc1b2d41 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:38.804091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c2368878-d291-4adc-b149-1aeffc1b2d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:38.812023 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:30:39.107647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001541e-6633-4f49-8058-135dbf89a8ef None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:39.109946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7001541e-6633-4f49-8058-135dbf89a8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:39.187083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001541e-6633-4f49-8058-135dbf89a8ef None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:39.190742 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba761740-281d-479a-8d96-ed6cff70a14c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:39.191336 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba761740-281d-479a-8d96-ed6cff70a14c service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:39.191616 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba761740-281d-479a-8d96-ed6cff70a14c service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:39.191888 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba761740-281d-479a-8d96-ed6cff70a14c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:39.200672 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba761740-281d-479a-8d96-ed6cff70a14c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:39.202086 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba761740-281d-479a-8d96-ed6cff70a14c service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:39.212427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 771/1530] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:41.108822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfae56-1430-416d-94d7-87f93c5f71c5 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:41.109894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfae56-1430-416d-94d7-87f93c5f71c5 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:41.109894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfae56-1430-416d-94d7-87f93c5f71c5 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:41.111301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:41.116343 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ac22c-39a2-4fae-8b11-d4dc40502953 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:41.116753 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ac22c-39a2-4fae-8b11-d4dc40502953 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:41.116896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ac22c-39a2-4fae-8b11-d4dc40502953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:41.137337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ef7ac22c-39a2-4fae-8b11-d4dc40502953 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:41.138527 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ef7ac22c-39a2-4fae-8b11-d4dc40502953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:41.146270 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:30:41.433109 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfae56-1430-416d-94d7-87f93c5f71c5 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:41.434848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-18bfae56-1430-416d-94d7-87f93c5f71c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:41.448107 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfae56-1430-416d-94d7-87f93c5f71c5 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:41.451608 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45df2f-37ba-4768-9729-f68d253730a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:41.452199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45df2f-37ba-4768-9729-f68d253730a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:41.452479 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45df2f-37ba-4768-9729-f68d253730a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:41.452775 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45df2f-37ba-4768-9729-f68d253730a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:41.461625 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45df2f-37ba-4768-9729-f68d253730a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:41.463338 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45df2f-37ba-4768-9729-f68d253730a0 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:41.472542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 761/1533] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:44.805713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438d2d5-8672-48a2-a928-e1affff6e9a1 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:44.806248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438d2d5-8672-48a2-a928-e1affff6e9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:44.806248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438d2d5-8672-48a2-a928-e1affff6e9a1 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:44.807647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:44.813363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb50ec-68d6-436a-b257-68b0c2972474 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:44.813779 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb50ec-68d6-436a-b257-68b0c2972474 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:44.813912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb50ec-68d6-436a-b257-68b0c2972474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:44.833911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-f7eb50ec-68d6-436a-b257-68b0c2972474 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:44.835129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f7eb50ec-68d6-436a-b257-68b0c2972474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:44.843161 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:30:45.395794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438d2d5-8672-48a2-a928-e1affff6e9a1 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:45.397443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a438d2d5-8672-48a2-a928-e1affff6e9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:45.460890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:45.475356 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438d2d5-8672-48a2-a928-e1affff6e9a1 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:45.478958 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b0a47-5e56-4f23-a5f1-ad48cf5fb820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:45.479548 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b0a47-5e56-4f23-a5f1-ad48cf5fb820 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:45.479826 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b0a47-5e56-4f23-a5f1-ad48cf5fb820 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:45.480097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b0a47-5e56-4f23-a5f1-ad48cf5fb820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:45.489538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b0a47-5e56-4f23-a5f1-ad48cf5fb820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:45.490977 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b0a47-5e56-4f23-a5f1-ad48cf5fb820 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:45.500158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 774/1536] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:47.414817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee457a-af2c-4c53-ab88-f6788ace0949 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:47.415349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee457a-af2c-4c53-ab88-f6788ace0949 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:47.415349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee457a-af2c-4c53-ab88-f6788ace0949 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:47.416632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:47.421819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd815a5-a6c5-411f-b29b-60095000f9ca None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:47.422208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd815a5-a6c5-411f-b29b-60095000f9ca None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:47.422359 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd815a5-a6c5-411f-b29b-60095000f9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:47.441337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-abd815a5-a6c5-411f-b29b-60095000f9ca None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:47.442514 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-abd815a5-a6c5-411f-b29b-60095000f9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:47.450402 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:30:47.997373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee457a-af2c-4c53-ab88-f6788ace0949 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:47.999120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4cee457a-af2c-4c53-ab88-f6788ace0949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:48.012558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee457a-af2c-4c53-ab88-f6788ace0949 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:48.016049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e395ae-cda1-4fa4-a20f-bc1411e80809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:48.016633 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e395ae-cda1-4fa4-a20f-bc1411e80809 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:48.016910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e395ae-cda1-4fa4-a20f-bc1411e80809 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:48.017183 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e395ae-cda1-4fa4-a20f-bc1411e80809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:48.025872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e395ae-cda1-4fa4-a20f-bc1411e80809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:48.027318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e395ae-cda1-4fa4-a20f-bc1411e80809 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:48.036447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 764/1539] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:57.436525 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=11 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:58.032397 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=33 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:25.972049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090993d1-05f8-487a-9b3a-e05c37b6dd84 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:25.972687 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090993d1-05f8-487a-9b3a-e05c37b6dd84 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:25.972687 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090993d1-05f8-487a-9b3a-e05c37b6dd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:25.999754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-090993d1-05f8-487a-9b3a-e05c37b6dd84 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:26.000985 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-090993d1-05f8-487a-9b3a-e05c37b6dd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:26.009342 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 776/1540] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:26.021193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27639bc6-d72a-4a60-80ac-5791800a0c70 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.021830 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27639bc6-d72a-4a60-80ac-5791800a0c70 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.021830 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27639bc6-d72a-4a60-80ac-5791800a0c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.048740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2631d2-6240-4242-9598-ae6cb77cba03 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.049102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2631d2-6240-4242-9598-ae6cb77cba03 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.049293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2631d2-6240-4242-9598-ae6cb77cba03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.067248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-27639bc6-d72a-4a60-80ac-5791800a0c70 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:26.068483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-27639bc6-d72a-4a60-80ac-5791800a0c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:26.078951 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-fc2631d2-6240-4242-9598-ae6cb77cba03 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:26.080163 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fc2631d2-6240-4242-9598-ae6cb77cba03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:26.086308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 765/1541] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:32:26.087611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534e2dc-c9bf-4e55-bf9c-97a981f8cd30 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.087897 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534e2dc-c9bf-4e55-bf9c-97a981f8cd30 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.088168 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534e2dc-c9bf-4e55-bf9c-97a981f8cd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.100218 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 777/1542] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:32:26.101321 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4cc43-d4ab-478a-91c5-cf9af7d5bf93 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.101606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4cc43-d4ab-478a-91c5-cf9af7d5bf93 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.101879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4cc43-d4ab-478a-91c5-cf9af7d5bf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.123497 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-7534e2dc-c9bf-4e55-bf9c-97a981f8cd30 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:26.124703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7534e2dc-c9bf-4e55-bf9c-97a981f8cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:26.127947 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-28b4cc43-d4ab-478a-91c5-cf9af7d5bf93 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:26.129356 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-28b4cc43-d4ab-478a-91c5-cf9af7d5bf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:26.133126 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 766/1543] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:26.134179 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e4c6a-4a3c-4ee9-878e-3d7bbbc8e23b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.134819 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e4c6a-4a3c-4ee9-878e-3d7bbbc8e23b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.134819 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e4c6a-4a3c-4ee9-878e-3d7bbbc8e23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.145155 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 778/1544] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:26.145909 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4cc43-d4ab-478a-91c5-cf9af7d5bf93 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.156743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4cc43-d4ab-478a-91c5-cf9af7d5bf93 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.156958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-490e4c6a-4a3c-4ee9-878e-3d7bbbc8e23b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:26.157961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-490e4c6a-4a3c-4ee9-878e-3d7bbbc8e23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:26.161847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367de9a-9173-4777-8fe7-86a0a01a0574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.162447 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367de9a-9173-4777-8fe7-86a0a01a0574 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.162758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367de9a-9173-4777-8fe7-86a0a01a0574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.163027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367de9a-9173-4777-8fe7-86a0a01a0574 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.163670 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367de9a-9173-4777-8fe7-86a0a01a0574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:32:26.163966 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367de9a-9173-4777-8fe7-86a0a01a0574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.165547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367de9a-9173-4777-8fe7-86a0a01a0574 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.166932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 767/1545] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:26.168179 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142138f-bec8-4af5-8d8f-4f01803ecd47 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.168471 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142138f-bec8-4af5-8d8f-4f01803ecd47 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.168747 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142138f-bec8-4af5-8d8f-4f01803ecd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.185395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 779/1546] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:32:26.186831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcae723-5fef-4b34-a984-53526d5bfffc None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.187122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcae723-5fef-4b34-a984-53526d5bfffc None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.187392 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcae723-5fef-4b34-a984-53526d5bfffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.190526 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-5142138f-bec8-4af5-8d8f-4f01803ecd47 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:26.192564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5142138f-bec8-4af5-8d8f-4f01803ecd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:26.202547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 768/1547] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:26.204169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853fb54-5e83-4d31-9bcd-5208b3092227 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.204640 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853fb54-5e83-4d31-9bcd-5208b3092227 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.205099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853fb54-5e83-4d31-9bcd-5208b3092227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.208006 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-3dcae723-5fef-4b34-a984-53526d5bfffc None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:26.209204 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3dcae723-5fef-4b34-a984-53526d5bfffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:26.218036 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 780/1548] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:26.219370 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cb4f3-aca1-4125-a1e2-11699bb686c6 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.219661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cb4f3-aca1-4125-a1e2-11699bb686c6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.219936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cb4f3-aca1-4125-a1e2-11699bb686c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.225663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-c853fb54-5e83-4d31-9bcd-5208b3092227 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:26.226903 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c853fb54-5e83-4d31-9bcd-5208b3092227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:26.235382 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 769/1549] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:26.236583 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd860c-9f6e-46ce-b108-4ac371bfd33f None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.236870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd860c-9f6e-46ce-b108-4ac371bfd33f None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.237281 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd860c-9f6e-46ce-b108-4ac371bfd33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.241665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-697cb4f3-aca1-4125-a1e2-11699bb686c6 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:26.243214 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-697cb4f3-aca1-4125-a1e2-11699bb686c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:26.251887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 781/1550] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:26.253406 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f19a4e-a656-422b-8159-b07d409e2003 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.253692 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f19a4e-a656-422b-8159-b07d409e2003 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.253960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f19a4e-a656-422b-8159-b07d409e2003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.256822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-4bcd860c-9f6e-46ce-b108-4ac371bfd33f None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:26.258070 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4bcd860c-9f6e-46ce-b108-4ac371bfd33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:26.265943 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 770/1551] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:26.267578 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd860c-9f6e-46ce-b108-4ac371bfd33f None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.273429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a4f19a4e-a656-422b-8159-b07d409e2003 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:26.274625 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a4f19a4e-a656-422b-8159-b07d409e2003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:26.277543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd860c-9f6e-46ce-b108-4ac371bfd33f None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.282087 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0f1f1-f77b-4b29-ba98-259f240b4845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.282665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 782/1552] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:26.282795 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f1f1-f77b-4b29-ba98-259f240b4845 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.282992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f1f1-f77b-4b29-ba98-259f240b4845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.283268 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f1f1-f77b-4b29-ba98-259f240b4845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.283511 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f19a4e-a656-422b-8159-b07d409e2003 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.283996 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0f1f1-f77b-4b29-ba98-259f240b4845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.285984 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0f1f1-f77b-4b29-ba98-259f240b4845 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.296008 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f19a4e-a656-422b-8159-b07d409e2003 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.301577 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28173261-e709-436a-a826-25ceb7b62450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.302341 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28173261-e709-436a-a826-25ceb7b62450 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.302824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28173261-e709-436a-a826-25ceb7b62450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.303118 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28173261-e709-436a-a826-25ceb7b62450 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.303802 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28173261-e709-436a-a826-25ceb7b62450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:32:26.304111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28173261-e709-436a-a826-25ceb7b62450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.306276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28173261-e709-436a-a826-25ceb7b62450 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.319138 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 783/1553] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:32:26.320475 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc9b97-2526-4a35-ba59-996089fe25f8 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.320766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc9b97-2526-4a35-ba59-996089fe25f8 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.321047 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc9b97-2526-4a35-ba59-996089fe25f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.339030 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 771/1554] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:26.340285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7018c1-34cb-4705-9550-66afa6a93116 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.340570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7018c1-34cb-4705-9550-66afa6a93116 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.340846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7018c1-34cb-4705-9550-66afa6a93116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.343654 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d8dc9b97-2526-4a35-ba59-996089fe25f8 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:26.345778 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d8dc9b97-2526-4a35-ba59-996089fe25f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:26.362833 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-8b7018c1-34cb-4705-9550-66afa6a93116 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:26.364046 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-8b7018c1-34cb-4705-9550-66afa6a93116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:26.407111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 784/1555] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:26.408273 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114245-8e17-483c-90f9-c41349821504 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.408557 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114245-8e17-483c-90f9-c41349821504 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.408827 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114245-8e17-483c-90f9-c41349821504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.428678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9e114245-8e17-483c-90f9-c41349821504 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:26.429428 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 772/1556] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:26.430074 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9e114245-8e17-483c-90f9-c41349821504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:26.430344 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7018c1-34cb-4705-9550-66afa6a93116 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.438923 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 785/1557] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:26.439849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e114245-8e17-483c-90f9-c41349821504 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.440327 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7018c1-34cb-4705-9550-66afa6a93116 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.445153 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73ac98-a22f-4a2e-a7b0-2c615156d432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.445761 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73ac98-a22f-4a2e-a7b0-2c615156d432 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.446040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73ac98-a22f-4a2e-a7b0-2c615156d432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.446315 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73ac98-a22f-4a2e-a7b0-2c615156d432 admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.446993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73ac98-a22f-4a2e-a7b0-2c615156d432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:32:26.447302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73ac98-a22f-4a2e-a7b0-2c615156d432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.448307 dv-cinder-852208-16-smb devstack@keystone.service[81498]: WARNING py.warnings [None req-7f73ac98-a22f-4a2e-a7b0-2c615156d432 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:32:26.448307 dv-cinder-852208-16-smb devstack@keystone.service[81498]: warnings.warn(msg) Sep 01 16:32:26.448307 dv-cinder-852208-16-smb devstack@keystone.service[81498]: Sep 01 16:32:26.449224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73ac98-a22f-4a2e-a7b0-2c615156d432 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.449698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e114245-8e17-483c-90f9-c41349821504 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.454319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd1755-bebd-4ada-963c-2cc3c497144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.454981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd1755-bebd-4ada-963c-2cc3c497144c admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.455261 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd1755-bebd-4ada-963c-2cc3c497144c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.455650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd1755-bebd-4ada-963c-2cc3c497144c admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.456301 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd1755-bebd-4ada-963c-2cc3c497144c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:32:26.456601 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd1755-bebd-4ada-963c-2cc3c497144c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.458231 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd1755-bebd-4ada-963c-2cc3c497144c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.462654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 773/1558] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:32:26.462654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73ac98-a22f-4a2e-a7b0-2c615156d432 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.472034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73ac98-a22f-4a2e-a7b0-2c615156d432 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.479858 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 786/1559] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:32:26.480518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70357fcb-c617-400c-867a-391da6d4528d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.480648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd1755-bebd-4ada-963c-2cc3c497144c admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.480731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70357fcb-c617-400c-867a-391da6d4528d admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.480731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70357fcb-c617-400c-867a-391da6d4528d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.480731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70357fcb-c617-400c-867a-391da6d4528d admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.480731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70357fcb-c617-400c-867a-391da6d4528d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:32:26.480731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70357fcb-c617-400c-867a-391da6d4528d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.481161 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70357fcb-c617-400c-867a-391da6d4528d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.492795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd1755-bebd-4ada-963c-2cc3c497144c admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.494651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 774/1560] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:32:26.495532 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70357fcb-c617-400c-867a-391da6d4528d admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.499294 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e00e5b-d061-47ce-b4af-f52ff764c3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.500010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e00e5b-d061-47ce-b4af-f52ff764c3de admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.500392 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e00e5b-d061-47ce-b4af-f52ff764c3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.500961 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e00e5b-d061-47ce-b4af-f52ff764c3de admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.501703 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e00e5b-d061-47ce-b4af-f52ff764c3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.503437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: WARNING py.warnings [None req-98e00e5b-d061-47ce-b4af-f52ff764c3de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:32:26.503437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: warnings.warn(msg) Sep 01 16:32:26.503437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: Sep 01 16:32:26.504766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e00e5b-d061-47ce-b4af-f52ff764c3de admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.505822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70357fcb-c617-400c-867a-391da6d4528d admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.510431 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9981cf6-7dfb-4558-b4a1-38963a0b096f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.511061 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9981cf6-7dfb-4558-b4a1-38963a0b096f admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.511371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9981cf6-7dfb-4558-b4a1-38963a0b096f admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.511642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9981cf6-7dfb-4558-b4a1-38963a0b096f admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.512275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9981cf6-7dfb-4558-b4a1-38963a0b096f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.513278 dv-cinder-852208-16-smb devstack@keystone.service[81498]: WARNING py.warnings [None req-c9981cf6-7dfb-4558-b4a1-38963a0b096f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:32:26.513278 dv-cinder-852208-16-smb devstack@keystone.service[81498]: warnings.warn(msg) Sep 01 16:32:26.513278 dv-cinder-852208-16-smb devstack@keystone.service[81498]: Sep 01 16:32:26.514467 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9981cf6-7dfb-4558-b4a1-38963a0b096f admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.535266 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 787/1561] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:26.536645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff581fb7-2260-4d6d-8176-c90126bcb44b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.536936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff581fb7-2260-4d6d-8176-c90126bcb44b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.537209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff581fb7-2260-4d6d-8176-c90126bcb44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.538658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 775/1562] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:26.542501 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9981cf6-7dfb-4558-b4a1-38963a0b096f admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.552986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9981cf6-7dfb-4558-b4a1-38963a0b096f admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.557185 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ff581fb7-2260-4d6d-8176-c90126bcb44b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:26.558414 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ff581fb7-2260-4d6d-8176-c90126bcb44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:26.597578 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:26.612232 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:26.612472 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078a66d-6011-410d-af1c-d403af0f7205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.613155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078a66d-6011-410d-af1c-d403af0f7205 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.613443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078a66d-6011-410d-af1c-d403af0f7205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.613718 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078a66d-6011-410d-af1c-d403af0f7205 admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.614433 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078a66d-6011-410d-af1c-d403af0f7205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:32:26.614791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078a66d-6011-410d-af1c-d403af0f7205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.616400 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078a66d-6011-410d-af1c-d403af0f7205 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.628960 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 776/1563] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:32:26.629991 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078a66d-6011-410d-af1c-d403af0f7205 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.630121 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 788/1564] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:26.630798 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff581fb7-2260-4d6d-8176-c90126bcb44b None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.640624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff581fb7-2260-4d6d-8176-c90126bcb44b None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.643707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078a66d-6011-410d-af1c-d403af0f7205 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.645291 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d10bc-8792-41b1-bd79-2185a24430ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.645883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d10bc-8792-41b1-bd79-2185a24430ab admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.646162 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d10bc-8792-41b1-bd79-2185a24430ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.646419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d10bc-8792-41b1-bd79-2185a24430ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.647487 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d10bc-8792-41b1-bd79-2185a24430ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.648536 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b30dd0-8592-411a-a06e-fbe0cb946b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.649356 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b30dd0-8592-411a-a06e-fbe0cb946b73 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.649463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d10bc-8792-41b1-bd79-2185a24430ab admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.654103 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b30dd0-8592-411a-a06e-fbe0cb946b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.654400 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b30dd0-8592-411a-a06e-fbe0cb946b73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.655089 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b30dd0-8592-411a-a06e-fbe0cb946b73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:32:26.655400 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b30dd0-8592-411a-a06e-fbe0cb946b73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.658101 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b30dd0-8592-411a-a06e-fbe0cb946b73 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.674922 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 777/1565] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:32:26.679641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b30dd0-8592-411a-a06e-fbe0cb946b73 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.681851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 789/1566] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:26.682734 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d10bc-8792-41b1-bd79-2185a24430ab admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.690226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b30dd0-8592-411a-a06e-fbe0cb946b73 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.744861 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d10bc-8792-41b1-bd79-2185a24430ab admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.748071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241db65d-6c35-4062-9c2f-3a7cd3dc9df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.748690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241db65d-6c35-4062-9c2f-3a7cd3dc9df3 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.748971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241db65d-6c35-4062-9c2f-3a7cd3dc9df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.749805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab8fad-928f-4cbe-8354-bae6d833f4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.750412 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab8fad-928f-4cbe-8354-bae6d833f4aa admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.751110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab8fad-928f-4cbe-8354-bae6d833f4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.751110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab8fad-928f-4cbe-8354-bae6d833f4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.751545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241db65d-6c35-4062-9c2f-3a7cd3dc9df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.751775 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab8fad-928f-4cbe-8354-bae6d833f4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.752276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241db65d-6c35-4062-9c2f-3a7cd3dc9df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.753844 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab8fad-928f-4cbe-8354-bae6d833f4aa admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.754416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241db65d-6c35-4062-9c2f-3a7cd3dc9df3 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.783421 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 790/1567] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:26.784016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 778/1568] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:26.784981 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241db65d-6c35-4062-9c2f-3a7cd3dc9df3 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.787781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab8fad-928f-4cbe-8354-bae6d833f4aa admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.847721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241db65d-6c35-4062-9c2f-3a7cd3dc9df3 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.852575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a29fe-41c0-4af2-b42a-32983d719a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.853200 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a29fe-41c0-4af2-b42a-32983d719a63 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.853479 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a29fe-41c0-4af2-b42a-32983d719a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.853579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab8fad-928f-4cbe-8354-bae6d833f4aa admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.853751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a29fe-41c0-4af2-b42a-32983d719a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.854396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a29fe-41c0-4af2-b42a-32983d719a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.856608 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a29fe-41c0-4af2-b42a-32983d719a63 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.858760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01d84d-d799-4600-b6e4-74454b69ff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.859368 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01d84d-d799-4600-b6e4-74454b69ff7b admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.859641 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01d84d-d799-4600-b6e4-74454b69ff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.859909 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01d84d-d799-4600-b6e4-74454b69ff7b admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.860677 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01d84d-d799-4600-b6e4-74454b69ff7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.862565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01d84d-d799-4600-b6e4-74454b69ff7b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.866932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 779/1569] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:26.867756 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a29fe-41c0-4af2-b42a-32983d719a63 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.878823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a29fe-41c0-4af2-b42a-32983d719a63 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.883791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362680f-f919-42ce-a708-56700b0abbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.884403 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362680f-f919-42ce-a708-56700b0abbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.884532 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 791/1570] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:26.887807 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362680f-f919-42ce-a708-56700b0abbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.887807 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362680f-f919-42ce-a708-56700b0abbc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.888010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01d84d-d799-4600-b6e4-74454b69ff7b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.888116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362680f-f919-42ce-a708-56700b0abbc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:32:26.888116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362680f-f919-42ce-a708-56700b0abbc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.888116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362680f-f919-42ce-a708-56700b0abbc5 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.894904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01d84d-d799-4600-b6e4-74454b69ff7b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.899492 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b66db-4a35-47b9-972a-b68755351084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.900079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b66db-4a35-47b9-972a-b68755351084 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.900353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b66db-4a35-47b9-972a-b68755351084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.907770 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 780/1571] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:32:26.907980 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b66db-4a35-47b9-972a-b68755351084 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.907980 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b66db-4a35-47b9-972a-b68755351084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.908234 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362680f-f919-42ce-a708-56700b0abbc5 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.908346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b66db-4a35-47b9-972a-b68755351084 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.911995 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362680f-f919-42ce-a708-56700b0abbc5 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:26.918036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c2eea-4809-47e4-b7a1-cf79e0725d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:26.918659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c2eea-4809-47e4-b7a1-cf79e0725d02 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:26.918942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c2eea-4809-47e4-b7a1-cf79e0725d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:26.919239 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c2eea-4809-47e4-b7a1-cf79e0725d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:26.919867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c2eea-4809-47e4-b7a1-cf79e0725d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:26.921782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c2eea-4809-47e4-b7a1-cf79e0725d02 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:26.936030 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 792/1572] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:26.936030 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b66db-4a35-47b9-972a-b68755351084 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.958018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 781/1573] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:26.958018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c2eea-4809-47e4-b7a1-cf79e0725d02 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:26.960814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:26.971138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:26.997684 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b66db-4a35-47b9-972a-b68755351084 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.022290 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c2eea-4809-47e4-b7a1-cf79e0725d02 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.027731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db050364-0b31-43ee-bfab-1549b9862668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.028332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db050364-0b31-43ee-bfab-1549b9862668 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.028610 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db050364-0b31-43ee-bfab-1549b9862668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.028879 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db050364-0b31-43ee-bfab-1549b9862668 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.029565 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db050364-0b31-43ee-bfab-1549b9862668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.031494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db050364-0b31-43ee-bfab-1549b9862668 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.053281 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 782/1574] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:27.054087 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db050364-0b31-43ee-bfab-1549b9862668 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.060144 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb9d1f-1f42-4603-9b36-24b88d95b6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.060873 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb9d1f-1f42-4603-9b36-24b88d95b6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.061250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb9d1f-1f42-4603-9b36-24b88d95b6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.061639 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb9d1f-1f42-4603-9b36-24b88d95b6a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.062370 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb9d1f-1f42-4603-9b36-24b88d95b6a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.063635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db050364-0b31-43ee-bfab-1549b9862668 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.064822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb9d1f-1f42-4603-9b36-24b88d95b6a1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.068181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7199f95-f56e-4176-9d9f-84347d3ea85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.068769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7199f95-f56e-4176-9d9f-84347d3ea85c admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.069044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7199f95-f56e-4176-9d9f-84347d3ea85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.069312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7199f95-f56e-4176-9d9f-84347d3ea85c admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.069967 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7199f95-f56e-4176-9d9f-84347d3ea85c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.071842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7199f95-f56e-4176-9d9f-84347d3ea85c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.088675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 793/1575] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:26 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:27.090067 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb9d1f-1f42-4603-9b36-24b88d95b6a1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.095735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 783/1576] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:27 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:27.096852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7199f95-f56e-4176-9d9f-84347d3ea85c admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.107827 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb9d1f-1f42-4603-9b36-24b88d95b6a1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.108073 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7199f95-f56e-4176-9d9f-84347d3ea85c admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.112754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d4721-76a4-4d9e-8479-b9a6659903c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.112927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00551129-f50f-4867-9b86-0766e22e6168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.113363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d4721-76a4-4d9e-8479-b9a6659903c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.113486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00551129-f50f-4867-9b86-0766e22e6168 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.113646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d4721-76a4-4d9e-8479-b9a6659903c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.113778 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00551129-f50f-4867-9b86-0766e22e6168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.113953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d4721-76a4-4d9e-8479-b9a6659903c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.114053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00551129-f50f-4867-9b86-0766e22e6168 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.114598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d4721-76a4-4d9e-8479-b9a6659903c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.114729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00551129-f50f-4867-9b86-0766e22e6168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.116224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d4721-76a4-4d9e-8479-b9a6659903c1 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.116336 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00551129-f50f-4867-9b86-0766e22e6168 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.127454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 784/1577] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:27.128006 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 794/1578] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:27.131525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d4721-76a4-4d9e-8479-b9a6659903c1 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.131692 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00551129-f50f-4867-9b86-0766e22e6168 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.141816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d4721-76a4-4d9e-8479-b9a6659903c1 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.142107 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00551129-f50f-4867-9b86-0766e22e6168 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.146371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d50b70-0ad6-4882-a880-dda57a9cb8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.146791 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a8487-2401-4bff-a160-bf331141c500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.147002 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d50b70-0ad6-4882-a880-dda57a9cb8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.147277 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d50b70-0ad6-4882-a880-dda57a9cb8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.147416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a8487-2401-4bff-a160-bf331141c500 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.147543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d50b70-0ad6-4882-a880-dda57a9cb8b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.147711 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a8487-2401-4bff-a160-bf331141c500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.147966 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a8487-2401-4bff-a160-bf331141c500 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.148163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d50b70-0ad6-4882-a880-dda57a9cb8b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.148593 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a8487-2401-4bff-a160-bf331141c500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.150069 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d50b70-0ad6-4882-a880-dda57a9cb8b7 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.150491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a8487-2401-4bff-a160-bf331141c500 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.175384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 795/1579] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:27 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:27.176643 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a8487-2401-4bff-a160-bf331141c500 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.183295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 785/1580] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:27 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:27.183295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d50b70-0ad6-4882-a880-dda57a9cb8b7 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.188875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a8487-2401-4bff-a160-bf331141c500 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.246202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d50b70-0ad6-4882-a880-dda57a9cb8b7 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.246916 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6109f4-610b-4427-866b-fbb5a5389139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.247517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6109f4-610b-4427-866b-fbb5a5389139 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.247795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6109f4-610b-4427-866b-fbb5a5389139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.248064 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6109f4-610b-4427-866b-fbb5a5389139 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.248693 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6109f4-610b-4427-866b-fbb5a5389139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.250747 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6109f4-610b-4427-866b-fbb5a5389139 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.250955 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cef05b-52a4-4ce0-a853-0c70603125d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.251558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cef05b-52a4-4ce0-a853-0c70603125d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.251839 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cef05b-52a4-4ce0-a853-0c70603125d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.252114 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cef05b-52a4-4ce0-a853-0c70603125d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.252811 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cef05b-52a4-4ce0-a853-0c70603125d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.254385 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cef05b-52a4-4ce0-a853-0c70603125d2 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.266116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 786/1581] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:27.268109 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cef05b-52a4-4ce0-a853-0c70603125d2 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.273007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 796/1582] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:27 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:27.274012 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6109f4-610b-4427-866b-fbb5a5389139 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.279292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cef05b-52a4-4ce0-a853-0c70603125d2 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.283266 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6109f4-610b-4427-866b-fbb5a5389139 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.284106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887da50-b376-4972-8db8-996c790b232c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.284704 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887da50-b376-4972-8db8-996c790b232c admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.284986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887da50-b376-4972-8db8-996c790b232c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.285260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887da50-b376-4972-8db8-996c790b232c admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.285898 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887da50-b376-4972-8db8-996c790b232c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.287537 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887da50-b376-4972-8db8-996c790b232c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.287824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6bce5-372d-4493-a5eb-22eec2d5654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.288405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6bce5-372d-4493-a5eb-22eec2d5654b admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.288682 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6bce5-372d-4493-a5eb-22eec2d5654b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.288952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6bce5-372d-4493-a5eb-22eec2d5654b admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.289577 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6bce5-372d-4493-a5eb-22eec2d5654b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.291164 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6bce5-372d-4493-a5eb-22eec2d5654b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.298003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 787/1583] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:27.298859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887da50-b376-4972-8db8-996c790b232c admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.301844 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 797/1584] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:27.302836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6bce5-372d-4493-a5eb-22eec2d5654b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.310499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887da50-b376-4972-8db8-996c790b232c admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.312821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6bce5-372d-4493-a5eb-22eec2d5654b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.315194 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688cc66-0cb4-4cd3-9a94-1ba77a4ca25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.315790 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688cc66-0cb4-4cd3-9a94-1ba77a4ca25b admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.316071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688cc66-0cb4-4cd3-9a94-1ba77a4ca25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.316345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688cc66-0cb4-4cd3-9a94-1ba77a4ca25b admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.316980 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688cc66-0cb4-4cd3-9a94-1ba77a4ca25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.317344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6e8d8-4a38-41c5-bef9-f2669c841621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.317975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6e8d8-4a38-41c5-bef9-f2669c841621 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.318250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6e8d8-4a38-41c5-bef9-f2669c841621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.318520 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6e8d8-4a38-41c5-bef9-f2669c841621 admin admin] PATH_INFO: `/v3/projects/0642180c3c83477f9f8e3ba7e8945bd8/users/89a6c0042fc447c39aa7ebe9c9017b82/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.318639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688cc66-0cb4-4cd3-9a94-1ba77a4ca25b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.327606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:27.330265 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 788/1585] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:27.331155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688cc66-0cb4-4cd3-9a94-1ba77a4ca25b admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.336932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6e8d8-4a38-41c5-bef9-f2669c841621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0642180c3c83477f9f8e3ba7e8945bd8, user_id=89a6c0042fc447c39aa7ebe9c9017b82, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.338036 dv-cinder-852208-16-smb devstack@keystone.service[81497]: WARNING py.warnings [None req-0cd6e8d8-4a38-41c5-bef9-f2669c841621 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:32:27.338036 dv-cinder-852208-16-smb devstack@keystone.service[81497]: warnings.warn(msg) Sep 01 16:32:27.338036 dv-cinder-852208-16-smb devstack@keystone.service[81497]: Sep 01 16:32:27.340968 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6e8d8-4a38-41c5-bef9-f2669c841621 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.341719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688cc66-0cb4-4cd3-9a94-1ba77a4ca25b admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.347551 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb90b92-d83b-423c-9609-1f3d25dc122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.348307 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb90b92-d83b-423c-9609-1f3d25dc122a admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.348664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb90b92-d83b-423c-9609-1f3d25dc122a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.348907 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb90b92-d83b-423c-9609-1f3d25dc122a admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.349871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb90b92-d83b-423c-9609-1f3d25dc122a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.351540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb90b92-d83b-423c-9609-1f3d25dc122a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.355914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 798/1586] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:27 2022] PUT /identity/v3/projects/0642180c3c83477f9f8e3ba7e8945bd8/users/89a6c0042fc447c39aa7ebe9c9017b82/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:27.356798 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6e8d8-4a38-41c5-bef9-f2669c841621 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.372555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 789/1587] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:27.373811 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb90b92-d83b-423c-9609-1f3d25dc122a admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.384397 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb90b92-d83b-423c-9609-1f3d25dc122a admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.396407 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:27.422106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6e8d8-4a38-41c5-bef9-f2669c841621 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.427221 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bc08a-0ef3-4097-9049-1164037e33b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.427772 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bc08a-0ef3-4097-9049-1164037e33b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.428035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bc08a-0ef3-4097-9049-1164037e33b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.428305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bc08a-0ef3-4097-9049-1164037e33b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.428936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bc08a-0ef3-4097-9049-1164037e33b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.430872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bc08a-0ef3-4097-9049-1164037e33b7 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.443669 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00175c65-c3a5-4352-a6df-334df8450c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.444539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00175c65-c3a5-4352-a6df-334df8450c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.444856 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00175c65-c3a5-4352-a6df-334df8450c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.445199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00175c65-c3a5-4352-a6df-334df8450c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.445904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00175c65-c3a5-4352-a6df-334df8450c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.447618 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00175c65-c3a5-4352-a6df-334df8450c1c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.452768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 799/1588] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:27 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:27.452768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bc08a-0ef3-4097-9049-1164037e33b7 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.461860 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 790/1589] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:27.462859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00175c65-c3a5-4352-a6df-334df8450c1c admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.465074 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bc08a-0ef3-4097-9049-1164037e33b7 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.470413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29da0f-f033-4d5f-af47-a40cf83591b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.471073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29da0f-f033-4d5f-af47-a40cf83591b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.471467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29da0f-f033-4d5f-af47-a40cf83591b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.471854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29da0f-f033-4d5f-af47-a40cf83591b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.472488 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29da0f-f033-4d5f-af47-a40cf83591b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.473927 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00175c65-c3a5-4352-a6df-334df8450c1c admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.474045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29da0f-f033-4d5f-af47-a40cf83591b9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.478545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271a6ca-ae2f-4ef5-be95-a57133f782f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.479345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271a6ca-ae2f-4ef5-be95-a57133f782f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.479622 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271a6ca-ae2f-4ef5-be95-a57133f782f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.479891 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271a6ca-ae2f-4ef5-be95-a57133f782f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.480580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271a6ca-ae2f-4ef5-be95-a57133f782f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.482135 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271a6ca-ae2f-4ef5-be95-a57133f782f7 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.484539 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 800/1590] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:27.485353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29da0f-f033-4d5f-af47-a40cf83591b9 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.494651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 791/1591] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:27.494651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271a6ca-ae2f-4ef5-be95-a57133f782f7 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.498377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29da0f-f033-4d5f-af47-a40cf83591b9 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.502999 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8d60e-4e96-4d9f-b749-5b7f318534a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.503345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271a6ca-ae2f-4ef5-be95-a57133f782f7 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.503579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8d60e-4e96-4d9f-b749-5b7f318534a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.503859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8d60e-4e96-4d9f-b749-5b7f318534a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.504128 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8d60e-4e96-4d9f-b749-5b7f318534a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.504753 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8d60e-4e96-4d9f-b749-5b7f318534a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.506315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8d60e-4e96-4d9f-b749-5b7f318534a8 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.508498 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ed30c-2640-434f-ba86-829f3469364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.509151 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ed30c-2640-434f-ba86-829f3469364d admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.509434 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ed30c-2640-434f-ba86-829f3469364d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.509739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ed30c-2640-434f-ba86-829f3469364d admin admin] PATH_INFO: `/v3/projects/67e7332e29da4841a9aa7b8eaf60cea6/users/4b0020cf6bfe4c65a6bb4dad21d0f366/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.517340 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 801/1592] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:27.518659 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f025da-6fc0-46e4-8f9b-8401a6469fc7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.518931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f025da-6fc0-46e4-8f9b-8401a6469fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.519198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f025da-6fc0-46e4-8f9b-8401a6469fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.526015 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ed30c-2640-434f-ba86-829f3469364d admin admin] RBAC: Authorizing `identity:create_grant(project_id=67e7332e29da4841a9aa7b8eaf60cea6, user_id=4b0020cf6bfe4c65a6bb4dad21d0f366, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.528749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ed30c-2640-434f-ba86-829f3469364d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.551511 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 792/1593] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:27 2022] PUT /identity/v3/projects/67e7332e29da4841a9aa7b8eaf60cea6/users/4b0020cf6bfe4c65a6bb4dad21d0f366/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:27.551511 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ed30c-2640-434f-ba86-829f3469364d admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.551827 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-34f025da-6fc0-46e4-8f9b-8401a6469fc7 None None] MFA Rules not processed for user `89a6c0042fc447c39aa7ebe9c9017b82`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:27.551827 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-34f025da-6fc0-46e4-8f9b-8401a6469fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:27.613594 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 802/1594] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:27.614524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f025da-6fc0-46e4-8f9b-8401a6469fc7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.614694 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ed30c-2640-434f-ba86-829f3469364d admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.624039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b7554-d25e-4d3b-8385-44a42a0cdd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.624741 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b7554-d25e-4d3b-8385-44a42a0cdd75 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.625164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b7554-d25e-4d3b-8385-44a42a0cdd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.625500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b7554-d25e-4d3b-8385-44a42a0cdd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.626498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f025da-6fc0-46e4-8f9b-8401a6469fc7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.626638 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b7554-d25e-4d3b-8385-44a42a0cdd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.629010 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b7554-d25e-4d3b-8385-44a42a0cdd75 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.631591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33019d98-d606-4e58-9df2-2df267aeb12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.632462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33019d98-d606-4e58-9df2-2df267aeb12a admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.632617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33019d98-d606-4e58-9df2-2df267aeb12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.632871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33019d98-d606-4e58-9df2-2df267aeb12a admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.633599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33019d98-d606-4e58-9df2-2df267aeb12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.635301 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33019d98-d606-4e58-9df2-2df267aeb12a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.641965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 793/1595] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:27.642987 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b7554-d25e-4d3b-8385-44a42a0cdd75 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.647206 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 803/1596] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:27.648123 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33019d98-d606-4e58-9df2-2df267aeb12a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.656369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b7554-d25e-4d3b-8385-44a42a0cdd75 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.662237 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33019d98-d606-4e58-9df2-2df267aeb12a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.663435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37025d-de39-4ab6-81fa-04e7bf35de96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.664196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37025d-de39-4ab6-81fa-04e7bf35de96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.664538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37025d-de39-4ab6-81fa-04e7bf35de96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.664912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37025d-de39-4ab6-81fa-04e7bf35de96 admin admin] PATH_INFO: `/v3/projects/6ac9929dbcf4494a888a7d024c7e0015/users/44d3f78436c543a5b9cf7178e81ff5c3/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.666908 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6287c7d-cbf2-4482-aaa2-76245a8935ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.668022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6287c7d-cbf2-4482-aaa2-76245a8935ea admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.668303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6287c7d-cbf2-4482-aaa2-76245a8935ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.668579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6287c7d-cbf2-4482-aaa2-76245a8935ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.669249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6287c7d-cbf2-4482-aaa2-76245a8935ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.670853 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6287c7d-cbf2-4482-aaa2-76245a8935ea admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.680869 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37025d-de39-4ab6-81fa-04e7bf35de96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac9929dbcf4494a888a7d024c7e0015, user_id=44d3f78436c543a5b9cf7178e81ff5c3, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.681034 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 804/1597] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:27.684390 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37025d-de39-4ab6-81fa-04e7bf35de96 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.685183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6287c7d-cbf2-4482-aaa2-76245a8935ea admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.697424 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6287c7d-cbf2-4482-aaa2-76245a8935ea admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.698916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 794/1598] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:27 2022] PUT /identity/v3/projects/6ac9929dbcf4494a888a7d024c7e0015/users/44d3f78436c543a5b9cf7178e81ff5c3/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:27.699748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37025d-de39-4ab6-81fa-04e7bf35de96 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.717220 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:27.752335 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:27.758551 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90144d82-f697-4111-b7e4-99754b90cc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.759238 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90144d82-f697-4111-b7e4-99754b90cc68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.759511 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90144d82-f697-4111-b7e4-99754b90cc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.759777 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90144d82-f697-4111-b7e4-99754b90cc68 admin admin] PATH_INFO: `/v3/projects/7985d0b24b174e90acb7cc7046876910/users/08d87dbdb5e8475ebee33fd65e62b3d6/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.767406 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37025d-de39-4ab6-81fa-04e7bf35de96 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.772281 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a75f13-cd71-4824-bf2c-de1308022bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.773022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a75f13-cd71-4824-bf2c-de1308022bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.773304 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a75f13-cd71-4824-bf2c-de1308022bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.773580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a75f13-cd71-4824-bf2c-de1308022bd6 admin admin] PATH_INFO: `/v3/projects/63136372842e4c5aa18a03179e35bcae/users/9b64df21a9aa46f78f956c8e7d4fd932/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.774451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90144d82-f697-4111-b7e4-99754b90cc68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7985d0b24b174e90acb7cc7046876910, user_id=08d87dbdb5e8475ebee33fd65e62b3d6, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.777192 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90144d82-f697-4111-b7e4-99754b90cc68 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.788349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a75f13-cd71-4824-bf2c-de1308022bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63136372842e4c5aa18a03179e35bcae, user_id=9b64df21a9aa46f78f956c8e7d4fd932, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.790810 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 805/1599] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:27 2022] PUT /identity/v3/projects/7985d0b24b174e90acb7cc7046876910/users/08d87dbdb5e8475ebee33fd65e62b3d6/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:27.791000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a75f13-cd71-4824-bf2c-de1308022bd6 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.796519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1b26e-2fdf-4a2c-8285-1c34a43eea35 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.796929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1b26e-2fdf-4a2c-8285-1c34a43eea35 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.797233 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1b26e-2fdf-4a2c-8285-1c34a43eea35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.805091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 795/1600] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:27 2022] PUT /identity/v3/projects/63136372842e4c5aa18a03179e35bcae/users/9b64df21a9aa46f78f956c8e7d4fd932/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:27.806451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abd724-5107-4bb0-af16-a3a0a8d6407a None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.806825 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abd724-5107-4bb0-af16-a3a0a8d6407a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.807105 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abd724-5107-4bb0-af16-a3a0a8d6407a None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.809110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 796/1601] 10.222.0.71 () {54 vars in 962 bytes} [Thu Sep 1 16:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:32:27.809694 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abd724-5107-4bb0-af16-a3a0a8d6407a None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.828867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-56b1b26e-2fdf-4a2c-8285-1c34a43eea35 None None] MFA Rules not processed for user `4b0020cf6bfe4c65a6bb4dad21d0f366`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:27.830100 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-56b1b26e-2fdf-4a2c-8285-1c34a43eea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:27.880570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abd724-5107-4bb0-af16-a3a0a8d6407a None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.885086 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50cefa-e238-4f71-9dd1-894dbed3d056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.885745 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50cefa-e238-4f71-9dd1-894dbed3d056 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.886030 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50cefa-e238-4f71-9dd1-894dbed3d056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.886328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50cefa-e238-4f71-9dd1-894dbed3d056 admin admin] PATH_INFO: `/v3/projects/a9a10d96a23f4af687c4fc40d667c395/users/88cd06365efb4911b40d8aa0c721c32f/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.895702 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 806/1602] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:27.896614 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1b26e-2fdf-4a2c-8285-1c34a43eea35 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.901354 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50cefa-e238-4f71-9dd1-894dbed3d056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a10d96a23f4af687c4fc40d667c395, user_id=88cd06365efb4911b40d8aa0c721c32f, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.904966 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50cefa-e238-4f71-9dd1-894dbed3d056 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.906893 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1b26e-2fdf-4a2c-8285-1c34a43eea35 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.911783 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc4372-6c9e-4889-bbaf-6cf28b028824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.912412 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc4372-6c9e-4889-bbaf-6cf28b028824 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.912658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc4372-6c9e-4889-bbaf-6cf28b028824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.912932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc4372-6c9e-4889-bbaf-6cf28b028824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.913693 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc4372-6c9e-4889-bbaf-6cf28b028824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:27.915302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc4372-6c9e-4889-bbaf-6cf28b028824 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:27.919305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 797/1603] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:27 2022] PUT /identity/v3/projects/a9a10d96a23f4af687c4fc40d667c395/users/88cd06365efb4911b40d8aa0c721c32f/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:27.923508 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50cefa-e238-4f71-9dd1-894dbed3d056 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:27.926313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 807/1604] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:27.927682 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7e27b-d7b7-4aba-bc10-a8b486761bbd None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.928055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7e27b-d7b7-4aba-bc10-a8b486761bbd None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.928422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7e27b-d7b7-4aba-bc10-a8b486761bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:27.955419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-00d7e27b-d7b7-4aba-bc10-a8b486761bbd None None] MFA Rules not processed for user `44d3f78436c543a5b9cf7178e81ff5c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:27.956529 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-00d7e27b-d7b7-4aba-bc10-a8b486761bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:27.988611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50cefa-e238-4f71-9dd1-894dbed3d056 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:27.993488 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd2bee-9f9c-4eea-92bc-2905cdb09d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:27.994278 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd2bee-9f9c-4eea-92bc-2905cdb09d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:27.994695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd2bee-9f9c-4eea-92bc-2905cdb09d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:27.995071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd2bee-9f9c-4eea-92bc-2905cdb09d78 admin admin] PATH_INFO: `/v3/projects/f612c01c5bca47d58b94ed343c8af7b0/users/6912413cfb474eb68e31c250531dfcd0/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.009420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd2bee-9f9c-4eea-92bc-2905cdb09d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f612c01c5bca47d58b94ed343c8af7b0, user_id=6912413cfb474eb68e31c250531dfcd0, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:28.012109 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd2bee-9f9c-4eea-92bc-2905cdb09d78 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:28.024327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 808/1605] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:28.025728 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a1f55-1632-41fc-aca2-b381982f50d7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.026116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a1f55-1632-41fc-aca2-b381982f50d7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.026394 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a1f55-1632-41fc-aca2-b381982f50d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.028369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 798/1606] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:27 2022] PUT /identity/v3/projects/f612c01c5bca47d58b94ed343c8af7b0/users/6912413cfb474eb68e31c250531dfcd0/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:28.030425 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d0eb8-b8d7-4f93-90d9-52838c58ac1c None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.031069 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d0eb8-b8d7-4f93-90d9-52838c58ac1c None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.031069 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d0eb8-b8d7-4f93-90d9-52838c58ac1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.050845 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2a9a1f55-1632-41fc-aca2-b381982f50d7 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:28.052051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2a9a1f55-1632-41fc-aca2-b381982f50d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:28.060116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:28.071451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-e35d0eb8-b8d7-4f93-90d9-52838c58ac1c None None] MFA Rules not processed for user `ed71d63cd24f4a6caf6ebba2c30d3608`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:28.072651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e35d0eb8-b8d7-4f93-90d9-52838c58ac1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:28.092010 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:28.115080 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 809/1607] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:28.116825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a13a0-7cc0-4c48-919b-669de78ba314 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.117104 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a13a0-7cc0-4c48-919b-669de78ba314 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.117656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a13a0-7cc0-4c48-919b-669de78ba314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.145937 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 799/1608] 10.222.0.71 () {58 vars in 1059 bytes} [Thu Sep 1 16:32:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:28.146176 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-356a13a0-7cc0-4c48-919b-669de78ba314 None None] MFA Rules not processed for user `9b64df21a9aa46f78f956c8e7d4fd932`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:28.146871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d0eb8-b8d7-4f93-90d9-52838c58ac1c None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:28.147300 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-356a13a0-7cc0-4c48-919b-669de78ba314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:28.157532 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d0eb8-b8d7-4f93-90d9-52838c58ac1c None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:28.162709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f65784-8e7f-4326-b573-e9d677db2fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:28.163382 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f65784-8e7f-4326-b573-e9d677db2fcd admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.163760 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f65784-8e7f-4326-b573-e9d677db2fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.164107 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f65784-8e7f-4326-b573-e9d677db2fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.164818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f65784-8e7f-4326-b573-e9d677db2fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:28.166828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f65784-8e7f-4326-b573-e9d677db2fcd admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:28.195802 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 800/1609] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:28 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:28.197058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8ac6d-f702-407f-b069-705dc75906db None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.197343 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8ac6d-f702-407f-b069-705dc75906db None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.197618 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8ac6d-f702-407f-b069-705dc75906db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.215524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 810/1610] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:28.216249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a13a0-7cc0-4c48-919b-669de78ba314 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:28.221367 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-27f8ac6d-f702-407f-b069-705dc75906db None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:28.222690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-27f8ac6d-f702-407f-b069-705dc75906db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:28.227703 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a13a0-7cc0-4c48-919b-669de78ba314 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:28.291872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907028f-ccd0-4403-b414-864dedd648e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:28.293261 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907028f-ccd0-4403-b414-864dedd648e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.293540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907028f-ccd0-4403-b414-864dedd648e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.293812 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907028f-ccd0-4403-b414-864dedd648e8 admin admin] PATH_INFO: `/v3/projects/c5c583a13aa046d397dfa79538a93222/users/6d98ba47977f4440bf28614a67efebd9/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.296617 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 801/1611] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:28.297866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28d10f-895f-4fd6-a628-db59a3113079 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.298149 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28d10f-895f-4fd6-a628-db59a3113079 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.298423 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28d10f-895f-4fd6-a628-db59a3113079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.309905 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907028f-ccd0-4403-b414-864dedd648e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c583a13aa046d397dfa79538a93222, user_id=6d98ba47977f4440bf28614a67efebd9, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:28.312603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907028f-ccd0-4403-b414-864dedd648e8 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:28.321292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-cd28d10f-895f-4fd6-a628-db59a3113079 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:28.322506 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-cd28d10f-895f-4fd6-a628-db59a3113079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:28.325575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 811/1612] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:28 2022] PUT /identity/v3/projects/c5c583a13aa046d397dfa79538a93222/users/6d98ba47977f4440bf28614a67efebd9/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:28.327649 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907028f-ccd0-4403-b414-864dedd648e8 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:28.359613 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:28.382932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 802/1613] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:28.383858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28d10f-895f-4fd6-a628-db59a3113079 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:28.387591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907028f-ccd0-4403-b414-864dedd648e8 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:28.391344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec91527-6f2c-44a6-b1a1-a124f005ca2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:28.391944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec91527-6f2c-44a6-b1a1-a124f005ca2b service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.392218 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec91527-6f2c-44a6-b1a1-a124f005ca2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.392486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec91527-6f2c-44a6-b1a1-a124f005ca2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.423013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:28.440354 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28d10f-895f-4fd6-a628-db59a3113079 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:28.444061 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a685fd9-cc8a-4d50-92d6-9aa175437eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:28.444680 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a685fd9-cc8a-4d50-92d6-9aa175437eba service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.444953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a685fd9-cc8a-4d50-92d6-9aa175437eba service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.445226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a685fd9-cc8a-4d50-92d6-9aa175437eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.450785 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec91527-6f2c-44a6-b1a1-a124f005ca2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:28.452306 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec91527-6f2c-44a6-b1a1-a124f005ca2b service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:28.454863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a685fd9-cc8a-4d50-92d6-9aa175437eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:28.456272 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a685fd9-cc8a-4d50-92d6-9aa175437eba service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:28.462359 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 812/1614] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:28.463271 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec91527-6f2c-44a6-b1a1-a124f005ca2b service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:28.469421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 803/1615] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:28.470370 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a685fd9-cc8a-4d50-92d6-9aa175437eba service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:28.480558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a685fd9-cc8a-4d50-92d6-9aa175437eba service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:28.487230 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b34a7b-20a0-4105-98da-ba2000362d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:28.487870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b34a7b-20a0-4105-98da-ba2000362d60 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.488157 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b34a7b-20a0-4105-98da-ba2000362d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.488436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b34a7b-20a0-4105-98da-ba2000362d60 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.489212 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b34a7b-20a0-4105-98da-ba2000362d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:28.491620 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b34a7b-20a0-4105-98da-ba2000362d60 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:28.516583 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 804/1616] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:28 2022] POST /identity/v3/users => generated 296 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:28.518342 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7601b-2fca-4ebe-9bd8-95be766d3cba None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.518661 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7601b-2fca-4ebe-9bd8-95be766d3cba None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.518936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7601b-2fca-4ebe-9bd8-95be766d3cba None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.520815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 805/1617] 10.222.0.71 () {54 vars in 962 bytes} [Thu Sep 1 16:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:32:28.521116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7601b-2fca-4ebe-9bd8-95be766d3cba None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:28.535133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7601b-2fca-4ebe-9bd8-95be766d3cba None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:28.539257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c95c57-41b7-4b9b-90e2-6c1250537a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:28.539888 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c95c57-41b7-4b9b-90e2-6c1250537a5b service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.540169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c95c57-41b7-4b9b-90e2-6c1250537a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.540442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c95c57-41b7-4b9b-90e2-6c1250537a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.550210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec91527-6f2c-44a6-b1a1-a124f005ca2b service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:28.551782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c95c57-41b7-4b9b-90e2-6c1250537a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:28.553734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c95c57-41b7-4b9b-90e2-6c1250537a5b service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:28.556464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514ee8c-aadd-496e-beeb-59d810bbeb59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:28.557144 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514ee8c-aadd-496e-beeb-59d810bbeb59 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.557488 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514ee8c-aadd-496e-beeb-59d810bbeb59 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.557823 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514ee8c-aadd-496e-beeb-59d810bbeb59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.565271 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 806/1618] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:28.567445 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86374b24-b27c-48e4-894a-44269dd19779 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.567813 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86374b24-b27c-48e4-894a-44269dd19779 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.568157 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86374b24-b27c-48e4-894a-44269dd19779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.595097 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-86374b24-b27c-48e4-894a-44269dd19779 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:28.597320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-86374b24-b27c-48e4-894a-44269dd19779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:28.606838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 807/1619] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:28.610217 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86374b24-b27c-48e4-894a-44269dd19779 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:28.630563 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86374b24-b27c-48e4-894a-44269dd19779 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:28.635057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a7262-3e43-44ca-85ea-bd224e28e508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:28.635972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a7262-3e43-44ca-85ea-bd224e28e508 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.637011 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a7262-3e43-44ca-85ea-bd224e28e508 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.637358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a7262-3e43-44ca-85ea-bd224e28e508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.647660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514ee8c-aadd-496e-beeb-59d810bbeb59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:28.648591 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a7262-3e43-44ca-85ea-bd224e28e508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:28.649800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514ee8c-aadd-496e-beeb-59d810bbeb59 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:28.650254 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a7262-3e43-44ca-85ea-bd224e28e508 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:28.662417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 808/1620] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:28.663396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a7262-3e43-44ca-85ea-bd224e28e508 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:28.665387 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 813/1621] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:28.667222 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fac244-e32d-48a3-a357-1fe1628a6195 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.667697 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fac244-e32d-48a3-a357-1fe1628a6195 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.668041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fac244-e32d-48a3-a357-1fe1628a6195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.691208 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a7262-3e43-44ca-85ea-bd224e28e508 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:28.693427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-93fac244-e32d-48a3-a357-1fe1628a6195 None None] MFA Rules not processed for user `ed71d63cd24f4a6caf6ebba2c30d3608`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:28.696009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-93fac244-e32d-48a3-a357-1fe1628a6195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:28.706357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e401907-67e0-46a8-aa20-8eb8c5036825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:28.707084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e401907-67e0-46a8-aa20-8eb8c5036825 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.707428 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e401907-67e0-46a8-aa20-8eb8c5036825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.707839 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e401907-67e0-46a8-aa20-8eb8c5036825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.708567 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e401907-67e0-46a8-aa20-8eb8c5036825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:28.712594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e401907-67e0-46a8-aa20-8eb8c5036825 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:28.713172 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 814/1622] 10.222.0.71 () {58 vars in 1059 bytes} [Thu Sep 1 16:32:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:28.714644 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fac244-e32d-48a3-a357-1fe1628a6195 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:28.732186 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fac244-e32d-48a3-a357-1fe1628a6195 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:28.741501 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51241061-303d-4fea-83d3-9a08302fdfe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:28.742346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51241061-303d-4fea-83d3-9a08302fdfe7 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.742713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51241061-303d-4fea-83d3-9a08302fdfe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.742992 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51241061-303d-4fea-83d3-9a08302fdfe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.750878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 809/1623] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:28.751916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e401907-67e0-46a8-aa20-8eb8c5036825 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:28.762118 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51241061-303d-4fea-83d3-9a08302fdfe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:28.764813 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51241061-303d-4fea-83d3-9a08302fdfe7 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:28.772955 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:28.779056 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e401907-67e0-46a8-aa20-8eb8c5036825 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:28.785866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc4030-9dc1-4620-a35f-6c3033b2d190 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:28.786870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc4030-9dc1-4620-a35f-6c3033b2d190 service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.787253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc4030-9dc1-4620-a35f-6c3033b2d190 service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.787623 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc4030-9dc1-4620-a35f-6c3033b2d190 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.788669 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 815/1624] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:28.804448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51241061-303d-4fea-83d3-9a08302fdfe7 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:28.845949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51241061-303d-4fea-83d3-9a08302fdfe7 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:28.858457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44cdca-2377-48ab-b8c1-083b6b3ef8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:28.859179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44cdca-2377-48ab-b8c1-083b6b3ef8e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:28.859442 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44cdca-2377-48ab-b8c1-083b6b3ef8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:28.859715 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44cdca-2377-48ab-b8c1-083b6b3ef8e2 admin admin] PATH_INFO: `/v3/projects/1ce3f7ed9b80485093bb70a40ffc00c2/users/17326a8900ab4cfcb9caa6234cd4cd7d/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:28.865828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc4030-9dc1-4620-a35f-6c3033b2d190 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:28.867912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc4030-9dc1-4620-a35f-6c3033b2d190 service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:28.892828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 810/1625] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:28.896643 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44cdca-2377-48ab-b8c1-083b6b3ef8e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce3f7ed9b80485093bb70a40ffc00c2, user_id=17326a8900ab4cfcb9caa6234cd4cd7d, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:28.899989 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44cdca-2377-48ab-b8c1-083b6b3ef8e2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:28.928726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 816/1626] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:28 2022] PUT /identity/v3/projects/1ce3f7ed9b80485093bb70a40ffc00c2/users/17326a8900ab4cfcb9caa6234cd4cd7d/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:28.930290 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc4030-9dc1-4620-a35f-6c3033b2d190 service nova] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:28.947954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc4030-9dc1-4620-a35f-6c3033b2d190 service nova] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:29.076202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b8387-bb7c-4072-b571-72833e3ce70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:29.076948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b8387-bb7c-4072-b571-72833e3ce70d admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:29.077237 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b8387-bb7c-4072-b571-72833e3ce70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:29.077505 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b8387-bb7c-4072-b571-72833e3ce70d admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:29.078266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b8387-bb7c-4072-b571-72833e3ce70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:29.080088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b8387-bb7c-4072-b571-72833e3ce70d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:29.104237 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 811/1627] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:29.105683 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44cdca-2377-48ab-b8c1-083b6b3ef8e2 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:29.121647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44cdca-2377-48ab-b8c1-083b6b3ef8e2 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:29.178366 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dbd6a-f8bc-4b07-9953-004ea196c8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:29.179085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dbd6a-f8bc-4b07-9953-004ea196c8a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:29.179362 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dbd6a-f8bc-4b07-9953-004ea196c8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:29.179636 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dbd6a-f8bc-4b07-9953-004ea196c8a6 admin admin] PATH_INFO: `/v3/projects/1ce3f7ed9b80485093bb70a40ffc00c2/users/17326a8900ab4cfcb9caa6234cd4cd7d/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:29.192386 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dbd6a-f8bc-4b07-9953-004ea196c8a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce3f7ed9b80485093bb70a40ffc00c2, user_id=17326a8900ab4cfcb9caa6234cd4cd7d, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:29.199714 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dbd6a-f8bc-4b07-9953-004ea196c8a6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:29.259165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 817/1628] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:29 2022] PUT /identity/v3/projects/1ce3f7ed9b80485093bb70a40ffc00c2/users/17326a8900ab4cfcb9caa6234cd4cd7d/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:29.266759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecab284-198b-4ac2-bbd7-059ba657e216 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:29.267273 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecab284-198b-4ac2-bbd7-059ba657e216 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:29.267727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecab284-198b-4ac2-bbd7-059ba657e216 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:29.270075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 812/1629] 10.222.0.71 () {54 vars in 912 bytes} [Thu Sep 1 16:32:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:32:29.272722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54cb88-46e3-4b0a-98c7-8cc6d6445ff1 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:29.273009 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54cb88-46e3-4b0a-98c7-8cc6d6445ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:29.273286 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54cb88-46e3-4b0a-98c7-8cc6d6445ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:29.276282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db1a73-10d5-4eb6-b8cd-576339ec88ea None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:29.276753 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db1a73-10d5-4eb6-b8cd-576339ec88ea None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:29.277430 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db1a73-10d5-4eb6-b8cd-576339ec88ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:29.334222 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-73db1a73-10d5-4eb6-b8cd-576339ec88ea None None] MFA Rules not processed for user `ed71d63cd24f4a6caf6ebba2c30d3608`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:29.335792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-73db1a73-10d5-4eb6-b8cd-576339ec88ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:29.349528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:29.372976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-fb54cb88-46e3-4b0a-98c7-8cc6d6445ff1 None None] MFA Rules not processed for user `17326a8900ab4cfcb9caa6234cd4cd7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:29.374207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-fb54cb88-46e3-4b0a-98c7-8cc6d6445ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:29.489751 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 818/1630] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Sep 1 16:32:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:32:29.493225 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c19e39-cd31-4f36-bc2c-c0696e3debd6 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:29.493575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c19e39-cd31-4f36-bc2c-c0696e3debd6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:29.493917 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c19e39-cd31-4f36-bc2c-c0696e3debd6 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:29.504606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 819/1631] 10.222.0.71 () {54 vars in 912 bytes} [Thu Sep 1 16:32:29 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:32:29.506014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1147de-204b-4f98-adc4-18c26d5997c6 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:29.507282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1147de-204b-4f98-adc4-18c26d5997c6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:29.507452 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1147de-204b-4f98-adc4-18c26d5997c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:29.562944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5f1147de-204b-4f98-adc4-18c26d5997c6 None None] MFA Rules not processed for user `ed71d63cd24f4a6caf6ebba2c30d3608`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:29.564503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5f1147de-204b-4f98-adc4-18c26d5997c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:29.574408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 813/1632] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:32:29.574408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54cb88-46e3-4b0a-98c7-8cc6d6445ff1 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:29.593577 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 820/1633] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Sep 1 16:32:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:29.595336 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1147de-204b-4f98-adc4-18c26d5997c6 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:29.687405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54cb88-46e3-4b0a-98c7-8cc6d6445ff1 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:29.691872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d6e4a-7b55-4b6f-a21d-883effe43f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:29.692556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d6e4a-7b55-4b6f-a21d-883effe43f9c service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:29.692904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d6e4a-7b55-4b6f-a21d-883effe43f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:29.693241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d6e4a-7b55-4b6f-a21d-883effe43f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:29.697593 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1147de-204b-4f98-adc4-18c26d5997c6 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:29.703314 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73af983-0192-438b-84b6-ba6d63fd8902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:29.704247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73af983-0192-438b-84b6-ba6d63fd8902 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:29.705151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73af983-0192-438b-84b6-ba6d63fd8902 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:29.705520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d6e4a-7b55-4b6f-a21d-883effe43f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:29.706111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73af983-0192-438b-84b6-ba6d63fd8902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:29.707130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d6e4a-7b55-4b6f-a21d-883effe43f9c service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:29.720886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73af983-0192-438b-84b6-ba6d63fd8902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:29.722639 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73af983-0192-438b-84b6-ba6d63fd8902 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:29.735800 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 814/1634] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:29.736093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 821/1635] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:29.791039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d6e4a-7b55-4b6f-a21d-883effe43f9c service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:29.800582 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d6e4a-7b55-4b6f-a21d-883effe43f9c service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:29.805758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287be30-901e-450c-9002-0cb5ec4323e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:29.806471 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287be30-901e-450c-9002-0cb5ec4323e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:29.807135 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287be30-901e-450c-9002-0cb5ec4323e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:29.807490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287be30-901e-450c-9002-0cb5ec4323e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:29.821181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287be30-901e-450c-9002-0cb5ec4323e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:29.822779 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287be30-901e-450c-9002-0cb5ec4323e3 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:29.852742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 815/1636] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:30.044850 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73af983-0192-438b-84b6-ba6d63fd8902 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:30.057539 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73af983-0192-438b-84b6-ba6d63fd8902 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:30.069606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caf833-504e-4577-a90c-3ae56f0f07d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:30.071820 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caf833-504e-4577-a90c-3ae56f0f07d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:30.072498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caf833-504e-4577-a90c-3ae56f0f07d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:30.072783 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caf833-504e-4577-a90c-3ae56f0f07d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:30.213640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:30.258811 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77caf833-504e-4577-a90c-3ae56f0f07d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:30.258811 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77caf833-504e-4577-a90c-3ae56f0f07d1 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:30.260844 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287be30-901e-450c-9002-0cb5ec4323e3 service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:30.282217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 822/1637] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:30.440900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287be30-901e-450c-9002-0cb5ec4323e3 service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:30.455346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd139561-62dd-4d00-be88-4df7a5b906ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:30.460139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd139561-62dd-4d00-be88-4df7a5b906ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:30.460139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd139561-62dd-4d00-be88-4df7a5b906ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:30.460139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd139561-62dd-4d00-be88-4df7a5b906ea admin admin] PATH_INFO: `/v3/users/9b64df21a9aa46f78f956c8e7d4fd932` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:30.464753 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd139561-62dd-4d00-be88-4df7a5b906ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b64df21a9aa46f78f956c8e7d4fd932)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:30.467801 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd139561-62dd-4d00-be88-4df7a5b906ea admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:30.544670 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:30.574586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-fd139561-62dd-4d00-be88-4df7a5b906ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b64df21a9aa46f78f956c8e7d4fd932'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:30.575720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-fd139561-62dd-4d00-be88-4df7a5b906ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b64df21a9aa46f78f956c8e7d4fd932'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:30.600289 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-fd139561-62dd-4d00-be88-4df7a5b906ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b64df21a9aa46f78f956c8e7d4fd932'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:30.612796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-fd139561-62dd-4d00-be88-4df7a5b906ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b64df21a9aa46f78f956c8e7d4fd932'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:30.623144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-fd139561-62dd-4d00-be88-4df7a5b906ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b64df21a9aa46f78f956c8e7d4fd932'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:30.631882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 816/1638] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:32:30 2022] DELETE /identity/v3/users/9b64df21a9aa46f78f956c8e7d4fd932 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:30.635822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb46077-8785-4ac7-adec-9821f0ebbcd8 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:30.636869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb46077-8785-4ac7-adec-9821f0ebbcd8 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:30.637495 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb46077-8785-4ac7-adec-9821f0ebbcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:30.699229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9bb46077-8785-4ac7-adec-9821f0ebbcd8 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:30.713626 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9bb46077-8785-4ac7-adec-9821f0ebbcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:30.881549 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 823/1639] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:30.903706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd139561-62dd-4d00-be88-4df7a5b906ea admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:30.905292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-fd139561-62dd-4d00-be88-4df7a5b906ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:31.047443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd139561-62dd-4d00-be88-4df7a5b906ea admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:31.055021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a3bcc-1da9-44c6-92b5-720e0169b296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:31.059565 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a3bcc-1da9-44c6-92b5-720e0169b296 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:31.060423 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a3bcc-1da9-44c6-92b5-720e0169b296 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:31.061102 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a3bcc-1da9-44c6-92b5-720e0169b296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:31.088634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a3bcc-1da9-44c6-92b5-720e0169b296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:31.092404 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a3bcc-1da9-44c6-92b5-720e0169b296 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:31.116451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 817/1640] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:32.121924 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb46077-8785-4ac7-adec-9821f0ebbcd8 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:32.124244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9bb46077-8785-4ac7-adec-9821f0ebbcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:32.146333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb46077-8785-4ac7-adec-9821f0ebbcd8 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:32.156947 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787ad7a-e5da-4529-903f-70ce9723f292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:32.158031 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787ad7a-e5da-4529-903f-70ce9723f292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:32.158503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787ad7a-e5da-4529-903f-70ce9723f292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:32.159002 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787ad7a-e5da-4529-903f-70ce9723f292 admin admin] PATH_INFO: `/v3/projects/63136372842e4c5aa18a03179e35bcae` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:32.162968 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787ad7a-e5da-4529-903f-70ce9723f292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63136372842e4c5aa18a03179e35bcae)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:32.165646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787ad7a-e5da-4529-903f-70ce9723f292 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:32.284743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-0787ad7a-e5da-4529-903f-70ce9723f292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63136372842e4c5aa18a03179e35bcae', 'request_id': 'req-0787ad7a-e5da-4529-903f-70ce9723f292'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:32.297952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-0787ad7a-e5da-4529-903f-70ce9723f292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63136372842e4c5aa18a03179e35bcae', 'request_id': 'req-0787ad7a-e5da-4529-903f-70ce9723f292'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:32.320367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-0787ad7a-e5da-4529-903f-70ce9723f292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63136372842e4c5aa18a03179e35bcae', 'request_id': 'req-0787ad7a-e5da-4529-903f-70ce9723f292'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:32.346603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-0787ad7a-e5da-4529-903f-70ce9723f292 admin admin] The token cache is being invalidate because project 63136372842e4c5aa18a03179e35bcae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:32:32.346935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-0787ad7a-e5da-4529-903f-70ce9723f292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:32.349285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-0787ad7a-e5da-4529-903f-70ce9723f292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:32.361091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 824/1641] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:32:32 2022] DELETE /identity/v3/projects/63136372842e4c5aa18a03179e35bcae => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:32.361304 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9fd5e-46c4-4b19-8eba-669f6c2b5c9c None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:32.361304 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9fd5e-46c4-4b19-8eba-669f6c2b5c9c None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:32.361304 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9fd5e-46c4-4b19-8eba-669f6c2b5c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:32.404793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-abf9fd5e-46c4-4b19-8eba-669f6c2b5c9c None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:32.416680 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-abf9fd5e-46c4-4b19-8eba-669f6c2b5c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:32.569717 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0ed9-6aa7-4720-9662-7522efba0409 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:32.570381 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0ed9-6aa7-4720-9662-7522efba0409 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:32.571078 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0ed9-6aa7-4720-9662-7522efba0409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:32.578176 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 818/1642] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:32:32.607546 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-e1bd0ed9-6aa7-4720-9662-7522efba0409 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:32.609159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e1bd0ed9-6aa7-4720-9662-7522efba0409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:32.639564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9fd5e-46c4-4b19-8eba-669f6c2b5c9c None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:32.640254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 825/1643] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:32.655070 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9fd5e-46c4-4b19-8eba-669f6c2b5c9c None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:32.664361 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4371e17-545b-4743-ac17-2846f793c301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:32.665000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4371e17-545b-4743-ac17-2846f793c301 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:32.665284 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4371e17-545b-4743-ac17-2846f793c301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:32.665555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4371e17-545b-4743-ac17-2846f793c301 admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:32.666915 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4371e17-545b-4743-ac17-2846f793c301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:32:32.667160 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4371e17-545b-4743-ac17-2846f793c301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:32.676078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4371e17-545b-4743-ac17-2846f793c301 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:32.708700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 819/1644] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:32:32.723801 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd0ed9-6aa7-4720-9662-7522efba0409 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:32.737476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd0ed9-6aa7-4720-9662-7522efba0409 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:32.750228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433843b0-85ca-4588-835f-def20ee9cc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:32.750228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433843b0-85ca-4588-835f-def20ee9cc8a admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:32.750228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433843b0-85ca-4588-835f-def20ee9cc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:32.750560 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433843b0-85ca-4588-835f-def20ee9cc8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:32.751236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433843b0-85ca-4588-835f-def20ee9cc8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:32.756380 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433843b0-85ca-4588-835f-def20ee9cc8a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:32.819572 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4371e17-545b-4743-ac17-2846f793c301 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:32.826841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 826/1645] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:32 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:32.834542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4371e17-545b-4743-ac17-2846f793c301 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:32.926798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:32.975388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7708e-c64f-4a7e-ae5c-c9924e558e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:32.976089 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7708e-c64f-4a7e-ae5c-c9924e558e76 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:32.976389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7708e-c64f-4a7e-ae5c-c9924e558e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:32.976599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7708e-c64f-4a7e-ae5c-c9924e558e76 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:32.977219 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7708e-c64f-4a7e-ae5c-c9924e558e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:32.979313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7708e-c64f-4a7e-ae5c-c9924e558e76 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:33.022485 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 820/1646] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:32 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:33.026700 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433843b0-85ca-4588-835f-def20ee9cc8a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:33.037614 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433843b0-85ca-4588-835f-def20ee9cc8a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:33.058951 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41719559-00f2-46c0-99d0-f9d8e22b80ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:33.059606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41719559-00f2-46c0-99d0-f9d8e22b80ff admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:33.059886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41719559-00f2-46c0-99d0-f9d8e22b80ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:33.060159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41719559-00f2-46c0-99d0-f9d8e22b80ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:33.060815 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41719559-00f2-46c0-99d0-f9d8e22b80ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:33.062521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41719559-00f2-46c0-99d0-f9d8e22b80ff admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:33.102688 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7708e-c64f-4a7e-ae5c-c9924e558e76 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:33.102976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 827/1647] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:33.115024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7708e-c64f-4a7e-ae5c-c9924e558e76 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:33.126305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67a3f5-bda4-45f9-b309-898a482ab464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:33.126954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67a3f5-bda4-45f9-b309-898a482ab464 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:33.127236 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67a3f5-bda4-45f9-b309-898a482ab464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:33.127513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67a3f5-bda4-45f9-b309-898a482ab464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:33.128163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67a3f5-bda4-45f9-b309-898a482ab464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:33.129868 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67a3f5-bda4-45f9-b309-898a482ab464 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:33.158332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41719559-00f2-46c0-99d0-f9d8e22b80ff admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:33.170083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41719559-00f2-46c0-99d0-f9d8e22b80ff admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:33.170755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 821/1648] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:33.197780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba5b28-aa50-4cc9-a01c-19d7aec6967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:33.199083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba5b28-aa50-4cc9-a01c-19d7aec6967e admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:33.199368 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba5b28-aa50-4cc9-a01c-19d7aec6967e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:33.199644 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba5b28-aa50-4cc9-a01c-19d7aec6967e admin admin] PATH_INFO: `/v3/projects/71325e8e265d42ab968e2f0fcd1328a1/users/5027b1a6491b4efca25c826727149bae/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:33.231971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba5b28-aa50-4cc9-a01c-19d7aec6967e admin admin] RBAC: Authorizing `identity:create_grant(project_id=71325e8e265d42ab968e2f0fcd1328a1, user_id=5027b1a6491b4efca25c826727149bae, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:33.238009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba5b28-aa50-4cc9-a01c-19d7aec6967e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:33.265448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 828/1649] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:33 2022] PUT /identity/v3/projects/71325e8e265d42ab968e2f0fcd1328a1/users/5027b1a6491b4efca25c826727149bae/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:33.278667 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dfefc-393b-45b7-91dd-c79321dd844b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:33.278980 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dfefc-393b-45b7-91dd-c79321dd844b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:33.279226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dfefc-393b-45b7-91dd-c79321dd844b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:33.323164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-547dfefc-393b-45b7-91dd-c79321dd844b None None] MFA Rules not processed for user `5027b1a6491b4efca25c826727149bae`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:33.324644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-547dfefc-393b-45b7-91dd-c79321dd844b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:33.433709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 822/1650] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:33.434394 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba5b28-aa50-4cc9-a01c-19d7aec6967e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:33.447276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:33.525680 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba5b28-aa50-4cc9-a01c-19d7aec6967e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:33.531757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f18892-8723-47b9-adf3-4f2a029e163d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:33.532550 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f18892-8723-47b9-adf3-4f2a029e163d admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:33.532937 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f18892-8723-47b9-adf3-4f2a029e163d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:33.533304 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f18892-8723-47b9-adf3-4f2a029e163d admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:33.534101 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f18892-8723-47b9-adf3-4f2a029e163d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:33.536215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f18892-8723-47b9-adf3-4f2a029e163d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:33.605632 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 829/1651] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:33 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:32:33.609600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dfefc-393b-45b7-91dd-c79321dd844b None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:33.623795 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dfefc-393b-45b7-91dd-c79321dd844b None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:33.768962 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ce65d-31c1-4986-b0b2-84e5c980a843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:33.769618 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ce65d-31c1-4986-b0b2-84e5c980a843 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:33.769896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ce65d-31c1-4986-b0b2-84e5c980a843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:33.770167 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ce65d-31c1-4986-b0b2-84e5c980a843 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:33.770868 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ce65d-31c1-4986-b0b2-84e5c980a843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:33.772822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ce65d-31c1-4986-b0b2-84e5c980a843 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:33.825942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 823/1652] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:33 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:32:33.827022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f18892-8723-47b9-adf3-4f2a029e163d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:33.843003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f18892-8723-47b9-adf3-4f2a029e163d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:33.851500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990db4c2-0591-4ba4-97e5-a0221b0891e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:33.852134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990db4c2-0591-4ba4-97e5-a0221b0891e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:33.852545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990db4c2-0591-4ba4-97e5-a0221b0891e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:33.852860 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990db4c2-0591-4ba4-97e5-a0221b0891e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:33.853695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990db4c2-0591-4ba4-97e5-a0221b0891e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:33.856926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990db4c2-0591-4ba4-97e5-a0221b0891e0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:33.871325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 830/1653] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:32:33.877218 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ce65d-31c1-4986-b0b2-84e5c980a843 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:33.893972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ce65d-31c1-4986-b0b2-84e5c980a843 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:33.902905 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdeab58-ede9-4d68-80d4-63e8fe62c16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:33.903576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdeab58-ede9-4d68-80d4-63e8fe62c16f admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:33.903859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdeab58-ede9-4d68-80d4-63e8fe62c16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:33.904137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdeab58-ede9-4d68-80d4-63e8fe62c16f admin admin] PATH_INFO: `/v3/projects/d4b84105cc584c3fb210275761717d29/users/d86d1a3f45fb4dcaac11a5841df65745/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:33.928405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdeab58-ede9-4d68-80d4-63e8fe62c16f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b84105cc584c3fb210275761717d29, user_id=d86d1a3f45fb4dcaac11a5841df65745, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:33.931752 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdeab58-ede9-4d68-80d4-63e8fe62c16f admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:33.977207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 824/1654] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:33 2022] PUT /identity/v3/projects/d4b84105cc584c3fb210275761717d29/users/d86d1a3f45fb4dcaac11a5841df65745/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:33.979503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990db4c2-0591-4ba4-97e5-a0221b0891e0 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:33.998144 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990db4c2-0591-4ba4-97e5-a0221b0891e0 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:34.117873 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94814d-e436-406b-9012-8077bd780a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:34.118832 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94814d-e436-406b-9012-8077bd780a3a admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:34.119111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94814d-e436-406b-9012-8077bd780a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:34.121138 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94814d-e436-406b-9012-8077bd780a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:34.127151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94814d-e436-406b-9012-8077bd780a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:34.129560 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94814d-e436-406b-9012-8077bd780a3a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:34.148584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 831/1655] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:34.150288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdeab58-ede9-4d68-80d4-63e8fe62c16f admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:34.165250 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdeab58-ede9-4d68-80d4-63e8fe62c16f admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:34.175675 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b6c10-885f-4b04-98a3-fcca441c06a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:34.176701 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b6c10-885f-4b04-98a3-fcca441c06a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:34.177979 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b6c10-885f-4b04-98a3-fcca441c06a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:34.178553 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b6c10-885f-4b04-98a3-fcca441c06a9 admin admin] PATH_INFO: `/v3/projects/d4b84105cc584c3fb210275761717d29/users/d86d1a3f45fb4dcaac11a5841df65745/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:34.181428 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b6c10-885f-4b04-98a3-fcca441c06a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b84105cc584c3fb210275761717d29, user_id=d86d1a3f45fb4dcaac11a5841df65745, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:34.187761 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b6c10-885f-4b04-98a3-fcca441c06a9 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:34.193256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:34.212200 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 825/1656] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:34 2022] PUT /identity/v3/projects/d4b84105cc584c3fb210275761717d29/users/d86d1a3f45fb4dcaac11a5841df65745/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:34.218822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7a6fb-33af-40ce-bbf6-923c554cb470 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:34.218822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7a6fb-33af-40ce-bbf6-923c554cb470 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:34.218822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7a6fb-33af-40ce-bbf6-923c554cb470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:34.270181 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b2c7a6fb-33af-40ce-bbf6-923c554cb470 None None] MFA Rules not processed for user `d86d1a3f45fb4dcaac11a5841df65745`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:34.278017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b2c7a6fb-33af-40ce-bbf6-923c554cb470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:34.439942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 832/1657] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:34.484700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b6c10-885f-4b04-98a3-fcca441c06a9 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:34.487456 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-222b6c10-885f-4b04-98a3-fcca441c06a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:34.572863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b6c10-885f-4b04-98a3-fcca441c06a9 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:34.579165 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f7484-5604-43ad-a9f3-8bf7af233ff6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:34.579794 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f7484-5604-43ad-a9f3-8bf7af233ff6 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:34.580069 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f7484-5604-43ad-a9f3-8bf7af233ff6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:34.580338 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f7484-5604-43ad-a9f3-8bf7af233ff6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:34.599086 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f7484-5604-43ad-a9f3-8bf7af233ff6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:34.600528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f7484-5604-43ad-a9f3-8bf7af233ff6 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:34.612293 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 826/1658] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:36.106427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7a6fb-33af-40ce-bbf6-923c554cb470 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:36.113746 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:36.285019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7a6fb-33af-40ce-bbf6-923c554cb470 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:36.290024 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6797ac7-0e70-49da-a686-16e735a07545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:36.290893 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6797ac7-0e70-49da-a686-16e735a07545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:36.291316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6797ac7-0e70-49da-a686-16e735a07545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:36.291753 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6797ac7-0e70-49da-a686-16e735a07545 admin admin] PATH_INFO: `/v3/users/5027b1a6491b4efca25c826727149bae` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:36.296395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6797ac7-0e70-49da-a686-16e735a07545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5027b1a6491b4efca25c826727149bae)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:36.297782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: WARNING py.warnings [None req-e6797ac7-0e70-49da-a686-16e735a07545 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:32:36.297782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: warnings.warn(msg) Sep 01 16:32:36.297782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: Sep 01 16:32:36.299413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6797ac7-0e70-49da-a686-16e735a07545 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:36.657554 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e6797ac7-0e70-49da-a686-16e735a07545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5027b1a6491b4efca25c826727149bae'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:36.666768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e6797ac7-0e70-49da-a686-16e735a07545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5027b1a6491b4efca25c826727149bae'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:36.700475 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e6797ac7-0e70-49da-a686-16e735a07545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5027b1a6491b4efca25c826727149bae'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:36.849004 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e6797ac7-0e70-49da-a686-16e735a07545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5027b1a6491b4efca25c826727149bae'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:36.885253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e6797ac7-0e70-49da-a686-16e735a07545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5027b1a6491b4efca25c826727149bae'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:36.915165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 833/1659] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:32:36 2022] DELETE /identity/v3/users/5027b1a6491b4efca25c826727149bae => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:36.917178 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38732-f586-4643-a8c4-4202b5ef3faa None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:36.918491 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38732-f586-4643-a8c4-4202b5ef3faa None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:36.918994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38732-f586-4643-a8c4-4202b5ef3faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:36.925439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6797ac7-0e70-49da-a686-16e735a07545 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:36.927600 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e6797ac7-0e70-49da-a686-16e735a07545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:36.969653 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-b7f38732-f586-4643-a8c4-4202b5ef3faa None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:36.971022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b7f38732-f586-4643-a8c4-4202b5ef3faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:37.128345 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6797ac7-0e70-49da-a686-16e735a07545 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:37.143869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65a09a-96ca-4ca5-8827-51ad21bd9414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:37.144545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65a09a-96ca-4ca5-8827-51ad21bd9414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:37.149086 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65a09a-96ca-4ca5-8827-51ad21bd9414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:37.150584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65a09a-96ca-4ca5-8827-51ad21bd9414 admin admin] PATH_INFO: `/v3/users/89a6c0042fc447c39aa7ebe9c9017b82` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:37.153204 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65a09a-96ca-4ca5-8827-51ad21bd9414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a6c0042fc447c39aa7ebe9c9017b82)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:37.156755 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65a09a-96ca-4ca5-8827-51ad21bd9414 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:37.171922 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 827/1660] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:37.184940 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:37.234570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f38732-f586-4643-a8c4-4202b5ef3faa None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:37.236151 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b7f38732-f586-4643-a8c4-4202b5ef3faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:37.244961 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9b65a09a-96ca-4ca5-8827-51ad21bd9414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a6c0042fc447c39aa7ebe9c9017b82'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:37.247513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9b65a09a-96ca-4ca5-8827-51ad21bd9414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a6c0042fc447c39aa7ebe9c9017b82'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:37.264283 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9b65a09a-96ca-4ca5-8827-51ad21bd9414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a6c0042fc447c39aa7ebe9c9017b82'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:37.294852 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9b65a09a-96ca-4ca5-8827-51ad21bd9414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a6c0042fc447c39aa7ebe9c9017b82'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:37.311019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9b65a09a-96ca-4ca5-8827-51ad21bd9414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a6c0042fc447c39aa7ebe9c9017b82'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:37.331450 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 834/1661] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:32:36 2022] DELETE /identity/v3/users/89a6c0042fc447c39aa7ebe9c9017b82 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:32:37.338073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f28e3e-2b8d-403d-9f50-da596518d425 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:37.339001 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f28e3e-2b8d-403d-9f50-da596518d425 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:37.339448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f28e3e-2b8d-403d-9f50-da596518d425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:37.405430 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-e4f28e3e-2b8d-403d-9f50-da596518d425 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:37.406760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e4f28e3e-2b8d-403d-9f50-da596518d425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:37.451805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f38732-f586-4643-a8c4-4202b5ef3faa None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:37.548904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 835/1662] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:37.580302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40c5ee-3d21-48a7-86c9-128ed8109d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:37.583850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40c5ee-3d21-48a7-86c9-128ed8109d8b service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:37.584342 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40c5ee-3d21-48a7-86c9-128ed8109d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:37.584826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40c5ee-3d21-48a7-86c9-128ed8109d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:37.587992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5a40c5ee-3d21-48a7-86c9-128ed8109d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:37.626764 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40c5ee-3d21-48a7-86c9-128ed8109d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:37.627260 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f28e3e-2b8d-403d-9f50-da596518d425 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:37.629487 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40c5ee-3d21-48a7-86c9-128ed8109d8b service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:37.629893 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e4f28e3e-2b8d-403d-9f50-da596518d425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:37.634354 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:37.653559 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f28e3e-2b8d-403d-9f50-da596518d425 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:37.655082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 828/1663] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:32:37.672299 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83ddf7-78e6-46e5-bae9-ff95b730bc9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:37.672299 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83ddf7-78e6-46e5-bae9-ff95b730bc9f service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:37.672299 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83ddf7-78e6-46e5-bae9-ff95b730bc9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:37.672617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83ddf7-78e6-46e5-bae9-ff95b730bc9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:37.697036 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83ddf7-78e6-46e5-bae9-ff95b730bc9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:37.701072 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83ddf7-78e6-46e5-bae9-ff95b730bc9f service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:37.728762 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 836/1664] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:32:39.436708 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40c5ee-3d21-48a7-86c9-128ed8109d8b service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:39.439516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5a40c5ee-3d21-48a7-86c9-128ed8109d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:39.494589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40c5ee-3d21-48a7-86c9-128ed8109d8b service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:39.510199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50546cd-d279-49c4-acac-b0263ab99de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:39.511847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50546cd-d279-49c4-acac-b0263ab99de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:39.515132 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50546cd-d279-49c4-acac-b0263ab99de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:39.515665 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50546cd-d279-49c4-acac-b0263ab99de0 admin admin] PATH_INFO: `/v3/projects/71325e8e265d42ab968e2f0fcd1328a1` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:39.519667 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50546cd-d279-49c4-acac-b0263ab99de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71325e8e265d42ab968e2f0fcd1328a1)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:39.521305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: WARNING py.warnings [None req-f50546cd-d279-49c4-acac-b0263ab99de0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:32:39.521305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: warnings.warn(msg) Sep 01 16:32:39.521305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: Sep 01 16:32:39.527650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50546cd-d279-49c4-acac-b0263ab99de0 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:39.644494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f50546cd-d279-49c4-acac-b0263ab99de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71325e8e265d42ab968e2f0fcd1328a1', 'request_id': 'req-f50546cd-d279-49c4-acac-b0263ab99de0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:39.659185 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f50546cd-d279-49c4-acac-b0263ab99de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71325e8e265d42ab968e2f0fcd1328a1', 'request_id': 'req-f50546cd-d279-49c4-acac-b0263ab99de0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:39.680441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f50546cd-d279-49c4-acac-b0263ab99de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71325e8e265d42ab968e2f0fcd1328a1', 'request_id': 'req-f50546cd-d279-49c4-acac-b0263ab99de0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:39.706134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f50546cd-d279-49c4-acac-b0263ab99de0 admin admin] The token cache is being invalidate because project 71325e8e265d42ab968e2f0fcd1328a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:32:39.706420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f50546cd-d279-49c4-acac-b0263ab99de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:39.707538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f50546cd-d279-49c4-acac-b0263ab99de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:39.712203 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 829/1665] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:32:39 2022] DELETE /identity/v3/projects/71325e8e265d42ab968e2f0fcd1328a1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:39.713456 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83ddf7-78e6-46e5-bae9-ff95b730bc9f service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:39.726580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83ddf7-78e6-46e5-bae9-ff95b730bc9f service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:39.899004 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72088d62-e9a9-4a30-9452-11d1ce489f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:39.900727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72088d62-e9a9-4a30-9452-11d1ce489f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:39.904518 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72088d62-e9a9-4a30-9452-11d1ce489f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:39.905034 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72088d62-e9a9-4a30-9452-11d1ce489f54 admin admin] PATH_INFO: `/v3/users/d86d1a3f45fb4dcaac11a5841df65745` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:39.907001 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72088d62-e9a9-4a30-9452-11d1ce489f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86d1a3f45fb4dcaac11a5841df65745)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:39.909527 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72088d62-e9a9-4a30-9452-11d1ce489f54 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:39.951416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50546cd-d279-49c4-acac-b0263ab99de0 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:39.952919 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f50546cd-d279-49c4-acac-b0263ab99de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:39.981184 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:39.988367 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50546cd-d279-49c4-acac-b0263ab99de0 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:40.003197 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46090b3-40d5-4590-bd8c-1183992eb53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:40.008229 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46090b3-40d5-4590-bd8c-1183992eb53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:40.008512 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46090b3-40d5-4590-bd8c-1183992eb53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:40.008792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46090b3-40d5-4590-bd8c-1183992eb53f admin admin] PATH_INFO: `/v3/projects/0642180c3c83477f9f8e3ba7e8945bd8` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:40.015519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46090b3-40d5-4590-bd8c-1183992eb53f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0642180c3c83477f9f8e3ba7e8945bd8)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:40.016654 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-72088d62-e9a9-4a30-9452-11d1ce489f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86d1a3f45fb4dcaac11a5841df65745'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:40.020835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46090b3-40d5-4590-bd8c-1183992eb53f admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:40.021639 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-72088d62-e9a9-4a30-9452-11d1ce489f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86d1a3f45fb4dcaac11a5841df65745'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:40.034868 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-72088d62-e9a9-4a30-9452-11d1ce489f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86d1a3f45fb4dcaac11a5841df65745'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:40.073018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-72088d62-e9a9-4a30-9452-11d1ce489f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86d1a3f45fb4dcaac11a5841df65745'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:40.094209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-72088d62-e9a9-4a30-9452-11d1ce489f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86d1a3f45fb4dcaac11a5841df65745'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:40.118981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 837/1666] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:32:39 2022] DELETE /identity/v3/users/d86d1a3f45fb4dcaac11a5841df65745 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:40.129818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b46090b3-40d5-4590-bd8c-1183992eb53f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0642180c3c83477f9f8e3ba7e8945bd8', 'request_id': 'req-b46090b3-40d5-4590-bd8c-1183992eb53f'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:40.139623 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b46090b3-40d5-4590-bd8c-1183992eb53f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0642180c3c83477f9f8e3ba7e8945bd8', 'request_id': 'req-b46090b3-40d5-4590-bd8c-1183992eb53f'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:40.148256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b46090b3-40d5-4590-bd8c-1183992eb53f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0642180c3c83477f9f8e3ba7e8945bd8', 'request_id': 'req-b46090b3-40d5-4590-bd8c-1183992eb53f'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:40.164790 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b46090b3-40d5-4590-bd8c-1183992eb53f admin admin] The token cache is being invalidate because project 0642180c3c83477f9f8e3ba7e8945bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:32:40.165081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b46090b3-40d5-4590-bd8c-1183992eb53f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:40.165740 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b46090b3-40d5-4590-bd8c-1183992eb53f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:40.168983 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 830/1667] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:32:39 2022] DELETE /identity/v3/projects/0642180c3c83477f9f8e3ba7e8945bd8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:32:40.176148 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad8c2-1be7-409e-ba87-09a515715438 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:40.176446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad8c2-1be7-409e-ba87-09a515715438 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:40.176724 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad8c2-1be7-409e-ba87-09a515715438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:40.200931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-798ad8c2-1be7-409e-ba87-09a515715438 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:40.202190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-798ad8c2-1be7-409e-ba87-09a515715438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:40.320260 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 838/1668] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:40.321550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b90c41-6bb4-43f6-b61f-fe2ea6be6e6b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:40.321864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b90c41-6bb4-43f6-b61f-fe2ea6be6e6b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:40.322112 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b90c41-6bb4-43f6-b61f-fe2ea6be6e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:40.394372 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-86b90c41-6bb4-43f6-b61f-fe2ea6be6e6b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:40.400088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-86b90c41-6bb4-43f6-b61f-fe2ea6be6e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:40.438921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 831/1669] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:40.442125 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ad8c2-1be7-409e-ba87-09a515715438 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:40.455190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ad8c2-1be7-409e-ba87-09a515715438 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:40.460619 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41626629-de91-4b21-a790-a4ea493e2eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:40.461746 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626629-de91-4b21-a790-a4ea493e2eba admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:40.462030 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626629-de91-4b21-a790-a4ea493e2eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:40.462300 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626629-de91-4b21-a790-a4ea493e2eba admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:40.463006 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41626629-de91-4b21-a790-a4ea493e2eba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:32:40.463307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41626629-de91-4b21-a790-a4ea493e2eba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:40.464990 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41626629-de91-4b21-a790-a4ea493e2eba admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:40.498243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 839/1670] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:32:40.499173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b90c41-6bb4-43f6-b61f-fe2ea6be6e6b None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:40.517413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b90c41-6bb4-43f6-b61f-fe2ea6be6e6b None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:40.537997 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abf22b-363f-4ea8-89eb-1be9b556857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:40.544846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abf22b-363f-4ea8-89eb-1be9b556857e admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:40.545151 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abf22b-363f-4ea8-89eb-1be9b556857e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:40.545431 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abf22b-363f-4ea8-89eb-1be9b556857e admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:40.548380 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abf22b-363f-4ea8-89eb-1be9b556857e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:40.567912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abf22b-363f-4ea8-89eb-1be9b556857e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:40.635545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 832/1671] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:40 2022] POST /identity/v3/projects => generated 405 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:32:40.642240 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41626629-de91-4b21-a790-a4ea493e2eba admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:40.655142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41626629-de91-4b21-a790-a4ea493e2eba admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:40.666406 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abf22b-363f-4ea8-89eb-1be9b556857e admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:40.669226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f3abf22b-363f-4ea8-89eb-1be9b556857e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:40.806707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:40.863275 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1b3e6-a201-4de8-97b0-2642a0b6c378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:40.865390 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1b3e6-a201-4de8-97b0-2642a0b6c378 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:40.865614 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1b3e6-a201-4de8-97b0-2642a0b6c378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:40.869354 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1b3e6-a201-4de8-97b0-2642a0b6c378 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:40.876645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1b3e6-a201-4de8-97b0-2642a0b6c378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:40.878648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1b3e6-a201-4de8-97b0-2642a0b6c378 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:40.888747 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abf22b-363f-4ea8-89eb-1be9b556857e admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:40.900820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835d09d-b104-4a25-aae8-f20f189eeb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:40.902021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835d09d-b104-4a25-aae8-f20f189eeb3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:40.906575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835d09d-b104-4a25-aae8-f20f189eeb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:40.907470 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835d09d-b104-4a25-aae8-f20f189eeb3d admin admin] PATH_INFO: `/v3/users/4b0020cf6bfe4c65a6bb4dad21d0f366` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:40.910805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835d09d-b104-4a25-aae8-f20f189eeb3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b0020cf6bfe4c65a6bb4dad21d0f366)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:40.920099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835d09d-b104-4a25-aae8-f20f189eeb3d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:40.935576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 840/1672] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:40 2022] POST /identity/v3/users => generated 303 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:40.939927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1b3e6-a201-4de8-97b0-2642a0b6c378 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:40.942813 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1bd1b3e6-a201-4de8-97b0-2642a0b6c378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:40.978032 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1b3e6-a201-4de8-97b0-2642a0b6c378 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:40.989399 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c063a-7e32-4746-a020-490695b02768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:40.990411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c063a-7e32-4746-a020-490695b02768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:40.990804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c063a-7e32-4746-a020-490695b02768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:40.991193 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c063a-7e32-4746-a020-490695b02768 admin admin] PATH_INFO: `/v3/users/44d3f78436c543a5b9cf7178e81ff5c3` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:40.998345 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c063a-7e32-4746-a020-490695b02768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d3f78436c543a5b9cf7178e81ff5c3)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:41.007854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c063a-7e32-4746-a020-490695b02768 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:41.047207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b835d09d-b104-4a25-aae8-f20f189eeb3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b0020cf6bfe4c65a6bb4dad21d0f366'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:41.050364 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b835d09d-b104-4a25-aae8-f20f189eeb3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b0020cf6bfe4c65a6bb4dad21d0f366'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:41.081886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:41.102788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b835d09d-b104-4a25-aae8-f20f189eeb3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b0020cf6bfe4c65a6bb4dad21d0f366'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:41.123717 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b835d09d-b104-4a25-aae8-f20f189eeb3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b0020cf6bfe4c65a6bb4dad21d0f366'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:41.148356 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b835d09d-b104-4a25-aae8-f20f189eeb3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b0020cf6bfe4c65a6bb4dad21d0f366'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:41.157546 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-440c063a-7e32-4746-a020-490695b02768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d3f78436c543a5b9cf7178e81ff5c3'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:41.159007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-440c063a-7e32-4746-a020-490695b02768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d3f78436c543a5b9cf7178e81ff5c3'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:41.172218 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 833/1673] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:32:40 2022] DELETE /identity/v3/users/4b0020cf6bfe4c65a6bb4dad21d0f366 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:41.173261 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835d09d-b104-4a25-aae8-f20f189eeb3d admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:41.180871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b835d09d-b104-4a25-aae8-f20f189eeb3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:41.181733 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-440c063a-7e32-4746-a020-490695b02768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d3f78436c543a5b9cf7178e81ff5c3'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:41.216974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-440c063a-7e32-4746-a020-490695b02768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d3f78436c543a5b9cf7178e81ff5c3'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:41.236599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-440c063a-7e32-4746-a020-490695b02768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d3f78436c543a5b9cf7178e81ff5c3'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:41.255196 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 841/1674] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:32:40 2022] DELETE /identity/v3/users/44d3f78436c543a5b9cf7178e81ff5c3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:41.256722 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e4192-c56a-41e2-bf7b-714a449bac35 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:41.257007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e4192-c56a-41e2-bf7b-714a449bac35 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:41.257284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e4192-c56a-41e2-bf7b-714a449bac35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:41.324340 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-711e4192-c56a-41e2-bf7b-714a449bac35 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:41.325580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-711e4192-c56a-41e2-bf7b-714a449bac35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:41.369799 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835d09d-b104-4a25-aae8-f20f189eeb3d admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:41.464073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 842/1675] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:41.465787 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f282b-ba54-447b-bba1-ae4d6a30c779 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:41.466251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f282b-ba54-447b-bba1-ae4d6a30c779 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:41.468979 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f282b-ba54-447b-bba1-ae4d6a30c779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:41.532258 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-bd2f282b-ba54-447b-bba1-ae4d6a30c779 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:41.535969 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bd2f282b-ba54-447b-bba1-ae4d6a30c779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:41.551826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd6b6f-0a15-4879-b50c-0ec7fbe3bf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:41.553936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd6b6f-0a15-4879-b50c-0ec7fbe3bf59 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:41.554209 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd6b6f-0a15-4879-b50c-0ec7fbe3bf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:41.554485 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd6b6f-0a15-4879-b50c-0ec7fbe3bf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:41.559519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd6b6f-0a15-4879-b50c-0ec7fbe3bf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:41.566919 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd6b6f-0a15-4879-b50c-0ec7fbe3bf59 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:41.575902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 843/1676] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:41.576479 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:41.577659 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f282b-ba54-447b-bba1-ae4d6a30c779 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:41.583826 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bd2f282b-ba54-447b-bba1-ae4d6a30c779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:41.609709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 834/1677] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:41.612850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd6b6f-0a15-4879-b50c-0ec7fbe3bf59 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:41.616340 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d8cd6b6f-0a15-4879-b50c-0ec7fbe3bf59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:41.656100 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd6b6f-0a15-4879-b50c-0ec7fbe3bf59 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:41.669580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91606aa-ef99-421a-8f30-8a576fe544e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:41.670310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91606aa-ef99-421a-8f30-8a576fe544e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:41.670706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91606aa-ef99-421a-8f30-8a576fe544e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:41.671073 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91606aa-ef99-421a-8f30-8a576fe544e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:41.671797 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91606aa-ef99-421a-8f30-8a576fe544e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:41.673749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91606aa-ef99-421a-8f30-8a576fe544e3 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:41.719836 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 835/1678] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:41.724206 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91606aa-ef99-421a-8f30-8a576fe544e3 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:41.740984 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91606aa-ef99-421a-8f30-8a576fe544e3 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:41.747859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f204f8d-984e-485a-8bcb-97e1119fa551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:41.749164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f204f8d-984e-485a-8bcb-97e1119fa551 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:41.749772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f204f8d-984e-485a-8bcb-97e1119fa551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:41.750234 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f204f8d-984e-485a-8bcb-97e1119fa551 admin admin] PATH_INFO: `/v3/projects/c9f534f373df463e97d9b3ee210bcc10/users/d2e807461a20444881e443ce84c1e01a/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:41.768118 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f204f8d-984e-485a-8bcb-97e1119fa551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f534f373df463e97d9b3ee210bcc10, user_id=d2e807461a20444881e443ce84c1e01a, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:41.770817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f204f8d-984e-485a-8bcb-97e1119fa551 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:41.774463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f282b-ba54-447b-bba1-ae4d6a30c779 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:41.789905 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0da39-17e3-4149-865c-9309853017f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:41.790483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 836/1679] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:41 2022] PUT /identity/v3/projects/c9f534f373df463e97d9b3ee210bcc10/users/d2e807461a20444881e443ce84c1e01a/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:41.794757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0da39-17e3-4149-865c-9309853017f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:41.794757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0da39-17e3-4149-865c-9309853017f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:41.794757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0da39-17e3-4149-865c-9309853017f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:41.802688 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7423f-2994-4518-9061-ca105c7c1a80 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:41.803237 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7423f-2994-4518-9061-ca105c7c1a80 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:41.803697 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7423f-2994-4518-9061-ca105c7c1a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:41.824362 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0da39-17e3-4149-865c-9309853017f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:41.825813 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0da39-17e3-4149-865c-9309853017f7 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:41.843829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-4df7423f-2994-4518-9061-ca105c7c1a80 None None] MFA Rules not processed for user `d2e807461a20444881e443ce84c1e01a`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:41.845995 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4df7423f-2994-4518-9061-ca105c7c1a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:41.851304 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 844/1680] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:41.937808 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 837/1681] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:32:41.942094 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0da39-17e3-4149-865c-9309853017f7 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:41.954049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0da39-17e3-4149-865c-9309853017f7 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:41.965195 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7423f-2994-4518-9061-ca105c7c1a80 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:42.078910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:42.137582 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171297f4-4ca9-49fc-8dbb-ee0f843e0470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:42.139269 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171297f4-4ca9-49fc-8dbb-ee0f843e0470 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:42.140337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171297f4-4ca9-49fc-8dbb-ee0f843e0470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:42.140620 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171297f4-4ca9-49fc-8dbb-ee0f843e0470 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:42.141332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171297f4-4ca9-49fc-8dbb-ee0f843e0470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:42.142733 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7423f-2994-4518-9061-ca105c7c1a80 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:42.143647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171297f4-4ca9-49fc-8dbb-ee0f843e0470 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:42.151559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65547951-bb58-42d4-ad18-09e6b51d7d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:42.152302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65547951-bb58-42d4-ad18-09e6b51d7d84 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:42.152595 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65547951-bb58-42d4-ad18-09e6b51d7d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:42.153962 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65547951-bb58-42d4-ad18-09e6b51d7d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:42.169730 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65547951-bb58-42d4-ad18-09e6b51d7d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:42.171247 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65547951-bb58-42d4-ad18-09e6b51d7d84 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:42.192683 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 845/1682] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:41 2022] POST /identity/v3/projects => generated 405 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:32:42.195340 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 838/1683] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:42.196550 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171297f4-4ca9-49fc-8dbb-ee0f843e0470 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:42.300607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171297f4-4ca9-49fc-8dbb-ee0f843e0470 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:42.305910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ca025-eb24-4772-a785-a103afdb8e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:42.306763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ca025-eb24-4772-a785-a103afdb8e9c admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:42.307049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ca025-eb24-4772-a785-a103afdb8e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:42.307322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ca025-eb24-4772-a785-a103afdb8e9c admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:42.308489 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ca025-eb24-4772-a785-a103afdb8e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:42.310651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ca025-eb24-4772-a785-a103afdb8e9c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:42.347623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 846/1684] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:42 2022] POST /identity/v3/users => generated 309 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:32:42.351958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65547951-bb58-42d4-ad18-09e6b51d7d84 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:42.364625 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65547951-bb58-42d4-ad18-09e6b51d7d84 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:42.371837 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ca025-eb24-4772-a785-a103afdb8e9c admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:42.374585 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-520ca025-eb24-4772-a785-a103afdb8e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:42.385922 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04224450-2446-455a-b2cb-857e04ad3ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:42.388149 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04224450-2446-455a-b2cb-857e04ad3ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:42.388452 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04224450-2446-455a-b2cb-857e04ad3ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:42.389448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04224450-2446-455a-b2cb-857e04ad3ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:42.391510 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04224450-2446-455a-b2cb-857e04ad3ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:42.396997 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04224450-2446-455a-b2cb-857e04ad3ff5 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:42.408985 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ca025-eb24-4772-a785-a103afdb8e9c admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:42.429500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af037b-49a8-4f75-8e8d-edbfc9da5d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:42.433824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af037b-49a8-4f75-8e8d-edbfc9da5d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:42.434089 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af037b-49a8-4f75-8e8d-edbfc9da5d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:42.434607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af037b-49a8-4f75-8e8d-edbfc9da5d04 admin admin] PATH_INFO: `/v3/projects/d4b84105cc584c3fb210275761717d29` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:42.440027 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 839/1685] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:32:42.440539 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af037b-49a8-4f75-8e8d-edbfc9da5d04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b84105cc584c3fb210275761717d29)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:42.443604 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04224450-2446-455a-b2cb-857e04ad3ff5 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:42.445808 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af037b-49a8-4f75-8e8d-edbfc9da5d04 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:42.470027 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04224450-2446-455a-b2cb-857e04ad3ff5 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:42.482504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae30acc-f5d8-40dd-96bc-35dd721a3c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:42.483989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae30acc-f5d8-40dd-96bc-35dd721a3c4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:42.484370 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae30acc-f5d8-40dd-96bc-35dd721a3c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:42.484805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae30acc-f5d8-40dd-96bc-35dd721a3c4a admin admin] PATH_INFO: `/v3/projects/6e7a33489267406fa95103c9dbf2d72a/users/c2bdb54363cb46819cd24189d5dfb700/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:42.508359 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae30acc-f5d8-40dd-96bc-35dd721a3c4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7a33489267406fa95103c9dbf2d72a, user_id=c2bdb54363cb46819cd24189d5dfb700, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:42.511580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae30acc-f5d8-40dd-96bc-35dd721a3c4a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:42.545901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 840/1686] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:42 2022] PUT /identity/v3/projects/6e7a33489267406fa95103c9dbf2d72a/users/c2bdb54363cb46819cd24189d5dfb700/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:42.549972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae30acc-f5d8-40dd-96bc-35dd721a3c4a admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:42.573711 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c9af037b-49a8-4f75-8e8d-edbfc9da5d04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b84105cc584c3fb210275761717d29', 'request_id': 'req-c9af037b-49a8-4f75-8e8d-edbfc9da5d04'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:42.594227 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c9af037b-49a8-4f75-8e8d-edbfc9da5d04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b84105cc584c3fb210275761717d29', 'request_id': 'req-c9af037b-49a8-4f75-8e8d-edbfc9da5d04'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:42.606176 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:42.608336 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c9af037b-49a8-4f75-8e8d-edbfc9da5d04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b84105cc584c3fb210275761717d29', 'request_id': 'req-c9af037b-49a8-4f75-8e8d-edbfc9da5d04'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:42.645742 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c9af037b-49a8-4f75-8e8d-edbfc9da5d04 admin admin] The token cache is being invalidate because project d4b84105cc584c3fb210275761717d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:32:42.646023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c9af037b-49a8-4f75-8e8d-edbfc9da5d04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:42.647136 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c9af037b-49a8-4f75-8e8d-edbfc9da5d04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:42.653145 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 847/1687] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:32:42 2022] DELETE /identity/v3/projects/d4b84105cc584c3fb210275761717d29 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:32:42.659250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6c51e-163b-4810-ab65-a7544552a5d0 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:42.659543 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6c51e-163b-4810-ab65-a7544552a5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:42.659866 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6c51e-163b-4810-ab65-a7544552a5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:42.720174 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1cc6c51e-163b-4810-ab65-a7544552a5d0 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:42.724573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1cc6c51e-163b-4810-ab65-a7544552a5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:42.734155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae30acc-f5d8-40dd-96bc-35dd721a3c4a admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:42.809391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:42.914457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c0e41-7242-42fd-85fe-11b6ae8edc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:42.915400 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c0e41-7242-42fd-85fe-11b6ae8edc28 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:42.916364 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c0e41-7242-42fd-85fe-11b6ae8edc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:42.916706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c0e41-7242-42fd-85fe-11b6ae8edc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:42.918088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c0e41-7242-42fd-85fe-11b6ae8edc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:42.919960 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c0e41-7242-42fd-85fe-11b6ae8edc28 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:42.925396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 848/1688] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:42.933693 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0999b1-735e-471d-84c3-2a84183954c5 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:42.934044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0999b1-735e-471d-84c3-2a84183954c5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:42.934253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0999b1-735e-471d-84c3-2a84183954c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:42.953015 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 841/1689] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:42.957574 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c0e41-7242-42fd-85fe-11b6ae8edc28 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:42.966314 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c32c0e41-7242-42fd-85fe-11b6ae8edc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:42.972135 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8c0999b1-735e-471d-84c3-2a84183954c5 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:42.973375 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8c0999b1-735e-471d-84c3-2a84183954c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:42.993686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 849/1690] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:32:42.997182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c0e41-7242-42fd-85fe-11b6ae8edc28 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:42.997825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0999b1-735e-471d-84c3-2a84183954c5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:43.002279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7c3cb-a674-4c3c-a1d2-518c6ceb047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:43.003160 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7c3cb-a674-4c3c-a1d2-518c6ceb047f admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:43.003454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7c3cb-a674-4c3c-a1d2-518c6ceb047f admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:43.003718 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7c3cb-a674-4c3c-a1d2-518c6ceb047f admin admin] PATH_INFO: `/v3/projects/6e7a33489267406fa95103c9dbf2d72a/users/c2bdb54363cb46819cd24189d5dfb700/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:43.005703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7c3cb-a674-4c3c-a1d2-518c6ceb047f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7a33489267406fa95103c9dbf2d72a, user_id=c2bdb54363cb46819cd24189d5dfb700, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:43.008390 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7c3cb-a674-4c3c-a1d2-518c6ceb047f admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:43.017287 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0999b1-735e-471d-84c3-2a84183954c5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:43.031418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c0c16-9b21-479d-9138-01d0d7483757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:43.032054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c0c16-9b21-479d-9138-01d0d7483757 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:43.032339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c0c16-9b21-479d-9138-01d0d7483757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:43.032612 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c0c16-9b21-479d-9138-01d0d7483757 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:43.033276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c0c16-9b21-479d-9138-01d0d7483757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:32:43.042073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c0c16-9b21-479d-9138-01d0d7483757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:43.042383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 842/1691] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:42 2022] PUT /identity/v3/projects/6e7a33489267406fa95103c9dbf2d72a/users/c2bdb54363cb46819cd24189d5dfb700/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:43.042461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c0c16-9b21-479d-9138-01d0d7483757 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:43.043864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92369e90-bdd0-4756-acf9-cd0f1a8b9861 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:43.044154 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92369e90-bdd0-4756-acf9-cd0f1a8b9861 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:43.044429 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92369e90-bdd0-4756-acf9-cd0f1a8b9861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:43.063280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 850/1692] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:32:43.067435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c0c16-9b21-479d-9138-01d0d7483757 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:43.084888 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c0c16-9b21-479d-9138-01d0d7483757 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:43.116601 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-92369e90-bdd0-4756-acf9-cd0f1a8b9861 None None] MFA Rules not processed for user `c2bdb54363cb46819cd24189d5dfb700`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:43.117871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-92369e90-bdd0-4756-acf9-cd0f1a8b9861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:43.255308 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e751f78-0604-46ab-83ec-ae07fe0a635b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:43.255948 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e751f78-0604-46ab-83ec-ae07fe0a635b admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:43.256481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e751f78-0604-46ab-83ec-ae07fe0a635b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:43.256759 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e751f78-0604-46ab-83ec-ae07fe0a635b admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:43.257412 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e751f78-0604-46ab-83ec-ae07fe0a635b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:43.260968 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e751f78-0604-46ab-83ec-ae07fe0a635b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:43.325855 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 843/1693] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:43 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:32:43.327464 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92369e90-bdd0-4756-acf9-cd0f1a8b9861 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:43.328872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-92369e90-bdd0-4756-acf9-cd0f1a8b9861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:43.344697 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92369e90-bdd0-4756-acf9-cd0f1a8b9861 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:43.348927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 851/1694] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:43 2022] POST /identity/v3/projects => generated 385 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:32:43.348927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e751f78-0604-46ab-83ec-ae07fe0a635b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:43.352971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9e751f78-0604-46ab-83ec-ae07fe0a635b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:43.398646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:43.470659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:43.473392 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:43.473892 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:43.474379 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde admin admin] PATH_INFO: `/v3/projects/67e7332e29da4841a9aa7b8eaf60cea6` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:43.476800 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde admin admin] RBAC: Authorizing `identity:delete_project(project_id=67e7332e29da4841a9aa7b8eaf60cea6)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:43.490214 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:43.523432 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e751f78-0604-46ab-83ec-ae07fe0a635b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:43.537006 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9e1e1-8017-49c6-924d-50ca0682fea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:43.538920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9e1e1-8017-49c6-924d-50ca0682fea2 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:43.538920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9e1e1-8017-49c6-924d-50ca0682fea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:43.538920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9e1e1-8017-49c6-924d-50ca0682fea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:43.637569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67e7332e29da4841a9aa7b8eaf60cea6', 'request_id': 'req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:43.650510 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67e7332e29da4841a9aa7b8eaf60cea6', 'request_id': 'req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:43.651574 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:43.670844 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67e7332e29da4841a9aa7b8eaf60cea6', 'request_id': 'req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:43.684508 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9e1e1-8017-49c6-924d-50ca0682fea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:43.686810 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9e1e1-8017-49c6-924d-50ca0682fea2 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:43.695515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde admin admin] The token cache is being invalidate because project 67e7332e29da4841a9aa7b8eaf60cea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:32:43.696576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:43.699028 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:43.702161 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 844/1695] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:32:43 2022] DELETE /identity/v3/projects/67e7332e29da4841a9aa7b8eaf60cea6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:43.703441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:43.705000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:43.716910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 852/1696] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:43 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:43.719208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9e1e1-8017-49c6-924d-50ca0682fea2 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:43.750908 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9e1e1-8017-49c6-924d-50ca0682fea2 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:43.888998 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5697a-9365-4bcc-951d-aa10112c7ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:43.889758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5697a-9365-4bcc-951d-aa10112c7ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:43.890321 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5697a-9365-4bcc-951d-aa10112c7ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:43.890768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5697a-9365-4bcc-951d-aa10112c7ac2 admin admin] PATH_INFO: `/v3/users/17326a8900ab4cfcb9caa6234cd4cd7d` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:43.898397 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5697a-9365-4bcc-951d-aa10112c7ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17326a8900ab4cfcb9caa6234cd4cd7d)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:43.902407 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5697a-9365-4bcc-951d-aa10112c7ac2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:43.961729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a9c9e-7a2c-4b6c-a175-b9b0a56badde admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:43.993931 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b34bfb-6c13-4a4d-b534-c3fdce0a0262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:43.994780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b34bfb-6c13-4a4d-b534-c3fdce0a0262 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:43.995580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b34bfb-6c13-4a4d-b534-c3fdce0a0262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:43.995920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b34bfb-6c13-4a4d-b534-c3fdce0a0262 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:43.996564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b34bfb-6c13-4a4d-b534-c3fdce0a0262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:43.998728 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b34bfb-6c13-4a4d-b534-c3fdce0a0262 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:44.027202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9be5697a-9365-4bcc-951d-aa10112c7ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17326a8900ab4cfcb9caa6234cd4cd7d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:44.027919 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9be5697a-9365-4bcc-951d-aa10112c7ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17326a8900ab4cfcb9caa6234cd4cd7d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:44.037847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 845/1697] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:43 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:44.037847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d27db-781b-4650-8cc4-b429e551fee5 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:44.037847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d27db-781b-4650-8cc4-b429e551fee5 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:44.037847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d27db-781b-4650-8cc4-b429e551fee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:44.050179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9be5697a-9365-4bcc-951d-aa10112c7ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17326a8900ab4cfcb9caa6234cd4cd7d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:44.097582 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-5c4d27db-781b-4650-8cc4-b429e551fee5 None None] MFA Rules not processed for user `6912413cfb474eb68e31c250531dfcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:44.097850 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9be5697a-9365-4bcc-951d-aa10112c7ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17326a8900ab4cfcb9caa6234cd4cd7d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:44.099062 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5c4d27db-781b-4650-8cc4-b429e551fee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:44.113992 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9be5697a-9365-4bcc-951d-aa10112c7ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17326a8900ab4cfcb9caa6234cd4cd7d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:44.132669 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 853/1698] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:32:43 2022] DELETE /identity/v3/users/17326a8900ab4cfcb9caa6234cd4cd7d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:44.132669 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5697a-9365-4bcc-951d-aa10112c7ac2 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:44.134193 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9be5697a-9365-4bcc-951d-aa10112c7ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:44.225307 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:44.300312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 846/1699] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:44.301438 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d27db-781b-4650-8cc4-b429e551fee5 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:44.305437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5c4d27db-781b-4650-8cc4-b429e551fee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:44.346633 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5697a-9365-4bcc-951d-aa10112c7ac2 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:44.365396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d27db-781b-4650-8cc4-b429e551fee5 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:44.366997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0501cd-cf89-4df7-bd5d-456c06bbe7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:44.367763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0501cd-cf89-4df7-bd5d-456c06bbe7dd admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:44.368141 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0501cd-cf89-4df7-bd5d-456c06bbe7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:44.368513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0501cd-cf89-4df7-bd5d-456c06bbe7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:44.369478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0501cd-cf89-4df7-bd5d-456c06bbe7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:44.372768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0501cd-cf89-4df7-bd5d-456c06bbe7dd admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:44.380579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdec50-02c7-4518-827a-3d4d0507ff1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:44.381242 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdec50-02c7-4518-827a-3d4d0507ff1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:44.381523 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdec50-02c7-4518-827a-3d4d0507ff1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:44.381942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdec50-02c7-4518-827a-3d4d0507ff1c admin admin] PATH_INFO: `/v3/users/d2e807461a20444881e443ce84c1e01a` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:44.398090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdec50-02c7-4518-827a-3d4d0507ff1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2e807461a20444881e443ce84c1e01a)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:44.400099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdec50-02c7-4518-827a-3d4d0507ff1c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:44.403084 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 854/1700] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:44.404069 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0501cd-cf89-4df7-bd5d-456c06bbe7dd admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:44.405955 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2c0501cd-cf89-4df7-bd5d-456c06bbe7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:44.419918 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:44.539154 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6acdec50-02c7-4518-827a-3d4d0507ff1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2e807461a20444881e443ce84c1e01a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:44.540809 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6acdec50-02c7-4518-827a-3d4d0507ff1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2e807461a20444881e443ce84c1e01a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:44.553147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0501cd-cf89-4df7-bd5d-456c06bbe7dd admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:44.576009 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6acdec50-02c7-4518-827a-3d4d0507ff1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2e807461a20444881e443ce84c1e01a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:44.596400 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6acdec50-02c7-4518-827a-3d4d0507ff1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2e807461a20444881e443ce84c1e01a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:44.601425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5386296-d912-4112-b451-9c29df433c33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:44.602058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5386296-d912-4112-b451-9c29df433c33 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:44.604392 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5386296-d912-4112-b451-9c29df433c33 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:44.604668 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5386296-d912-4112-b451-9c29df433c33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:44.608329 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b5386296-d912-4112-b451-9c29df433c33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:44.617617 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6acdec50-02c7-4518-827a-3d4d0507ff1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2e807461a20444881e443ce84c1e01a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:44.639440 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 847/1701] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:32:44 2022] DELETE /identity/v3/users/d2e807461a20444881e443ce84c1e01a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:44.640343 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdec50-02c7-4518-827a-3d4d0507ff1c admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:44.644823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6acdec50-02c7-4518-827a-3d4d0507ff1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:44.723076 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5386296-d912-4112-b451-9c29df433c33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:44.724895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5386296-d912-4112-b451-9c29df433c33 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:44.740406 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 855/1702] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:44.742382 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956727-2254-4c40-8c26-fdf49e400f37 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:44.743000 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956727-2254-4c40-8c26-fdf49e400f37 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:44.743416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956727-2254-4c40-8c26-fdf49e400f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:44.790072 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-78956727-2254-4c40-8c26-fdf49e400f37 None None] MFA Rules not processed for user `88cd06365efb4911b40d8aa0c721c32f`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:44.793376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-78956727-2254-4c40-8c26-fdf49e400f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:44.857302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdec50-02c7-4518-827a-3d4d0507ff1c admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:44.869984 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e776649-d22b-4c29-bbad-e7d8700b65bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:44.870814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e776649-d22b-4c29-bbad-e7d8700b65bd admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:44.871961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e776649-d22b-4c29-bbad-e7d8700b65bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:44.874792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e776649-d22b-4c29-bbad-e7d8700b65bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:44.875737 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e776649-d22b-4c29-bbad-e7d8700b65bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:44.879631 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e776649-d22b-4c29-bbad-e7d8700b65bd admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:44.929555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 848/1703] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:44.931852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e776649-d22b-4c29-bbad-e7d8700b65bd admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:44.934327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 856/1704] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:44.935742 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf37802-5e16-44c8-9687-5331a69fec68 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:44.936055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf37802-5e16-44c8-9687-5331a69fec68 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:44.936315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf37802-5e16-44c8-9687-5331a69fec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:44.943182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4e776649-d22b-4c29-bbad-e7d8700b65bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:44.980740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9bf37802-5e16-44c8-9687-5331a69fec68 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:44.981323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e776649-d22b-4c29-bbad-e7d8700b65bd admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:44.982706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9bf37802-5e16-44c8-9687-5331a69fec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:44.987398 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:44.988049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:44.988589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:44.988589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960 admin admin] PATH_INFO: `/v3/projects/6ac9929dbcf4494a888a7d024c7e0015` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:44.991292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ac9929dbcf4494a888a7d024c7e0015)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:44.995903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 857/1705] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:44.997093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf37802-5e16-44c8-9687-5331a69fec68 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:45.008120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf37802-5e16-44c8-9687-5331a69fec68 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:45.011416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:45.013962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f9a84-0eff-445d-83f9-8997ff2c1cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:45.014729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f9a84-0eff-445d-83f9-8997ff2c1cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:45.015011 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f9a84-0eff-445d-83f9-8997ff2c1cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:45.015465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f9a84-0eff-445d-83f9-8997ff2c1cd9 admin admin] PATH_INFO: `/v3/projects/ae5fe29878e44491902c653049118ea7/users/549e585973bc4f8aa4e8b3ee227dacde/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:45.037554 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f9a84-0eff-445d-83f9-8997ff2c1cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5fe29878e44491902c653049118ea7, user_id=549e585973bc4f8aa4e8b3ee227dacde, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:45.040314 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f9a84-0eff-445d-83f9-8997ff2c1cd9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:45.055840 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:45.083523 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 858/1706] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:44 2022] PUT /identity/v3/projects/ae5fe29878e44491902c653049118ea7/users/549e585973bc4f8aa4e8b3ee227dacde/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:45.087524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f9a84-0eff-445d-83f9-8997ff2c1cd9 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:45.094137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2f6f9a84-0eff-445d-83f9-8997ff2c1cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:45.150092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:45.156869 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ac9929dbcf4494a888a7d024c7e0015', 'request_id': 'req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:45.176033 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ac9929dbcf4494a888a7d024c7e0015', 'request_id': 'req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:45.193007 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ac9929dbcf4494a888a7d024c7e0015', 'request_id': 'req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:45.224998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960 admin admin] The token cache is being invalidate because project 6ac9929dbcf4494a888a7d024c7e0015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:32:45.225203 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:45.227459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:45.234242 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 849/1707] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:32:44 2022] DELETE /identity/v3/projects/6ac9929dbcf4494a888a7d024c7e0015 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:45.235338 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:45.241151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f9a84-0eff-445d-83f9-8997ff2c1cd9 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:45.241383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:45.349516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb9a6b-85cd-4603-80b0-fa2ae21eb960 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:45.356303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa180d4-d46b-4d6f-a457-b572cc2c7032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:45.357913 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa180d4-d46b-4d6f-a457-b572cc2c7032 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:45.358193 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa180d4-d46b-4d6f-a457-b572cc2c7032 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:45.358461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa180d4-d46b-4d6f-a457-b572cc2c7032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:45.360688 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130635b1-e87e-4e59-96f5-88b5d3d5977a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:45.361308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130635b1-e87e-4e59-96f5-88b5d3d5977a service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:45.361586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130635b1-e87e-4e59-96f5-88b5d3d5977a service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:45.361858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130635b1-e87e-4e59-96f5-88b5d3d5977a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:45.362578 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4fa180d4-d46b-4d6f-a457-b572cc2c7032 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:45.364484 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-130635b1-e87e-4e59-96f5-88b5d3d5977a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:45.472803 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa180d4-d46b-4d6f-a457-b572cc2c7032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:45.474823 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa180d4-d46b-4d6f-a457-b572cc2c7032 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:45.499333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 859/1708] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:45.502418 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130635b1-e87e-4e59-96f5-88b5d3d5977a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:45.504390 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130635b1-e87e-4e59-96f5-88b5d3d5977a service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:45.521319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007afbc0-a1e9-42f0-9f25-5ae4976fe39e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:45.522182 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007afbc0-a1e9-42f0-9f25-5ae4976fe39e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:45.523119 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007afbc0-a1e9-42f0-9f25-5ae4976fe39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:45.538259 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 850/1709] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:45.555465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afa9ec-049f-4171-851b-771bf3ab003b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:45.557918 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afa9ec-049f-4171-851b-771bf3ab003b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:45.558961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afa9ec-049f-4171-851b-771bf3ab003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:45.597715 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-f3afa9ec-049f-4171-851b-771bf3ab003b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:45.599347 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f3afa9ec-049f-4171-851b-771bf3ab003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:45.614355 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 851/1710] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:45.616084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef6adb-4c2b-4472-9a97-063db0431ad0 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:45.616586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef6adb-4c2b-4472-9a97-063db0431ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:45.617200 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef6adb-4c2b-4472-9a97-063db0431ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:45.648070 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-007afbc0-a1e9-42f0-9f25-5ae4976fe39e None None] MFA Rules not processed for user `549e585973bc4f8aa4e8b3ee227dacde`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:45.649294 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-007afbc0-a1e9-42f0-9f25-5ae4976fe39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:45.698475 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-83ef6adb-4c2b-4472-9a97-063db0431ad0 None None] MFA Rules not processed for user `6d98ba47977f4440bf28614a67efebd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:45.700432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-83ef6adb-4c2b-4472-9a97-063db0431ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:45.706594 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:45.813422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 860/1711] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:45.822493 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bc50b-d3f7-442b-86d0-35b0cea4059c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:45.824607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bc50b-d3f7-442b-86d0-35b0cea4059c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:45.825028 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bc50b-d3f7-442b-86d0-35b0cea4059c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:45.854000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 852/1712] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:45.864767 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef6adb-4c2b-4472-9a97-063db0431ad0 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:45.867112 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-83ef6adb-4c2b-4472-9a97-063db0431ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:45.893852 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-608bc50b-d3f7-442b-86d0-35b0cea4059c None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:45.902501 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-608bc50b-d3f7-442b-86d0-35b0cea4059c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:45.909329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef6adb-4c2b-4472-9a97-063db0431ad0 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:45.923096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5262ff-d753-4b60-81c2-3d2f8c8533d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:45.923096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5262ff-d753-4b60-81c2-3d2f8c8533d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:45.923096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5262ff-d753-4b60-81c2-3d2f8c8533d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:45.923096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5262ff-d753-4b60-81c2-3d2f8c8533d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:45.923650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5262ff-d753-4b60-81c2-3d2f8c8533d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:45.923954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 861/1713] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:45.925190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd0604-7f89-4d0f-9f4f-02cdfa8b8244 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:45.925527 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd0604-7f89-4d0f-9f4f-02cdfa8b8244 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:45.925867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd0604-7f89-4d0f-9f4f-02cdfa8b8244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:45.929724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5262ff-d753-4b60-81c2-3d2f8c8533d7 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:45.943003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:45.974900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-c2dd0604-7f89-4d0f-9f4f-02cdfa8b8244 None None] MFA Rules not processed for user `6d98ba47977f4440bf28614a67efebd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:45.976491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c2dd0604-7f89-4d0f-9f4f-02cdfa8b8244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:45.998743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 853/1714] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:45 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:45.999763 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5262ff-d753-4b60-81c2-3d2f8c8533d7 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:46.000685 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 862/1715] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:46.006269 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd0604-7f89-4d0f-9f4f-02cdfa8b8244 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:46.035224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd0604-7f89-4d0f-9f4f-02cdfa8b8244 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:46.122013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5262ff-d753-4b60-81c2-3d2f8c8533d7 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:46.128812 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d009ba2-129f-4a68-8505-c609f5b0bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:46.129782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d009ba2-129f-4a68-8505-c609f5b0bdbf admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:46.130244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d009ba2-129f-4a68-8505-c609f5b0bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:46.131256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d009ba2-129f-4a68-8505-c609f5b0bdbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:46.132307 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d009ba2-129f-4a68-8505-c609f5b0bdbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:32:46.132795 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d009ba2-129f-4a68-8505-c609f5b0bdbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:46.136031 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d009ba2-129f-4a68-8505-c609f5b0bdbf admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:46.154028 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 854/1716] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:32:46.155440 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d009ba2-129f-4a68-8505-c609f5b0bdbf admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:46.158217 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-3d009ba2-129f-4a68-8505-c609f5b0bdbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:46.192305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22868b-8795-400e-921a-17837a7abc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:46.194333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22868b-8795-400e-921a-17837a7abc28 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:46.194819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22868b-8795-400e-921a-17837a7abc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:46.195428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22868b-8795-400e-921a-17837a7abc28 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:46.196250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22868b-8795-400e-921a-17837a7abc28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:46.209486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22868b-8795-400e-921a-17837a7abc28 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:46.284513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 863/1717] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:46 2022] POST /identity/v3/users => generated 294 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:46.285502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22868b-8795-400e-921a-17837a7abc28 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:46.290942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0f22868b-8795-400e-921a-17837a7abc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:46.325877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22868b-8795-400e-921a-17837a7abc28 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:46.343847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cd637-27a3-44db-8d56-336291b5c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:46.344505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cd637-27a3-44db-8d56-336291b5c13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:46.346134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cd637-27a3-44db-8d56-336291b5c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:46.346407 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cd637-27a3-44db-8d56-336291b5c13f admin admin] PATH_INFO: `/v3/projects/1ce3f7ed9b80485093bb70a40ffc00c2` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:46.351147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798cd637-27a3-44db-8d56-336291b5c13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ce3f7ed9b80485093bb70a40ffc00c2)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:46.355060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798cd637-27a3-44db-8d56-336291b5c13f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:46.395276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d009ba2-129f-4a68-8505-c609f5b0bdbf admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:46.413920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccebcb-d899-4494-8566-aeeb0c43c09a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:46.414722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccebcb-d899-4494-8566-aeeb0c43c09a service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:46.415006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccebcb-d899-4494-8566-aeeb0c43c09a service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:46.415280 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccebcb-d899-4494-8566-aeeb0c43c09a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:46.473143 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-798cd637-27a3-44db-8d56-336291b5c13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce3f7ed9b80485093bb70a40ffc00c2', 'request_id': 'req-798cd637-27a3-44db-8d56-336291b5c13f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:46.493672 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-798cd637-27a3-44db-8d56-336291b5c13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce3f7ed9b80485093bb70a40ffc00c2', 'request_id': 'req-798cd637-27a3-44db-8d56-336291b5c13f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:46.513020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-798cd637-27a3-44db-8d56-336291b5c13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce3f7ed9b80485093bb70a40ffc00c2', 'request_id': 'req-798cd637-27a3-44db-8d56-336291b5c13f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:46.547852 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-798cd637-27a3-44db-8d56-336291b5c13f admin admin] The token cache is being invalidate because project 1ce3f7ed9b80485093bb70a40ffc00c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:32:46.548152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-798cd637-27a3-44db-8d56-336291b5c13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:46.548917 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-798cd637-27a3-44db-8d56-336291b5c13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:46.551030 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 864/1718] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:32:46 2022] DELETE /identity/v3/projects/1ce3f7ed9b80485093bb70a40ffc00c2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:46.551996 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cd637-27a3-44db-8d56-336291b5c13f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:46.553679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-798cd637-27a3-44db-8d56-336291b5c13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:46.583258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccebcb-d899-4494-8566-aeeb0c43c09a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:46.586420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccebcb-d899-4494-8566-aeeb0c43c09a service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:46.607180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 855/1719] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:46.608581 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccebcb-d899-4494-8566-aeeb0c43c09a service nova] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:46.633117 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccebcb-d899-4494-8566-aeeb0c43c09a service nova] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:46.647847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:46.669635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:46.741620 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cd637-27a3-44db-8d56-336291b5c13f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:46.750276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55445e1-7a45-42e4-96cc-eb38d20034ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:46.750961 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55445e1-7a45-42e4-96cc-eb38d20034ad admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:46.751236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55445e1-7a45-42e4-96cc-eb38d20034ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:46.752572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55445e1-7a45-42e4-96cc-eb38d20034ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:46.753864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55445e1-7a45-42e4-96cc-eb38d20034ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:46.774242 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55445e1-7a45-42e4-96cc-eb38d20034ad admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:46.832755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8d552-b85b-44a5-bc9f-ba0f128e8285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:46.833517 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d552-b85b-44a5-bc9f-ba0f128e8285 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:46.833803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d552-b85b-44a5-bc9f-ba0f128e8285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:46.834078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d552-b85b-44a5-bc9f-ba0f128e8285 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:46.834764 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8d552-b85b-44a5-bc9f-ba0f128e8285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:46.836835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8d552-b85b-44a5-bc9f-ba0f128e8285 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:46.864785 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 856/1720] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:46.875136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05111ff-923f-42f5-8696-22f8b5f95e63 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:46.875451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05111ff-923f-42f5-8696-22f8b5f95e63 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:46.875736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05111ff-923f-42f5-8696-22f8b5f95e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:46.882725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 865/1721] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:46 2022] POST /identity/v3/projects => generated 365 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:46.886007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55445e1-7a45-42e4-96cc-eb38d20034ad admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:46.891598 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a55445e1-7a45-42e4-96cc-eb38d20034ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:46.937370 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-c05111ff-923f-42f5-8696-22f8b5f95e63 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:46.938638 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c05111ff-923f-42f5-8696-22f8b5f95e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:47.066507 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55445e1-7a45-42e4-96cc-eb38d20034ad admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:47.073138 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad1ad2-837b-442b-a823-d3d4779fb32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:47.073772 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad1ad2-837b-442b-a823-d3d4779fb32f admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:47.074048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad1ad2-837b-442b-a823-d3d4779fb32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:47.074317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad1ad2-837b-442b-a823-d3d4779fb32f admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:47.089204 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad1ad2-837b-442b-a823-d3d4779fb32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:47.091046 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad1ad2-837b-442b-a823-d3d4779fb32f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:47.107281 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 866/1722] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:47.115252 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad1ad2-837b-442b-a823-d3d4779fb32f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:47.125350 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 857/1723] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:47.126205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05111ff-923f-42f5-8696-22f8b5f95e63 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:47.162082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad1ad2-837b-442b-a823-d3d4779fb32f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:47.162268 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05111ff-923f-42f5-8696-22f8b5f95e63 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:47.174023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857683c1-4ce7-40ee-9fce-7a90b2228102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:47.175128 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857683c1-4ce7-40ee-9fce-7a90b2228102 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:47.175626 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857683c1-4ce7-40ee-9fce-7a90b2228102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:47.176108 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857683c1-4ce7-40ee-9fce-7a90b2228102 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:47.177282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857683c1-4ce7-40ee-9fce-7a90b2228102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:47.179135 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca2aa3-36cb-4830-9938-7c8daa48cdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:47.179821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca2aa3-36cb-4830-9938-7c8daa48cdfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:47.180100 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca2aa3-36cb-4830-9938-7c8daa48cdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:47.180374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca2aa3-36cb-4830-9938-7c8daa48cdfd admin admin] PATH_INFO: `/v3/projects/7c487ba33b6046af8318f8b6c7b1aa2f/users/97e00c3cb5fa445d8f43ddc26938b8a9/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:47.184158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857683c1-4ce7-40ee-9fce-7a90b2228102 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:47.235630 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 867/1724] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:47 2022] POST /identity/v3/users => generated 283 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:47.237199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca2aa3-36cb-4830-9938-7c8daa48cdfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c487ba33b6046af8318f8b6c7b1aa2f, user_id=97e00c3cb5fa445d8f43ddc26938b8a9, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:47.239194 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb98ee7-9ca2-4b33-8936-f170e08440a7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:47.239737 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb98ee7-9ca2-4b33-8936-f170e08440a7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:47.240009 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca2aa3-36cb-4830-9938-7c8daa48cdfd admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:47.240565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb98ee7-9ca2-4b33-8936-f170e08440a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:47.279855 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 858/1725] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:47 2022] PUT /identity/v3/projects/7c487ba33b6046af8318f8b6c7b1aa2f/users/97e00c3cb5fa445d8f43ddc26938b8a9/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:47.289269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca2aa3-36cb-4830-9938-7c8daa48cdfd admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:47.302629 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7fb98ee7-9ca2-4b33-8936-f170e08440a7 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:47.305887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7fb98ee7-9ca2-4b33-8936-f170e08440a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:47.439178 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca2aa3-36cb-4830-9938-7c8daa48cdfd admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:47.447322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 868/1726] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:47.447685 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda6f10-560a-4936-9206-124723a86aad None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:47.451667 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda6f10-560a-4936-9206-124723a86aad None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:47.452091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda6f10-560a-4936-9206-124723a86aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:47.452871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afead84-e818-43d9-a69b-4859abde4eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:47.453560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afead84-e818-43d9-a69b-4859abde4eff admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:47.453911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afead84-e818-43d9-a69b-4859abde4eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:47.454191 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afead84-e818-43d9-a69b-4859abde4eff admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:47.466069 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afead84-e818-43d9-a69b-4859abde4eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:47.473364 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afead84-e818-43d9-a69b-4859abde4eff admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:47.495492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 859/1727] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:47.495492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afead84-e818-43d9-a69b-4859abde4eff admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:47.514700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afead84-e818-43d9-a69b-4859abde4eff admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:47.524845 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cca8a9-252f-4df8-bb4a-bfd01f4ecb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:47.525730 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cca8a9-252f-4df8-bb4a-bfd01f4ecb2a admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:47.527921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9cda6f10-560a-4936-9206-124723a86aad None None] MFA Rules not processed for user `97e00c3cb5fa445d8f43ddc26938b8a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:47.528356 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cca8a9-252f-4df8-bb4a-bfd01f4ecb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:47.528842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cca8a9-252f-4df8-bb4a-bfd01f4ecb2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:47.529671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cca8a9-252f-4df8-bb4a-bfd01f4ecb2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:32:47.531859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cca8a9-252f-4df8-bb4a-bfd01f4ecb2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:47.534363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cca8a9-252f-4df8-bb4a-bfd01f4ecb2a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:47.535012 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9cda6f10-560a-4936-9206-124723a86aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:47.561855 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 860/1728] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:32:47.563105 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cca8a9-252f-4df8-bb4a-bfd01f4ecb2a admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:47.582225 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:47.586449 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cca8a9-252f-4df8-bb4a-bfd01f4ecb2a admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:47.594870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec09e1-4fb7-4954-8622-73beedabecc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:47.595675 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec09e1-4fb7-4954-8622-73beedabecc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:47.596112 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec09e1-4fb7-4954-8622-73beedabecc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:47.596532 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec09e1-4fb7-4954-8622-73beedabecc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:47.597611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec09e1-4fb7-4954-8622-73beedabecc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:47.599548 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec09e1-4fb7-4954-8622-73beedabecc1 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:47.617318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 861/1729] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:47.618263 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec09e1-4fb7-4954-8622-73beedabecc1 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:47.623757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:47.629421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec09e1-4fb7-4954-8622-73beedabecc1 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:47.642229 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e496c99-2d10-4243-8705-de46fe2fc091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:47.643314 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e496c99-2d10-4243-8705-de46fe2fc091 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:47.643950 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e496c99-2d10-4243-8705-de46fe2fc091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:47.644369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e496c99-2d10-4243-8705-de46fe2fc091 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:47.645157 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e496c99-2d10-4243-8705-de46fe2fc091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:47.647314 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e496c99-2d10-4243-8705-de46fe2fc091 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:47.719752 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 862/1730] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:47 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:47.721694 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e496c99-2d10-4243-8705-de46fe2fc091 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:47.785166 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 869/1731] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:47.795664 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda6f10-560a-4936-9206-124723a86aad None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:47.829293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda6f10-560a-4936-9206-124723a86aad None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:47.913794 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e496c99-2d10-4243-8705-de46fe2fc091 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:47.936959 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8e297-2e83-4d2e-9b3e-bb83a14a38f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:47.937671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8e297-2e83-4d2e-9b3e-bb83a14a38f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:47.937961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8e297-2e83-4d2e-9b3e-bb83a14a38f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:47.938245 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8e297-2e83-4d2e-9b3e-bb83a14a38f6 admin admin] PATH_INFO: `/v3/projects/186ab45a41f04afda643f0842a6dcf6f/users/57ec06cbf3f34633b9b45d94321a35d0/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:47.989459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8e297-2e83-4d2e-9b3e-bb83a14a38f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=186ab45a41f04afda643f0842a6dcf6f, user_id=57ec06cbf3f34633b9b45d94321a35d0, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:47.992217 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8e297-2e83-4d2e-9b3e-bb83a14a38f6 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:48.029384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 863/1732] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:47 2022] PUT /identity/v3/projects/186ab45a41f04afda643f0842a6dcf6f/users/57ec06cbf3f34633b9b45d94321a35d0/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:48.029881 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea6e02-0777-4c48-9a68-01bec143d874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:48.030404 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b1811-a315-48d1-8c54-78cccd32901c None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:48.030511 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea6e02-0777-4c48-9a68-01bec143d874 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:48.030725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b1811-a315-48d1-8c54-78cccd32901c None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:48.030835 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea6e02-0777-4c48-9a68-01bec143d874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:48.031079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea6e02-0777-4c48-9a68-01bec143d874 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:48.031724 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea6e02-0777-4c48-9a68-01bec143d874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:48.033651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea6e02-0777-4c48-9a68-01bec143d874 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:48.039968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b1811-a315-48d1-8c54-78cccd32901c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:48.086124 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 870/1733] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:47 2022] POST /identity/v3/users => generated 285 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:48.086124 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea6e02-0777-4c48-9a68-01bec143d874 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:48.100104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-b29b1811-a315-48d1-8c54-78cccd32901c None None] MFA Rules not processed for user `08d87dbdb5e8475ebee33fd65e62b3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:48.101456 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b29b1811-a315-48d1-8c54-78cccd32901c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:48.116042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea6e02-0777-4c48-9a68-01bec143d874 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:48.223546 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ecbb4-01ef-4b11-8b2d-5e9222097ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:48.224168 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ecbb4-01ef-4b11-8b2d-5e9222097ddc admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:48.224496 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ecbb4-01ef-4b11-8b2d-5e9222097ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:48.224815 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ecbb4-01ef-4b11-8b2d-5e9222097ddc admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:48.227392 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ecbb4-01ef-4b11-8b2d-5e9222097ddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:48.230253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ecbb4-01ef-4b11-8b2d-5e9222097ddc admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:48.252538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 864/1734] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:48.253947 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b1811-a315-48d1-8c54-78cccd32901c None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:48.256098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b29b1811-a315-48d1-8c54-78cccd32901c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:48.285474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b1811-a315-48d1-8c54-78cccd32901c None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:48.299693 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 871/1735] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:48 2022] POST /identity/v3/projects => generated 387 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:48.301196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3a285-1fb6-4d90-90bc-a39e5388d614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:48.302418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbca98-a80f-456a-8c2a-75c4a853dd6c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:48.302730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbca98-a80f-456a-8c2a-75c4a853dd6c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:48.303995 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3a285-1fb6-4d90-90bc-a39e5388d614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:48.304302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3a285-1fb6-4d90-90bc-a39e5388d614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:48.304788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbca98-a80f-456a-8c2a-75c4a853dd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:48.306196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3a285-1fb6-4d90-90bc-a39e5388d614 admin admin] PATH_INFO: `/v3/projects/c9f534f373df463e97d9b3ee210bcc10` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:48.308897 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3a285-1fb6-4d90-90bc-a39e5388d614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f534f373df463e97d9b3ee210bcc10)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:48.313167 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3a285-1fb6-4d90-90bc-a39e5388d614 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:48.376123 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4fdbca98-a80f-456a-8c2a-75c4a853dd6c None None] MFA Rules not processed for user `57ec06cbf3f34633b9b45d94321a35d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:48.378279 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4fdbca98-a80f-456a-8c2a-75c4a853dd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:48.406895 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:48.414496 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5a3a285-1fb6-4d90-90bc-a39e5388d614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f534f373df463e97d9b3ee210bcc10', 'request_id': 'req-f5a3a285-1fb6-4d90-90bc-a39e5388d614'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:48.423438 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5a3a285-1fb6-4d90-90bc-a39e5388d614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f534f373df463e97d9b3ee210bcc10', 'request_id': 'req-f5a3a285-1fb6-4d90-90bc-a39e5388d614'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:48.429123 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:48.437917 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5a3a285-1fb6-4d90-90bc-a39e5388d614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f534f373df463e97d9b3ee210bcc10', 'request_id': 'req-f5a3a285-1fb6-4d90-90bc-a39e5388d614'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:48.460005 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5a3a285-1fb6-4d90-90bc-a39e5388d614 admin admin] The token cache is being invalidate because project c9f534f373df463e97d9b3ee210bcc10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:32:48.460374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5a3a285-1fb6-4d90-90bc-a39e5388d614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:48.464428 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5a3a285-1fb6-4d90-90bc-a39e5388d614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:48.466895 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 865/1736] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:32:48 2022] DELETE /identity/v3/projects/c9f534f373df463e97d9b3ee210bcc10 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:48.467863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3a285-1fb6-4d90-90bc-a39e5388d614 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:48.475943 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f5a3a285-1fb6-4d90-90bc-a39e5388d614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:48.538296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 872/1737] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:48.538296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e5a77-8ccd-4904-b2f1-24f2559224e3 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:48.538296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e5a77-8ccd-4904-b2f1-24f2559224e3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:48.538296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e5a77-8ccd-4904-b2f1-24f2559224e3 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:48.539573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 873/1738] 10.222.0.71 () {54 vars in 912 bytes} [Thu Sep 1 16:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:32:48.540161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790f8aa-8db6-4b9e-975a-3fc1761f18d6 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:48.540499 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790f8aa-8db6-4b9e-975a-3fc1761f18d6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:48.541227 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790f8aa-8db6-4b9e-975a-3fc1761f18d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:48.569382 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b790f8aa-8db6-4b9e-975a-3fc1761f18d6 None None] MFA Rules not processed for user `08d87dbdb5e8475ebee33fd65e62b3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:48.570964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b790f8aa-8db6-4b9e-975a-3fc1761f18d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:48.627803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3a285-1fb6-4d90-90bc-a39e5388d614 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:48.638793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26d64a-1d09-4278-b01e-fd48f07f74c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:48.639363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26d64a-1d09-4278-b01e-fd48f07f74c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:48.639686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26d64a-1d09-4278-b01e-fd48f07f74c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:48.639963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26d64a-1d09-4278-b01e-fd48f07f74c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:48.641104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26d64a-1d09-4278-b01e-fd48f07f74c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:48.643471 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26d64a-1d09-4278-b01e-fd48f07f74c3 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:48.662323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 866/1739] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:48.662323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26d64a-1d09-4278-b01e-fd48f07f74c3 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:48.669015 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6a26d64a-1d09-4278-b01e-fd48f07f74c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:48.709149 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26d64a-1d09-4278-b01e-fd48f07f74c3 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:48.720984 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf61bda-ee96-43a8-a271-b6dbd8ba8241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:48.721616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf61bda-ee96-43a8-a271-b6dbd8ba8241 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:48.723383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf61bda-ee96-43a8-a271-b6dbd8ba8241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:48.727520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf61bda-ee96-43a8-a271-b6dbd8ba8241 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:48.728279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf61bda-ee96-43a8-a271-b6dbd8ba8241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:48.731611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf61bda-ee96-43a8-a271-b6dbd8ba8241 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:48.736033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 874/1740] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:48.737045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790f8aa-8db6-4b9e-975a-3fc1761f18d6 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:48.738483 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b790f8aa-8db6-4b9e-975a-3fc1761f18d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:48.753865 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790f8aa-8db6-4b9e-975a-3fc1761f18d6 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:48.759111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf7dbc-b17a-4618-941e-154ca7937bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:48.759756 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf7dbc-b17a-4618-941e-154ca7937bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:48.760102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf7dbc-b17a-4618-941e-154ca7937bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:48.760333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf7dbc-b17a-4618-941e-154ca7937bdc admin admin] PATH_INFO: `/v3/users/c2bdb54363cb46819cd24189d5dfb700` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:48.761549 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf7dbc-b17a-4618-941e-154ca7937bdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2bdb54363cb46819cd24189d5dfb700)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:48.763808 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf7dbc-b17a-4618-941e-154ca7937bdc admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:48.779038 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 867/1741] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:48 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:48.781646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf61bda-ee96-43a8-a271-b6dbd8ba8241 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:48.788645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ccf61bda-ee96-43a8-a271-b6dbd8ba8241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:48.819285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf61bda-ee96-43a8-a271-b6dbd8ba8241 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:48.836184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34937df-4697-4a95-83ec-fd33e3bd9d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:48.838474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34937df-4697-4a95-83ec-fd33e3bd9d08 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:48.840166 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34937df-4697-4a95-83ec-fd33e3bd9d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:48.841110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34937df-4697-4a95-83ec-fd33e3bd9d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:48.844325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34937df-4697-4a95-83ec-fd33e3bd9d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:48.849579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34937df-4697-4a95-83ec-fd33e3bd9d08 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:48.869336 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9fdf7dbc-b17a-4618-941e-154ca7937bdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2bdb54363cb46819cd24189d5dfb700'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:48.873386 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9fdf7dbc-b17a-4618-941e-154ca7937bdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2bdb54363cb46819cd24189d5dfb700'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:48.887541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9fdf7dbc-b17a-4618-941e-154ca7937bdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2bdb54363cb46819cd24189d5dfb700'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:48.906526 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9fdf7dbc-b17a-4618-941e-154ca7937bdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2bdb54363cb46819cd24189d5dfb700'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:48.923211 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9fdf7dbc-b17a-4618-941e-154ca7937bdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2bdb54363cb46819cd24189d5dfb700'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:48.933797 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 875/1742] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:32:48 2022] DELETE /identity/v3/users/c2bdb54363cb46819cd24189d5dfb700 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:48.935444 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87dd1c-1bd9-492e-a169-205068571a4c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:48.946137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 868/1743] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:48 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:48.948840 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34937df-4697-4a95-83ec-fd33e3bd9d08 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:48.950547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87dd1c-1bd9-492e-a169-205068571a4c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:48.951002 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87dd1c-1bd9-492e-a169-205068571a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:48.957945 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e34937df-4697-4a95-83ec-fd33e3bd9d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:49.006320 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2a87dd1c-1bd9-492e-a169-205068571a4c None None] MFA Rules not processed for user `d494fd310b1f40839f113d045f0bdcb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:49.007865 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2a87dd1c-1bd9-492e-a169-205068571a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:49.035711 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:49.113105 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 876/1744] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Sep 1 16:32:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:49.114274 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87dd1c-1bd9-492e-a169-205068571a4c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:49.116021 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2a87dd1c-1bd9-492e-a169-205068571a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:49.136384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34937df-4697-4a95-83ec-fd33e3bd9d08 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:49.149383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed46bc-98c8-4b0e-a156-4b9fc6c9466c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:49.150020 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed46bc-98c8-4b0e-a156-4b9fc6c9466c admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:49.150301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed46bc-98c8-4b0e-a156-4b9fc6c9466c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:49.150572 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed46bc-98c8-4b0e-a156-4b9fc6c9466c admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:49.151780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed46bc-98c8-4b0e-a156-4b9fc6c9466c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:49.157635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed46bc-98c8-4b0e-a156-4b9fc6c9466c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:49.188115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 869/1745] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:49.190863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed46bc-98c8-4b0e-a156-4b9fc6c9466c admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:49.195632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-22ed46bc-98c8-4b0e-a156-4b9fc6c9466c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:49.223061 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed46bc-98c8-4b0e-a156-4b9fc6c9466c admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:49.240684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ac812-5ac3-48da-83b5-de67670f176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:49.241422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ac812-5ac3-48da-83b5-de67670f176d admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:49.241598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ac812-5ac3-48da-83b5-de67670f176d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:49.241860 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ac812-5ac3-48da-83b5-de67670f176d admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:49.242513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ac812-5ac3-48da-83b5-de67670f176d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:49.244786 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ac812-5ac3-48da-83b5-de67670f176d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:49.272104 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87dd1c-1bd9-492e-a169-205068571a4c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:49.272834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 870/1746] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:49.275698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ac812-5ac3-48da-83b5-de67670f176d admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:49.279033 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-fc7ac812-5ac3-48da-83b5-de67670f176d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:49.286058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81bf80-861c-412b-bf08-cda87e910470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:49.286710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81bf80-861c-412b-bf08-cda87e910470 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:49.286991 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81bf80-861c-412b-bf08-cda87e910470 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:49.287261 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81bf80-861c-412b-bf08-cda87e910470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:49.289186 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ac81bf80-861c-412b-bf08-cda87e910470 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:49.307369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ac812-5ac3-48da-83b5-de67670f176d admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:49.309984 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4829a-a8a2-408f-bd0e-d16b0d62ca81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:49.310871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4829a-a8a2-408f-bd0e-d16b0d62ca81 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:49.311636 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4829a-a8a2-408f-bd0e-d16b0d62ca81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:49.311952 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4829a-a8a2-408f-bd0e-d16b0d62ca81 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:49.313146 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4829a-a8a2-408f-bd0e-d16b0d62ca81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:49.317358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4829a-a8a2-408f-bd0e-d16b0d62ca81 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:49.379776 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81bf80-861c-412b-bf08-cda87e910470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:49.381517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81bf80-861c-412b-bf08-cda87e910470 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:49.382437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:INSERT=8,keystone:DELETE=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:49.396670 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 871/1747] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:49 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:49.398797 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 877/1748] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:49 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:49.399936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81bf80-861c-412b-bf08-cda87e910470 service nova] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:49.400807 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4829a-a8a2-408f-bd0e-d16b0d62ca81 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:49.407475 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-29f4829a-a8a2-408f-bd0e-d16b0d62ca81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:49.411317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81bf80-861c-412b-bf08-cda87e910470 service nova] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:49.424960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9d61a-0130-4412-acf7-61e7898f7dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:49.425643 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9d61a-0130-4412-acf7-61e7898f7dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:49.425919 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9d61a-0130-4412-acf7-61e7898f7dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:49.426194 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9d61a-0130-4412-acf7-61e7898f7dbd admin admin] PATH_INFO: `/v3/projects/a6107542604f4127abe167936f040ec0/users/d5781706dfd349c6bec885c36fd23a7e/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:49.442136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4829a-a8a2-408f-bd0e-d16b0d62ca81 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:49.445305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9d61a-0130-4412-acf7-61e7898f7dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6107542604f4127abe167936f040ec0, user_id=d5781706dfd349c6bec885c36fd23a7e, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:49.447504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c02386-8749-4671-8045-7ac42c9917f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:49.448682 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c02386-8749-4671-8045-7ac42c9917f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:49.448821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9d61a-0130-4412-acf7-61e7898f7dbd admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:49.448965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c02386-8749-4671-8045-7ac42c9917f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:49.449336 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c02386-8749-4671-8045-7ac42c9917f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:49.462547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c02386-8749-4671-8045-7ac42c9917f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:49.464957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c02386-8749-4671-8045-7ac42c9917f3 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:49.476627 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 872/1750] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:49.485416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 878/1750] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:49 2022] PUT /identity/v3/projects/a6107542604f4127abe167936f040ec0/users/d5781706dfd349c6bec885c36fd23a7e/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:49.487389 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75946f97-7026-4470-93a2-c6690537485b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:49.487824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75946f97-7026-4470-93a2-c6690537485b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:49.488278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75946f97-7026-4470-93a2-c6690537485b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:49.489147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c02386-8749-4671-8045-7ac42c9917f3 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:49.504796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c02386-8749-4671-8045-7ac42c9917f3 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:49.576783 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-75946f97-7026-4470-93a2-c6690537485b None None] MFA Rules not processed for user `6912413cfb474eb68e31c250531dfcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:49.578399 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-75946f97-7026-4470-93a2-c6690537485b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:49.685741 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c38f85-f4d3-4266-91c9-eede0115caa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:49.686896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c38f85-f4d3-4266-91c9-eede0115caa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:49.687324 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c38f85-f4d3-4266-91c9-eede0115caa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:49.688626 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c38f85-f4d3-4266-91c9-eede0115caa5 admin admin] PATH_INFO: `/v3/projects/ce13ae7e616049b28778c87e866c5ccc/users/a68a733e29594964a8f1ccd0b6490071/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:49.707394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c38f85-f4d3-4266-91c9-eede0115caa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce13ae7e616049b28778c87e866c5ccc, user_id=a68a733e29594964a8f1ccd0b6490071, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:49.708984 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:49.711767 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c38f85-f4d3-4266-91c9-eede0115caa5 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:49.755393 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 879/1751] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:49.759742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 873/1752] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:49 2022] PUT /identity/v3/projects/ce13ae7e616049b28778c87e866c5ccc/users/a68a733e29594964a8f1ccd0b6490071/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:49.763753 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6cc6d-68aa-4d31-8749-ee74a41ba33a None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:49.764767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75946f97-7026-4470-93a2-c6690537485b None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:49.765139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6cc6d-68aa-4d31-8749-ee74a41ba33a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:49.767331 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6cc6d-68aa-4d31-8749-ee74a41ba33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:49.788212 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75946f97-7026-4470-93a2-c6690537485b None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:49.814945 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-18a6cc6d-68aa-4d31-8749-ee74a41ba33a None None] MFA Rules not processed for user `d5781706dfd349c6bec885c36fd23a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:49.816905 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-18a6cc6d-68aa-4d31-8749-ee74a41ba33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:49.910071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 874/1753] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:49.912728 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6cc6d-68aa-4d31-8749-ee74a41ba33a None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:49.922468 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62d6e-5507-40b4-812f-3176c2669681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:49.923145 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62d6e-5507-40b4-812f-3176c2669681 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:49.923395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62d6e-5507-40b4-812f-3176c2669681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:49.923667 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62d6e-5507-40b4-812f-3176c2669681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:49.924424 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd62d6e-5507-40b4-812f-3176c2669681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:49.926178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd62d6e-5507-40b4-812f-3176c2669681 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:49.951090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 880/1754] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:49.952650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62d6e-5507-40b4-812f-3176c2669681 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:49.980313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62d6e-5507-40b4-812f-3176c2669681 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:50.003796 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e81a3-f5d6-4f00-9fdd-151e0eb7b90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:50.004421 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e81a3-f5d6-4f00-9fdd-151e0eb7b90e admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:50.004707 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e81a3-f5d6-4f00-9fdd-151e0eb7b90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:50.004975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e81a3-f5d6-4f00-9fdd-151e0eb7b90e admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:50.005617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e81a3-f5d6-4f00-9fdd-151e0eb7b90e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:50.015305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e81a3-f5d6-4f00-9fdd-151e0eb7b90e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:50.041027 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6cc6d-68aa-4d31-8749-ee74a41ba33a None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:50.061710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934c6de-e791-4b15-a47d-02f2736b3e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:50.062565 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934c6de-e791-4b15-a47d-02f2736b3e0a admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:50.062896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934c6de-e791-4b15-a47d-02f2736b3e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:50.063171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934c6de-e791-4b15-a47d-02f2736b3e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:50.063830 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934c6de-e791-4b15-a47d-02f2736b3e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:50.065500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934c6de-e791-4b15-a47d-02f2736b3e0a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:50.069543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:50.087267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 881/1755] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:49 2022] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:50.089574 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e81a3-f5d6-4f00-9fdd-151e0eb7b90e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:50.101453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 875/1756] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:50.101453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934c6de-e791-4b15-a47d-02f2736b3e0a admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:50.133872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934c6de-e791-4b15-a47d-02f2736b3e0a admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:50.273799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e81a3-f5d6-4f00-9fdd-151e0eb7b90e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:50.287888 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e49fd5-91e7-4465-9b90-1730bce63383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:50.290567 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e49fd5-91e7-4465-9b90-1730bce63383 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:50.290567 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e49fd5-91e7-4465-9b90-1730bce63383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:50.290567 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e49fd5-91e7-4465-9b90-1730bce63383 admin admin] PATH_INFO: `/v3/projects/e77c6bdca36743eca66a4e8fd3dc77a1/users/edb2c21819284d80893d2e38be53077b/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:50.343537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e49fd5-91e7-4465-9b90-1730bce63383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77c6bdca36743eca66a4e8fd3dc77a1, user_id=edb2c21819284d80893d2e38be53077b, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:50.348394 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e49fd5-91e7-4465-9b90-1730bce63383 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:50.379978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 882/1757] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:50 2022] PUT /identity/v3/projects/e77c6bdca36743eca66a4e8fd3dc77a1/users/edb2c21819284d80893d2e38be53077b/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:50.381852 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e49fd5-91e7-4465-9b90-1730bce63383 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:50.412395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394da579-6e72-42f8-ba14-3818f94d6ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:50.413039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394da579-6e72-42f8-ba14-3818f94d6ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:50.413322 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394da579-6e72-42f8-ba14-3818f94d6ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:50.413597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394da579-6e72-42f8-ba14-3818f94d6ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:50.414245 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394da579-6e72-42f8-ba14-3818f94d6ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:50.422942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394da579-6e72-42f8-ba14-3818f94d6ae2 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:50.483978 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 876/1758] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:50 2022] POST /identity/v3/users => generated 290 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:50.486274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394da579-6e72-42f8-ba14-3818f94d6ae2 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:50.500465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394da579-6e72-42f8-ba14-3818f94d6ae2 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:50.547960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:50.581959 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e49fd5-91e7-4465-9b90-1730bce63383 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:50.597550 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c83ebb-ff49-44ec-a76d-1befbbd108f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:50.598160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c83ebb-ff49-44ec-a76d-1befbbd108f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:50.600193 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c83ebb-ff49-44ec-a76d-1befbbd108f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:50.600193 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c83ebb-ff49-44ec-a76d-1befbbd108f0 admin admin] PATH_INFO: `/v3/projects/ce13ae7e616049b28778c87e866c5ccc/users/a68a733e29594964a8f1ccd0b6490071/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:50.607681 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c83ebb-ff49-44ec-a76d-1befbbd108f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce13ae7e616049b28778c87e866c5ccc, user_id=a68a733e29594964a8f1ccd0b6490071, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:50.611435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c83ebb-ff49-44ec-a76d-1befbbd108f0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:50.645214 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 883/1759] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:50 2022] PUT /identity/v3/projects/ce13ae7e616049b28778c87e866c5ccc/users/a68a733e29594964a8f1ccd0b6490071/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:50.649557 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e456371-88a7-406d-8783-98f7b0b6d8eb None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:50.650772 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e456371-88a7-406d-8783-98f7b0b6d8eb None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:50.651521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e456371-88a7-406d-8783-98f7b0b6d8eb None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:50.654145 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 884/1760] 10.222.0.71 () {54 vars in 912 bytes} [Thu Sep 1 16:32:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:32:50.655760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e456371-88a7-406d-8783-98f7b0b6d8eb None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:50.664098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe74d3-df7a-486c-bcec-0130cf5d07de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:50.666307 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe74d3-df7a-486c-bcec-0130cf5d07de admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:50.676472 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe74d3-df7a-486c-bcec-0130cf5d07de admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:50.676861 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe74d3-df7a-486c-bcec-0130cf5d07de admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:50.681423 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe74d3-df7a-486c-bcec-0130cf5d07de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:50.687590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe74d3-df7a-486c-bcec-0130cf5d07de admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:50.726060 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 877/1761] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:50.728189 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985d447-80ee-468a-8301-fc9100223326 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:50.729944 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985d447-80ee-468a-8301-fc9100223326 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:50.730247 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985d447-80ee-468a-8301-fc9100223326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:50.843960 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-4985d447-80ee-468a-8301-fc9100223326 None None] MFA Rules not processed for user `a68a733e29594964a8f1ccd0b6490071`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:50.855321 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4985d447-80ee-468a-8301-fc9100223326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:50.905306 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e456371-88a7-406d-8783-98f7b0b6d8eb None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:50.923288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4817b34-0464-4c40-9238-1f6f0f6f6892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:50.923936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4817b34-0464-4c40-9238-1f6f0f6f6892 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:50.924212 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4817b34-0464-4c40-9238-1f6f0f6f6892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:50.924494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4817b34-0464-4c40-9238-1f6f0f6f6892 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:50.925299 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4817b34-0464-4c40-9238-1f6f0f6f6892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:50.926957 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4817b34-0464-4c40-9238-1f6f0f6f6892 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:50.965860 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 885/1762] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:50.979906 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f13b3-55be-4f5f-8f51-c377481d87c5 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:50.980261 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f13b3-55be-4f5f-8f51-c377481d87c5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:50.980542 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f13b3-55be-4f5f-8f51-c377481d87c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:51.019181 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-460f13b3-55be-4f5f-8f51-c377481d87c5 None None] MFA Rules not processed for user `d494fd310b1f40839f113d045f0bdcb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:51.027242 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-460f13b3-55be-4f5f-8f51-c377481d87c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:51.068558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 878/1763] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:51.069252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985d447-80ee-468a-8301-fc9100223326 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:51.082180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985d447-80ee-468a-8301-fc9100223326 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:51.090269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22754442-8890-40ab-aa07-e506298d205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:51.091058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22754442-8890-40ab-aa07-e506298d205b admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:51.091504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22754442-8890-40ab-aa07-e506298d205b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:51.091792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22754442-8890-40ab-aa07-e506298d205b admin admin] PATH_INFO: `/v3/projects/e77c6bdca36743eca66a4e8fd3dc77a1/users/edb2c21819284d80893d2e38be53077b/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:51.096018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22754442-8890-40ab-aa07-e506298d205b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77c6bdca36743eca66a4e8fd3dc77a1, user_id=edb2c21819284d80893d2e38be53077b, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:51.099115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22754442-8890-40ab-aa07-e506298d205b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:51.102674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:51.124396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 886/1764] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Sep 1 16:32:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:51.125340 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f13b3-55be-4f5f-8f51-c377481d87c5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:51.127919 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-460f13b3-55be-4f5f-8f51-c377481d87c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:51.132257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 879/1765] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:51 2022] PUT /identity/v3/projects/e77c6bdca36743eca66a4e8fd3dc77a1/users/edb2c21819284d80893d2e38be53077b/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:51.139603 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22754442-8890-40ab-aa07-e506298d205b admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:51.158673 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f13b3-55be-4f5f-8f51-c377481d87c5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:51.296586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22754442-8890-40ab-aa07-e506298d205b admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:51.308070 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c9c67-770c-41a8-ba86-f17ad0fac419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:51.309459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c9c67-770c-41a8-ba86-f17ad0fac419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:51.309633 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c9c67-770c-41a8-ba86-f17ad0fac419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:51.309909 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c9c67-770c-41a8-ba86-f17ad0fac419 admin admin] PATH_INFO: `/v3/projects/6e7a33489267406fa95103c9dbf2d72a` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:51.311383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c9c67-770c-41a8-ba86-f17ad0fac419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e7a33489267406fa95103c9dbf2d72a)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:51.313309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c9c67-770c-41a8-ba86-f17ad0fac419 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:51.316295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea7e59-363d-4056-851e-d938dcc48d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:51.316975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea7e59-363d-4056-851e-d938dcc48d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:51.317254 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea7e59-363d-4056-851e-d938dcc48d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:51.317523 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea7e59-363d-4056-851e-d938dcc48d9e admin admin] PATH_INFO: `/v3/projects/1450e9c2ec234709873418d43d299493/users/fc82e1dc0c5045bfa6262a01efd64987/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:51.350182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea7e59-363d-4056-851e-d938dcc48d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1450e9c2ec234709873418d43d299493, user_id=fc82e1dc0c5045bfa6262a01efd64987, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:51.352897 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea7e59-363d-4056-851e-d938dcc48d9e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:51.385700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 880/1766] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:51 2022] PUT /identity/v3/projects/1450e9c2ec234709873418d43d299493/users/fc82e1dc0c5045bfa6262a01efd64987/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:51.385700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea7e59-363d-4056-851e-d938dcc48d9e admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:51.387311 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-39ea7e59-363d-4056-851e-d938dcc48d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:51.400441 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:51.430903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-477c9c67-770c-41a8-ba86-f17ad0fac419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e7a33489267406fa95103c9dbf2d72a', 'request_id': 'req-477c9c67-770c-41a8-ba86-f17ad0fac419'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:51.445471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-477c9c67-770c-41a8-ba86-f17ad0fac419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e7a33489267406fa95103c9dbf2d72a', 'request_id': 'req-477c9c67-770c-41a8-ba86-f17ad0fac419'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:51.488333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-477c9c67-770c-41a8-ba86-f17ad0fac419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e7a33489267406fa95103c9dbf2d72a', 'request_id': 'req-477c9c67-770c-41a8-ba86-f17ad0fac419'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:51.514537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-477c9c67-770c-41a8-ba86-f17ad0fac419 admin admin] The token cache is being invalidate because project 6e7a33489267406fa95103c9dbf2d72a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:32:51.514883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-477c9c67-770c-41a8-ba86-f17ad0fac419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:51.517460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-477c9c67-770c-41a8-ba86-f17ad0fac419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:51.523025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 887/1767] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:32:51 2022] DELETE /identity/v3/projects/6e7a33489267406fa95103c9dbf2d72a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:51.525198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c9c67-770c-41a8-ba86-f17ad0fac419 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:51.530028 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-477c9c67-770c-41a8-ba86-f17ad0fac419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:51.538863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea7e59-363d-4056-851e-d938dcc48d9e admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:51.630168 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964e7e8-ba40-4d27-948b-8600fdd62b1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae8db0856ed44088f0bd3cb93701de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:51.631668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964e7e8-ba40-4d27-948b-8600fdd62b1d service placement] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:51.632127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964e7e8-ba40-4d27-948b-8600fdd62b1d service placement] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:51.632549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964e7e8-ba40-4d27-948b-8600fdd62b1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:51.634718 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d964e7e8-ba40-4d27-948b-8600fdd62b1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:51.652861 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964e7e8-ba40-4d27-948b-8600fdd62b1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:51.654852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964e7e8-ba40-4d27-948b-8600fdd62b1d service placement] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:51.656712 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c9c67-770c-41a8-ba86-f17ad0fac419 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:51.660786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930698d-9cdc-48e7-9fc5-21e8f017a8e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:51.661670 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930698d-9cdc-48e7-9fc5-21e8f017a8e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:51.662050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930698d-9cdc-48e7-9fc5-21e8f017a8e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:51.662419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930698d-9cdc-48e7-9fc5-21e8f017a8e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:51.664486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c930698d-9cdc-48e7-9fc5-21e8f017a8e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:51.667163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 881/1768] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:51.668657 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a1521-23ed-4c90-ab7c-364cc7300b0e None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:51.669122 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a1521-23ed-4c90-ab7c-364cc7300b0e None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:51.669549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a1521-23ed-4c90-ab7c-364cc7300b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:51.699050 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-456a1521-23ed-4c90-ab7c-364cc7300b0e None None] MFA Rules not processed for user `88cd06365efb4911b40d8aa0c721c32f`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:51.700332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-456a1521-23ed-4c90-ab7c-364cc7300b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:51.713264 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:51.781503 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 882/1769] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:51.782827 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c6229-ba2c-499c-ab70-21e740ed2e1e None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:51.783036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c6229-ba2c-499c-ab70-21e740ed2e1e None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:51.783249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c6229-ba2c-499c-ab70-21e740ed2e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:51.803822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930698d-9cdc-48e7-9fc5-21e8f017a8e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:51.805648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930698d-9cdc-48e7-9fc5-21e8f017a8e7 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:51.818162 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 888/1770] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:51.819183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930698d-9cdc-48e7-9fc5-21e8f017a8e7 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:51.820565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c930698d-9cdc-48e7-9fc5-21e8f017a8e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:51.831995 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-5a4c6229-ba2c-499c-ab70-21e740ed2e1e None None] MFA Rules not processed for user `edb2c21819284d80893d2e38be53077b`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:51.833120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5a4c6229-ba2c-499c-ab70-21e740ed2e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:51.944109 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 883/1771] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:51.950123 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c6229-ba2c-499c-ab70-21e740ed2e1e None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:51.951604 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5a4c6229-ba2c-499c-ab70-21e740ed2e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:51.955236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930698d-9cdc-48e7-9fc5-21e8f017a8e7 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:51.968696 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f720de-08ff-4bbc-b9e9-8d5d396633cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:51.969734 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f720de-08ff-4bbc-b9e9-8d5d396633cc service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:51.970489 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f720de-08ff-4bbc-b9e9-8d5d396633cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:51.972575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f720de-08ff-4bbc-b9e9-8d5d396633cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:51.985351 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b5f720de-08ff-4bbc-b9e9-8d5d396633cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:52.012305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f720de-08ff-4bbc-b9e9-8d5d396633cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:52.015927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f720de-08ff-4bbc-b9e9-8d5d396633cc service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:52.039528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c6229-ba2c-499c-ab70-21e740ed2e1e None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:52.040654 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 889/1772] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:52.043030 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba4ac5-a23a-439a-9b98-2cb9c29c789a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:52.043580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba4ac5-a23a-439a-9b98-2cb9c29c789a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:52.043957 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba4ac5-a23a-439a-9b98-2cb9c29c789a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:52.052789 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678d052-8f90-4758-b9fb-f96958b05077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:52.054345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d052-8f90-4758-b9fb-f96958b05077 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:52.055613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d052-8f90-4758-b9fb-f96958b05077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:52.056380 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d052-8f90-4758-b9fb-f96958b05077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:52.058134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678d052-8f90-4758-b9fb-f96958b05077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:52.060773 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678d052-8f90-4758-b9fb-f96958b05077 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:52.084310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f1ba4ac5-a23a-439a-9b98-2cb9c29c789a None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:52.087447 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f1ba4ac5-a23a-439a-9b98-2cb9c29c789a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:52.094568 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 884/1773] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:52.095766 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678d052-8f90-4758-b9fb-f96958b05077 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:52.105436 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 890/1774] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:52.106801 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba4ac5-a23a-439a-9b98-2cb9c29c789a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:52.117950 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678d052-8f90-4758-b9fb-f96958b05077 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:52.132517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:52.141579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba4ac5-a23a-439a-9b98-2cb9c29c789a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:52.155119 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d64f9-9297-4037-8520-53f64d2d3e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:52.155547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40126d-3696-4c6b-b235-cbdcd381b0a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:52.156142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d64f9-9297-4037-8520-53f64d2d3e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:52.156273 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40126d-3696-4c6b-b235-cbdcd381b0a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:52.161876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40126d-3696-4c6b-b235-cbdcd381b0a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:52.162088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d64f9-9297-4037-8520-53f64d2d3e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:52.162178 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40126d-3696-4c6b-b235-cbdcd381b0a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:52.162266 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d64f9-9297-4037-8520-53f64d2d3e0e admin admin] PATH_INFO: `/v3/projects/1450e9c2ec234709873418d43d299493/users/fc82e1dc0c5045bfa6262a01efd64987/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:52.162266 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d64f9-9297-4037-8520-53f64d2d3e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1450e9c2ec234709873418d43d299493, user_id=fc82e1dc0c5045bfa6262a01efd64987, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:52.162266 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d64f9-9297-4037-8520-53f64d2d3e0e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:52.186095 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 891/1775] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:52 2022] PUT /identity/v3/projects/1450e9c2ec234709873418d43d299493/users/fc82e1dc0c5045bfa6262a01efd64987/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:52.187661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fef2e-3527-44a8-b6ad-5ff646eb7f14 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:52.188019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fef2e-3527-44a8-b6ad-5ff646eb7f14 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:52.189041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fef2e-3527-44a8-b6ad-5ff646eb7f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:52.199778 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40126d-3696-4c6b-b235-cbdcd381b0a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:52.208131 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40126d-3696-4c6b-b235-cbdcd381b0a3 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:52.249702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 885/1776] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:52.252213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b8467-8abd-4e1a-bad2-e5fb6e9c2b8b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:52.253478 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b8467-8abd-4e1a-bad2-e5fb6e9c2b8b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:52.254040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b8467-8abd-4e1a-bad2-e5fb6e9c2b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:52.267643 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d74fef2e-3527-44a8-b6ad-5ff646eb7f14 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:52.271212 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d74fef2e-3527-44a8-b6ad-5ff646eb7f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:52.341957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-694b8467-8abd-4e1a-bad2-e5fb6e9c2b8b None None] MFA Rules not processed for user `fc82e1dc0c5045bfa6262a01efd64987`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:52.344000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-694b8467-8abd-4e1a-bad2-e5fb6e9c2b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:52.368737 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:52.471616 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 892/1777] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:52.478583 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fef2e-3527-44a8-b6ad-5ff646eb7f14 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:52.481910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d74fef2e-3527-44a8-b6ad-5ff646eb7f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:52.517457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 886/1778] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:52.521909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b8467-8abd-4e1a-bad2-e5fb6e9c2b8b None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:52.565840 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b8467-8abd-4e1a-bad2-e5fb6e9c2b8b None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:52.583288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3c95e-90fa-4435-8686-6f36850a53f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:52.583928 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3c95e-90fa-4435-8686-6f36850a53f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:52.584193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3c95e-90fa-4435-8686-6f36850a53f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:52.584464 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3c95e-90fa-4435-8686-6f36850a53f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:52.585168 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3c95e-90fa-4435-8686-6f36850a53f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:32:52.585474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3c95e-90fa-4435-8686-6f36850a53f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:52.591746 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3c95e-90fa-4435-8686-6f36850a53f2 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:52.653263 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 887/1779] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:32:52.654156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3c95e-90fa-4435-8686-6f36850a53f2 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:52.677590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fef2e-3527-44a8-b6ad-5ff646eb7f14 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:52.684101 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3c95e-90fa-4435-8686-6f36850a53f2 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:52.690880 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935cd8e-26ef-43b6-a40e-40e3291fe2c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:52.691513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935cd8e-26ef-43b6-a40e-40e3291fe2c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:52.691794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935cd8e-26ef-43b6-a40e-40e3291fe2c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:52.692063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935cd8e-26ef-43b6-a40e-40e3291fe2c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:52.697822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066843e-c785-4c2b-af31-5895e2cac646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:52.698451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066843e-c785-4c2b-af31-5895e2cac646 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:52.699873 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2935cd8e-26ef-43b6-a40e-40e3291fe2c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:52.702225 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066843e-c785-4c2b-af31-5895e2cac646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:52.702746 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066843e-c785-4c2b-af31-5895e2cac646 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:52.703429 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066843e-c785-4c2b-af31-5895e2cac646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:52.705381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066843e-c785-4c2b-af31-5895e2cac646 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:52.808106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 888/1780] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:52 2022] POST /identity/v3/projects => generated 405 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:52.808467 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066843e-c785-4c2b-af31-5895e2cac646 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:52.952328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066843e-c785-4c2b-af31-5895e2cac646 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:52.963715 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a59758-a3a9-47d7-af0d-01bd948eef1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:52.964709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a59758-a3a9-47d7-af0d-01bd948eef1f admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:52.967331 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a59758-a3a9-47d7-af0d-01bd948eef1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:52.970890 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a59758-a3a9-47d7-af0d-01bd948eef1f admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:52.971864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935cd8e-26ef-43b6-a40e-40e3291fe2c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:52.973625 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935cd8e-26ef-43b6-a40e-40e3291fe2c0 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:52.973906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a59758-a3a9-47d7-af0d-01bd948eef1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:52.976435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a59758-a3a9-47d7-af0d-01bd948eef1f admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:53.024508 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 893/1781] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:53.027263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935cd8e-26ef-43b6-a40e-40e3291fe2c0 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:53.043024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 889/1782] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:52 2022] POST /identity/v3/users => generated 303 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:53.044484 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a59758-a3a9-47d7-af0d-01bd948eef1f admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:53.054317 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935cd8e-26ef-43b6-a40e-40e3291fe2c0 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:53.092159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a59758-a3a9-47d7-af0d-01bd948eef1f admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:53.111466 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82fa92-8f90-4628-90bc-ccbb09231247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:53.112269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82fa92-8f90-4628-90bc-ccbb09231247 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:53.112443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82fa92-8f90-4628-90bc-ccbb09231247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:53.112666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82fa92-8f90-4628-90bc-ccbb09231247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:53.113323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82fa92-8f90-4628-90bc-ccbb09231247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:53.120992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82fa92-8f90-4628-90bc-ccbb09231247 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:53.197394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 890/1783] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:32:53.201551 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82fa92-8f90-4628-90bc-ccbb09231247 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:53.215401 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:53.223866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82fa92-8f90-4628-90bc-ccbb09231247 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:53.241097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d59228-c460-4bf9-892b-884c010ddd85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:53.241754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d59228-c460-4bf9-892b-884c010ddd85 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:53.242067 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d59228-c460-4bf9-892b-884c010ddd85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:53.242307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d59228-c460-4bf9-892b-884c010ddd85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:53.243433 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61b79c-25d1-4a79-97ea-912ef60a380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:53.244051 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61b79c-25d1-4a79-97ea-912ef60a380b admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:53.244403 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61b79c-25d1-4a79-97ea-912ef60a380b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:53.244625 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61b79c-25d1-4a79-97ea-912ef60a380b admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:53.245285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61b79c-25d1-4a79-97ea-912ef60a380b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:53.246933 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61b79c-25d1-4a79-97ea-912ef60a380b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:53.307930 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 891/1784] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:32:53.309107 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61b79c-25d1-4a79-97ea-912ef60a380b admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:53.341769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61b79c-25d1-4a79-97ea-912ef60a380b admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:53.348298 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120508eb-a7c0-4f6c-9669-a22348ed9d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:53.352843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120508eb-a7c0-4f6c-9669-a22348ed9d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:53.353788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120508eb-a7c0-4f6c-9669-a22348ed9d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:53.354127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120508eb-a7c0-4f6c-9669-a22348ed9d13 admin admin] PATH_INFO: `/v3/projects/777ce7ea5aae4e3abcf5bb5fced111f1/users/ecc3f19588aa4093b59a25a8a978c97b/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:53.418725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120508eb-a7c0-4f6c-9669-a22348ed9d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=777ce7ea5aae4e3abcf5bb5fced111f1, user_id=ecc3f19588aa4093b59a25a8a978c97b, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:53.426641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120508eb-a7c0-4f6c-9669-a22348ed9d13 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:53.469606 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 892/1785] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:53 2022] PUT /identity/v3/projects/777ce7ea5aae4e3abcf5bb5fced111f1/users/ecc3f19588aa4093b59a25a8a978c97b/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:32:53.471239 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa185e-d1a0-46e1-8f94-c6a1abd53769 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:53.471673 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa185e-d1a0-46e1-8f94-c6a1abd53769 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:53.472054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa185e-d1a0-46e1-8f94-c6a1abd53769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:53.485905 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d59228-c460-4bf9-892b-884c010ddd85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:53.487406 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d59228-c460-4bf9-892b-884c010ddd85 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:53.521339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-55fa185e-d1a0-46e1-8f94-c6a1abd53769 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:53.522322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 894/1786] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:53.523572 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-55fa185e-d1a0-46e1-8f94-c6a1abd53769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:53.553047 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:53.762537 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 893/1787] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:53.770308 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d59228-c460-4bf9-892b-884c010ddd85 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:53.776273 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa185e-d1a0-46e1-8f94-c6a1abd53769 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:53.782908 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d59228-c460-4bf9-892b-884c010ddd85 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:53.936121 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa185e-d1a0-46e1-8f94-c6a1abd53769 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:53.948917 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc83a75-a35f-49fa-b49d-fcf9cde4c69e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:53.949777 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc83a75-a35f-49fa-b49d-fcf9cde4c69e service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:53.950229 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc83a75-a35f-49fa-b49d-fcf9cde4c69e service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:53.950684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc83a75-a35f-49fa-b49d-fcf9cde4c69e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:53.973940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc83a75-a35f-49fa-b49d-fcf9cde4c69e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:53.976045 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc83a75-a35f-49fa-b49d-fcf9cde4c69e service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:54.000217 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 894/1788] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:54.001884 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e684f5-4409-402b-9794-d2e98c832008 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:54.002974 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e684f5-4409-402b-9794-d2e98c832008 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:54.003749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e684f5-4409-402b-9794-d2e98c832008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:54.015162 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06db81-4f82-4679-8ea5-9531f0a2fd1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:54.015795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06db81-4f82-4679-8ea5-9531f0a2fd1c service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:54.018379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06db81-4f82-4679-8ea5-9531f0a2fd1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:54.018702 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06db81-4f82-4679-8ea5-9531f0a2fd1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:54.037822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-dc06db81-4f82-4679-8ea5-9531f0a2fd1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:54.059915 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-81e684f5-4409-402b-9794-d2e98c832008 None None] MFA Rules not processed for user `08d87dbdb5e8475ebee33fd65e62b3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:54.061454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-81e684f5-4409-402b-9794-d2e98c832008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:54.236834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 895/1789] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:54.397886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06db81-4f82-4679-8ea5-9531f0a2fd1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:54.401845 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06db81-4f82-4679-8ea5-9531f0a2fd1c service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:54.430952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 895/1790] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:57.044189 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77869906-3996-4de8-bda2-4bb89edb3d5a None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:57.045487 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77869906-3996-4de8-bda2-4bb89edb3d5a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:57.046125 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77869906-3996-4de8-bda2-4bb89edb3d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:57.154056 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-77869906-3996-4de8-bda2-4bb89edb3d5a None None] MFA Rules not processed for user `cd0dbb2c140946f69c3f508b4184e998`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:57.155419 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-77869906-3996-4de8-bda2-4bb89edb3d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:57.280222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:57.364648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 896/1791] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Sep 1 16:32:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:57.701258 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06db81-4f82-4679-8ea5-9531f0a2fd1c service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:57.703704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-dc06db81-4f82-4679-8ea5-9531f0a2fd1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:57.756001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77869906-3996-4de8-bda2-4bb89edb3d5a None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:57.787635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77869906-3996-4de8-bda2-4bb89edb3d5a None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:57.802430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f3d70-f8c8-4c42-a799-b28177c3f4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:57.803403 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f3d70-f8c8-4c42-a799-b28177c3f4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:57.803908 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f3d70-f8c8-4c42-a799-b28177c3f4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:57.804467 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f3d70-f8c8-4c42-a799-b28177c3f4f5 admin admin] PATH_INFO: `/v3/users/d5781706dfd349c6bec885c36fd23a7e` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:57.808838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f3d70-f8c8-4c42-a799-b28177c3f4f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5781706dfd349c6bec885c36fd23a7e)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:57.813750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f3d70-f8c8-4c42-a799-b28177c3f4f5 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:57.881128 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:57.953850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-674f3d70-f8c8-4c42-a799-b28177c3f4f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5781706dfd349c6bec885c36fd23a7e'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:57.956630 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-674f3d70-f8c8-4c42-a799-b28177c3f4f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5781706dfd349c6bec885c36fd23a7e'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:57.991373 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06db81-4f82-4679-8ea5-9531f0a2fd1c service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:57.993885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-674f3d70-f8c8-4c42-a799-b28177c3f4f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5781706dfd349c6bec885c36fd23a7e'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:58.007028 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67baeb-840e-42ed-a542-c58614c14428 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f7afa63815643f580c91df4e4c3bafc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:58.007701 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67baeb-840e-42ed-a542-c58614c14428 service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:58.007981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67baeb-840e-42ed-a542-c58614c14428 service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:58.008531 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67baeb-840e-42ed-a542-c58614c14428 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:58.008605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-674f3d70-f8c8-4c42-a799-b28177c3f4f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5781706dfd349c6bec885c36fd23a7e'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:58.019512 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0f67baeb-840e-42ed-a542-c58614c14428 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:58.024369 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-674f3d70-f8c8-4c42-a799-b28177c3f4f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5781706dfd349c6bec885c36fd23a7e'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:32:58.043901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 897/1792] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:32:57 2022] DELETE /identity/v3/users/d5781706dfd349c6bec885c36fd23a7e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:32:58.046286 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbe776-94c1-45fb-b860-21720f32e39d None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:58.047556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbe776-94c1-45fb-b860-21720f32e39d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:58.048004 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbe776-94c1-45fb-b860-21720f32e39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:58.050438 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67baeb-840e-42ed-a542-c58614c14428 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:58.056279 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67baeb-840e-42ed-a542-c58614c14428 service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:58.081264 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 896/1793] 10.222.0.71 () {60 vars in 1384 bytes} [Thu Sep 1 16:32:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:32:58.105121 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-56dbe776-94c1-45fb-b860-21720f32e39d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:58.106888 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-56dbe776-94c1-45fb-b860-21720f32e39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:58.348145 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 898/1794] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:58.490553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67baeb-840e-42ed-a542-c58614c14428 service swift] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:58.495077 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0f67baeb-840e-42ed-a542-c58614c14428 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:58.560515 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67baeb-840e-42ed-a542-c58614c14428 service swift] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:58.683651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be992f45-70f2-4d4a-b40f-f1ed9048b307 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:58.683943 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be992f45-70f2-4d4a-b40f-f1ed9048b307 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:58.684215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be992f45-70f2-4d4a-b40f-f1ed9048b307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:58.850518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-be992f45-70f2-4d4a-b40f-f1ed9048b307 None None] MFA Rules not processed for user `ecc3f19588aa4093b59a25a8a978c97b`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:58.851688 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-be992f45-70f2-4d4a-b40f-f1ed9048b307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:58.862318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6623d-48c4-4e42-9274-1845fe5a0e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:58.864408 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6623d-48c4-4e42-9274-1845fe5a0e42 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:58.869122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6623d-48c4-4e42-9274-1845fe5a0e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:58.874258 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6623d-48c4-4e42-9274-1845fe5a0e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:58.916441 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6623d-48c4-4e42-9274-1845fe5a0e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:58.920651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6623d-48c4-4e42-9274-1845fe5a0e42 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:58.954224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 897/1795] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:59.101555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:59.308198 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 899/1796] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:32:58 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 626 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:59.309447 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6623d-48c4-4e42-9274-1845fe5a0e42 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:59.311284 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4aa6623d-48c4-4e42-9274-1845fe5a0e42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:59.377121 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6623d-48c4-4e42-9274-1845fe5a0e42 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:59.410392 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258106c7-fdda-4581-94c3-ecd4fadf3f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:59.412384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258106c7-fdda-4581-94c3-ecd4fadf3f4c admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:59.412668 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258106c7-fdda-4581-94c3-ecd4fadf3f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:59.417123 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258106c7-fdda-4581-94c3-ecd4fadf3f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:59.422160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258106c7-fdda-4581-94c3-ecd4fadf3f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:59.453362 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258106c7-fdda-4581-94c3-ecd4fadf3f4c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:59.548737 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 898/1797] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:32:59 2022] POST /identity/v3/projects => generated 403 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:59.550480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be992f45-70f2-4d4a-b40f-f1ed9048b307 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:59.593627 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be992f45-70f2-4d4a-b40f-f1ed9048b307 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:59.848463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907df2a-60ce-4d59-bf3d-a2d51b029278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:59.849100 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907df2a-60ce-4d59-bf3d-a2d51b029278 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:59.849382 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907df2a-60ce-4d59-bf3d-a2d51b029278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:59.851921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907df2a-60ce-4d59-bf3d-a2d51b029278 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:59.854387 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907df2a-60ce-4d59-bf3d-a2d51b029278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:59.856456 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907df2a-60ce-4d59-bf3d-a2d51b029278 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:59.926411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 900/1798] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:32:59 2022] POST /identity/v3/users => generated 308 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:32:59.929426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258106c7-fdda-4581-94c3-ecd4fadf3f4c admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:59.945158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258106c7-fdda-4581-94c3-ecd4fadf3f4c admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:59.955917 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d811f-9d5e-4147-b6b1-c95dea9f48cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:59.957162 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d811f-9d5e-4147-b6b1-c95dea9f48cd admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:59.957723 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d811f-9d5e-4147-b6b1-c95dea9f48cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:59.959426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d811f-9d5e-4147-b6b1-c95dea9f48cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:59.960465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d811f-9d5e-4147-b6b1-c95dea9f48cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:59.963770 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d811f-9d5e-4147-b6b1-c95dea9f48cd admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:59.997085 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907df2a-60ce-4d59-bf3d-a2d51b029278 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:00.005305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 899/1799] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:00.013842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907df2a-60ce-4d59-bf3d-a2d51b029278 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:00.027435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f3792-4a0b-4614-8976-aa90e0b3e966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:00.028605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f3792-4a0b-4614-8976-aa90e0b3e966 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:00.029231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f3792-4a0b-4614-8976-aa90e0b3e966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:00.029575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f3792-4a0b-4614-8976-aa90e0b3e966 admin admin] PATH_INFO: `/v3/projects/d519d76fd62747feb929244b653e5362/users/4f1b6090ae504b41b06e5bc5d7911a92/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:00.067230 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f3792-4a0b-4614-8976-aa90e0b3e966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d519d76fd62747feb929244b653e5362, user_id=4f1b6090ae504b41b06e5bc5d7911a92, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:00.076702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f3792-4a0b-4614-8976-aa90e0b3e966 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:00.131988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 901/1800] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:32:59 2022] PUT /identity/v3/projects/d519d76fd62747feb929244b653e5362/users/4f1b6090ae504b41b06e5bc5d7911a92/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:00.136807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d811f-9d5e-4147-b6b1-c95dea9f48cd admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:00.162588 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d811f-9d5e-4147-b6b1-c95dea9f48cd admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:00.351599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb958cf2-faab-4508-867a-cd9aa87918a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:00.354437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb958cf2-faab-4508-867a-cd9aa87918a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:00.354437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb958cf2-faab-4508-867a-cd9aa87918a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:00.362771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb958cf2-faab-4508-867a-cd9aa87918a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:00.363647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb958cf2-faab-4508-867a-cd9aa87918a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:00.374048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb958cf2-faab-4508-867a-cd9aa87918a9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:00.411810 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 900/1801] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:00.419447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f3792-4a0b-4614-8976-aa90e0b3e966 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:00.486170 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f3792-4a0b-4614-8976-aa90e0b3e966 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:00.515625 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a309946-1f06-4e80-b8f6-06d5a35f89fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:00.522225 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a309946-1f06-4e80-b8f6-06d5a35f89fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:00.522559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a309946-1f06-4e80-b8f6-06d5a35f89fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:00.522874 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a309946-1f06-4e80-b8f6-06d5a35f89fe admin admin] PATH_INFO: `/v3/projects/d519d76fd62747feb929244b653e5362/users/4f1b6090ae504b41b06e5bc5d7911a92/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:00.539011 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a309946-1f06-4e80-b8f6-06d5a35f89fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d519d76fd62747feb929244b653e5362, user_id=4f1b6090ae504b41b06e5bc5d7911a92, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:00.547265 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a309946-1f06-4e80-b8f6-06d5a35f89fe admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:00.591294 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 902/1802] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:00 2022] PUT /identity/v3/projects/d519d76fd62747feb929244b653e5362/users/4f1b6090ae504b41b06e5bc5d7911a92/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:00.853200 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56acc0-6f19-4595-bde0-e87ba7d000db None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:00.854351 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56acc0-6f19-4595-bde0-e87ba7d000db None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:00.854784 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56acc0-6f19-4595-bde0-e87ba7d000db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:00.932955 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9d56acc0-6f19-4595-bde0-e87ba7d000db None None] MFA Rules not processed for user `d494fd310b1f40839f113d045f0bdcb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:00.937729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9d56acc0-6f19-4595-bde0-e87ba7d000db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:00.992766 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a309946-1f06-4e80-b8f6-06d5a35f89fe admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:00.994943 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2a309946-1f06-4e80-b8f6-06d5a35f89fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:01.051642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:01.207725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 901/1803] 10.222.0.59 () {58 vars in 1015 bytes} [Thu Sep 1 16:33:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:01.223503 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a309946-1f06-4e80-b8f6-06d5a35f89fe admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:01.231283 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034f220-5ad4-4428-ba34-d4d1f207454b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:01.231909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f220-5ad4-4428-ba34-d4d1f207454b service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:01.232181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f220-5ad4-4428-ba34-d4d1f207454b service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:01.232488 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f220-5ad4-4428-ba34-d4d1f207454b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:01.235566 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1034f220-5ad4-4428-ba34-d4d1f207454b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:01.426352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:01.445570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56acc0-6f19-4595-bde0-e87ba7d000db None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:01.447415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9d56acc0-6f19-4595-bde0-e87ba7d000db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:01.464850 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56acc0-6f19-4595-bde0-e87ba7d000db None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:01.467969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034f220-5ad4-4428-ba34-d4d1f207454b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:01.477874 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9cb7e-3d10-4e12-b3e6-dead4d42a4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:01.483531 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9cb7e-3d10-4e12-b3e6-dead4d42a4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:01.483993 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9cb7e-3d10-4e12-b3e6-dead4d42a4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:01.484283 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9cb7e-3d10-4e12-b3e6-dead4d42a4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:01.491216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034f220-5ad4-4428-ba34-d4d1f207454b service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:01.501586 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9cb7e-3d10-4e12-b3e6-dead4d42a4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:01.503174 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9cb7e-3d10-4e12-b3e6-dead4d42a4d3 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:01.532495 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 902/1804] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:01.536937 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 903/1805] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:33:02.230514 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9cb7e-3d10-4e12-b3e6-dead4d42a4d3 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:02.236893 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-40a9cb7e-3d10-4e12-b3e6-dead4d42a4d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:02.530141 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9cb7e-3d10-4e12-b3e6-dead4d42a4d3 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:02.543019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:02.545325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:02.545586 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:02.545952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1 admin admin] PATH_INFO: `/v3/projects/a6107542604f4127abe167936f040ec0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:02.554537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6107542604f4127abe167936f040ec0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:02.566703 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:02.724593 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6107542604f4127abe167936f040ec0', 'request_id': 'req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:02.741212 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6107542604f4127abe167936f040ec0', 'request_id': 'req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:02.754979 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6107542604f4127abe167936f040ec0', 'request_id': 'req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:02.776832 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1 admin admin] The token cache is being invalidate because project a6107542604f4127abe167936f040ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:02.777428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:02.778695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:02.785025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 903/1806] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:02 2022] DELETE /identity/v3/projects/a6107542604f4127abe167936f040ec0 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:02.789569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034f220-5ad4-4428-ba34-d4d1f207454b service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:02.809753 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034f220-5ad4-4428-ba34-d4d1f207454b service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:03.057028 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:03.059255 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:03.102321 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e4977-88c7-42e7-be3e-0d311d7bf2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:03.105512 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e4977-88c7-42e7-be3e-0d311d7bf2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:03.108457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e4977-88c7-42e7-be3e-0d311d7bf2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:03.112099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e4977-88c7-42e7-be3e-0d311d7bf2f2 admin admin] PATH_INFO: `/v3/users/fc82e1dc0c5045bfa6262a01efd64987` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:03.116365 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e4977-88c7-42e7-be3e-0d311d7bf2f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc82e1dc0c5045bfa6262a01efd64987)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:03.118882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e4977-88c7-42e7-be3e-0d311d7bf2f2 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:03.272734 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:03.303533 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f11e4977-88c7-42e7-be3e-0d311d7bf2f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc82e1dc0c5045bfa6262a01efd64987'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:03.305770 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f11e4977-88c7-42e7-be3e-0d311d7bf2f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc82e1dc0c5045bfa6262a01efd64987'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:03.316566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5def10-ee9d-4007-ab4d-aba6f4d4f3d1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:03.339202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fba609-3f1b-40bc-a970-dad8d016c41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:03.343484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fba609-3f1b-40bc-a970-dad8d016c41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:03.348719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fba609-3f1b-40bc-a970-dad8d016c41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:03.349400 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fba609-3f1b-40bc-a970-dad8d016c41b admin admin] PATH_INFO: `/v3/users/57ec06cbf3f34633b9b45d94321a35d0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:03.350251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f11e4977-88c7-42e7-be3e-0d311d7bf2f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc82e1dc0c5045bfa6262a01efd64987'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:03.354816 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fba609-3f1b-40bc-a970-dad8d016c41b admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ec06cbf3f34633b9b45d94321a35d0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:03.357275 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fba609-3f1b-40bc-a970-dad8d016c41b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:03.370690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f11e4977-88c7-42e7-be3e-0d311d7bf2f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc82e1dc0c5045bfa6262a01efd64987'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:03.399292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f11e4977-88c7-42e7-be3e-0d311d7bf2f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc82e1dc0c5045bfa6262a01efd64987'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:03.423541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 904/1807] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:02 2022] DELETE /identity/v3/users/fc82e1dc0c5045bfa6262a01efd64987 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:03.499017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c8fba609-3f1b-40bc-a970-dad8d016c41b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ec06cbf3f34633b9b45d94321a35d0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:03.501082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c8fba609-3f1b-40bc-a970-dad8d016c41b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ec06cbf3f34633b9b45d94321a35d0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:03.518731 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c8fba609-3f1b-40bc-a970-dad8d016c41b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ec06cbf3f34633b9b45d94321a35d0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:03.549801 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c8fba609-3f1b-40bc-a970-dad8d016c41b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ec06cbf3f34633b9b45d94321a35d0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:03.565901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c8fba609-3f1b-40bc-a970-dad8d016c41b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ec06cbf3f34633b9b45d94321a35d0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:03.579901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 904/1808] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:03 2022] DELETE /identity/v3/users/57ec06cbf3f34633b9b45d94321a35d0 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:03.584332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8198884-6e54-411b-b383-f35b0955e265 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:03.584718 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8198884-6e54-411b-b383-f35b0955e265 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:03.585072 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8198884-6e54-411b-b383-f35b0955e265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:03.619398 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-a8198884-6e54-411b-b383-f35b0955e265 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:03.622819 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a8198884-6e54-411b-b383-f35b0955e265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:03.716360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 905/1809] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:03.808895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fba609-3f1b-40bc-a970-dad8d016c41b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:03.808895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c8fba609-3f1b-40bc-a970-dad8d016c41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:03.945886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fba609-3f1b-40bc-a970-dad8d016c41b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:03.959240 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5daca1-45fb-4a02-90ca-1b30f6aadf1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:03.960398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5daca1-45fb-4a02-90ca-1b30f6aadf1d service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:03.967479 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5daca1-45fb-4a02-90ca-1b30f6aadf1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:03.968174 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5daca1-45fb-4a02-90ca-1b30f6aadf1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:03.980936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5daca1-45fb-4a02-90ca-1b30f6aadf1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:03.983865 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5daca1-45fb-4a02-90ca-1b30f6aadf1d service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:03.998434 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 905/1810] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:05.117195 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35742db0-933e-423a-a7eb-92ea6ddf1342 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:05.118140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35742db0-933e-423a-a7eb-92ea6ddf1342 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:05.118575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35742db0-933e-423a-a7eb-92ea6ddf1342 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:05.120155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 906/1811] 10.222.0.71 () {54 vars in 921 bytes} [Thu Sep 1 16:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:33:05.151657 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdbb94-75b3-44ba-be13-a6d1dc45d98a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:05.152635 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdbb94-75b3-44ba-be13-a6d1dc45d98a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:05.153060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdbb94-75b3-44ba-be13-a6d1dc45d98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:05.194453 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a3cdbb94-75b3-44ba-be13-a6d1dc45d98a None None] MFA Rules not processed for user `ed71d63cd24f4a6caf6ebba2c30d3608`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:05.196046 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a3cdbb94-75b3-44ba-be13-a6d1dc45d98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:05.198997 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea8105-4ea0-4360-92c3-ba79ada2194f None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:05.199554 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea8105-4ea0-4360-92c3-ba79ada2194f None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:05.200089 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea8105-4ea0-4360-92c3-ba79ada2194f None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:05.201831 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 907/1812] 10.222.0.71 () {54 vars in 921 bytes} [Thu Sep 1 16:33:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:33:05.311244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd38a58-d18a-427d-a60c-9aaa375f5950 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:05.311660 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd38a58-d18a-427d-a60c-9aaa375f5950 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:05.312054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd38a58-d18a-427d-a60c-9aaa375f5950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:05.331364 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:05.393991 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-1bd38a58-d18a-427d-a60c-9aaa375f5950 None None] MFA Rules not processed for user `ed71d63cd24f4a6caf6ebba2c30d3608`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:05.395524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1bd38a58-d18a-427d-a60c-9aaa375f5950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:05.470291 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 906/1813] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Sep 1 16:33:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:05.497240 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdbb94-75b3-44ba-be13-a6d1dc45d98a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:05.498963 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a3cdbb94-75b3-44ba-be13-a6d1dc45d98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:05.530665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdbb94-75b3-44ba-be13-a6d1dc45d98a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:05.557434 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8fe6a-4682-4b60-b56c-46731c8d1783 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:05.564304 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8fe6a-4682-4b60-b56c-46731c8d1783 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:05.565112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8fe6a-4682-4b60-b56c-46731c8d1783 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:05.565544 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8fe6a-4682-4b60-b56c-46731c8d1783 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:05.574816 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:05.615590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8fe6a-4682-4b60-b56c-46731c8d1783 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:05.624885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8fe6a-4682-4b60-b56c-46731c8d1783 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:05.645058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 908/1814] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Sep 1 16:33:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:05.661344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 907/1815] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:05.731679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd38a58-d18a-427d-a60c-9aaa375f5950 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:05.733242 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1bd38a58-d18a-427d-a60c-9aaa375f5950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:05.760537 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd38a58-d18a-427d-a60c-9aaa375f5950 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:05.773635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0ac68-82ae-43ae-ac88-1bf3604f562c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:05.774293 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0ac68-82ae-43ae-ac88-1bf3604f562c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:05.774575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0ac68-82ae-43ae-ac88-1bf3604f562c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:05.774876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0ac68-82ae-43ae-ac88-1bf3604f562c admin admin] PATH_INFO: `/v3/users/549e585973bc4f8aa4e8b3ee227dacde` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:05.779617 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0ac68-82ae-43ae-ac88-1bf3604f562c admin admin] RBAC: Authorizing `identity:delete_user(user_id=549e585973bc4f8aa4e8b3ee227dacde)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:05.781659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0ac68-82ae-43ae-ac88-1bf3604f562c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:05.873286 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-17c0ac68-82ae-43ae-ac88-1bf3604f562c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549e585973bc4f8aa4e8b3ee227dacde'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:05.874036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-17c0ac68-82ae-43ae-ac88-1bf3604f562c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549e585973bc4f8aa4e8b3ee227dacde'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:05.889744 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-17c0ac68-82ae-43ae-ac88-1bf3604f562c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549e585973bc4f8aa4e8b3ee227dacde'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:05.900651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-17c0ac68-82ae-43ae-ac88-1bf3604f562c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549e585973bc4f8aa4e8b3ee227dacde'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:05.924944 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-17c0ac68-82ae-43ae-ac88-1bf3604f562c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549e585973bc4f8aa4e8b3ee227dacde'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:05.936647 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 909/1816] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:05 2022] DELETE /identity/v3/users/549e585973bc4f8aa4e8b3ee227dacde => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:05.942727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35008999-b464-4718-97ed-2829e86fb79a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:05.943174 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35008999-b464-4718-97ed-2829e86fb79a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:05.943566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35008999-b464-4718-97ed-2829e86fb79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:05.980760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-35008999-b464-4718-97ed-2829e86fb79a None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:05.981934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-35008999-b464-4718-97ed-2829e86fb79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:06.136031 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 908/1817] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:06.183120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0ac68-82ae-43ae-ac88-1bf3604f562c admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:06.184623 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-17c0ac68-82ae-43ae-ac88-1bf3604f562c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:06.287929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0ac68-82ae-43ae-ac88-1bf3604f562c admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:06.313296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75089b87-d2f4-46be-916d-42f2f9590eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:06.314448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089b87-d2f4-46be-916d-42f2f9590eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:06.315055 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089b87-d2f4-46be-916d-42f2f9590eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:06.315743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089b87-d2f4-46be-916d-42f2f9590eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:06.334705 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75089b87-d2f4-46be-916d-42f2f9590eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:06.339395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75089b87-d2f4-46be-916d-42f2f9590eb1 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:06.352299 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35008999-b464-4718-97ed-2829e86fb79a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:06.354898 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-35008999-b464-4718-97ed-2829e86fb79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:06.381850 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35008999-b464-4718-97ed-2829e86fb79a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:06.390581 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 910/1818] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:06.400672 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:06.403383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:06.405073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:06.406469 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d admin admin] PATH_INFO: `/v3/projects/186ab45a41f04afda643f0842a6dcf6f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:06.410446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d admin admin] RBAC: Authorizing `identity:delete_project(project_id=186ab45a41f04afda643f0842a6dcf6f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:06.414480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75089b87-d2f4-46be-916d-42f2f9590eb1 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:06.417347 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-75089b87-d2f4-46be-916d-42f2f9590eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:06.427189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:06.457353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75089b87-d2f4-46be-916d-42f2f9590eb1 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:06.481923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:06.482915 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:06.483333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:06.483735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182 admin admin] PATH_INFO: `/v3/projects/1450e9c2ec234709873418d43d299493` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:06.487242 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1450e9c2ec234709873418d43d299493)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:06.493712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:06.511261 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:06.574297 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '186ab45a41f04afda643f0842a6dcf6f', 'request_id': 'req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:06.591971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '186ab45a41f04afda643f0842a6dcf6f', 'request_id': 'req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:06.611261 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '186ab45a41f04afda643f0842a6dcf6f', 'request_id': 'req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:06.622671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1450e9c2ec234709873418d43d299493', 'request_id': 'req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:06.636090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d admin admin] The token cache is being invalidate because project 186ab45a41f04afda643f0842a6dcf6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:06.636749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:06.638156 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:06.642066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1450e9c2ec234709873418d43d299493', 'request_id': 'req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:06.647944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 909/1819] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:06 2022] DELETE /identity/v3/projects/186ab45a41f04afda643f0842a6dcf6f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:06.649369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:06.655629 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:06.659888 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1450e9c2ec234709873418d43d299493', 'request_id': 'req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:06.704701 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182 admin admin] The token cache is being invalidate because project 1450e9c2ec234709873418d43d299493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:06.710017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:06.713008 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:06.715576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 911/1820] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:06 2022] DELETE /identity/v3/projects/1450e9c2ec234709873418d43d299493 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:06.716726 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:06.718712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:06.852412 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f3ddd-224e-48e8-a3b9-cc042e1c265d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:06.877446 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9baa5c1-3c79-4da6-90ae-91ab5ac05182 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:06.885785 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634a07f-5f4f-4786-8b49-e4564cd822d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:06.886644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634a07f-5f4f-4786-8b49-e4564cd822d3 service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:06.887394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634a07f-5f4f-4786-8b49-e4564cd822d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:06.887394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634a07f-5f4f-4786-8b49-e4564cd822d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:06.890140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-8634a07f-5f4f-4786-8b49-e4564cd822d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:06.904608 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:06.907598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634a07f-5f4f-4786-8b49-e4564cd822d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:06.909751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634a07f-5f4f-4786-8b49-e4564cd822d3 service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:06.932311 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 912/1821] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:06.934834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42be1b-eb7d-45e7-9c3c-df1b5e6ce5d1 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:06.935503 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42be1b-eb7d-45e7-9c3c-df1b5e6ce5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:06.935946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42be1b-eb7d-45e7-9c3c-df1b5e6ce5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:06.962223 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-0d42be1b-eb7d-45e7-9c3c-df1b5e6ce5d1 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:06.964097 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0d42be1b-eb7d-45e7-9c3c-df1b5e6ce5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:06.990760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2018ed5-1587-41c1-b485-e660cef2b794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:06.998113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2018ed5-1587-41c1-b485-e660cef2b794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:06.998113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2018ed5-1587-41c1-b485-e660cef2b794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:06.998113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2018ed5-1587-41c1-b485-e660cef2b794 admin admin] PATH_INFO: `/v3/users/edb2c21819284d80893d2e38be53077b` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:07.003622 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2018ed5-1587-41c1-b485-e660cef2b794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edb2c21819284d80893d2e38be53077b)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:07.006887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2018ed5-1587-41c1-b485-e660cef2b794 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:07.117562 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f2018ed5-1587-41c1-b485-e660cef2b794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edb2c21819284d80893d2e38be53077b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:07.117981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f2018ed5-1587-41c1-b485-e660cef2b794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edb2c21819284d80893d2e38be53077b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:07.134010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f2018ed5-1587-41c1-b485-e660cef2b794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edb2c21819284d80893d2e38be53077b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:07.168686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f2018ed5-1587-41c1-b485-e660cef2b794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edb2c21819284d80893d2e38be53077b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:07.179771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f2018ed5-1587-41c1-b485-e660cef2b794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edb2c21819284d80893d2e38be53077b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:07.194048 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 913/1822] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:07.194048 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fbe74-7902-418a-b04c-2ca618d9b5ac None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:07.194048 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fbe74-7902-418a-b04c-2ca618d9b5ac None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:07.194804 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fbe74-7902-418a-b04c-2ca618d9b5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:07.200277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 910/1823] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:06 2022] DELETE /identity/v3/users/edb2c21819284d80893d2e38be53077b => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:07.201581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393f679-c588-4d00-8fdd-1676ec0382cd None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:07.201928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393f679-c588-4d00-8fdd-1676ec0382cd None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:07.202132 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393f679-c588-4d00-8fdd-1676ec0382cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:07.247747 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-3393f679-c588-4d00-8fdd-1676ec0382cd None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:07.249004 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3393f679-c588-4d00-8fdd-1676ec0382cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:07.285703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-d69fbe74-7902-418a-b04c-2ca618d9b5ac None None] MFA Rules not processed for user `4f1b6090ae504b41b06e5bc5d7911a92`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:07.294788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d69fbe74-7902-418a-b04c-2ca618d9b5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:07.323340 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:07.409394 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 911/1824] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:07.414432 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393f679-c588-4d00-8fdd-1676ec0382cd None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:07.438314 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393f679-c588-4d00-8fdd-1676ec0382cd None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:07.458388 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae28f58-6abd-4a5a-b098-bbdd84d2da05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:07.458889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae28f58-6abd-4a5a-b098-bbdd84d2da05 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:07.458997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae28f58-6abd-4a5a-b098-bbdd84d2da05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:07.459256 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae28f58-6abd-4a5a-b098-bbdd84d2da05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:07.459920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae28f58-6abd-4a5a-b098-bbdd84d2da05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:07.460222 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae28f58-6abd-4a5a-b098-bbdd84d2da05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:07.462185 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae28f58-6abd-4a5a-b098-bbdd84d2da05 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:07.497573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 912/1825] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:33:07.501798 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae28f58-6abd-4a5a-b098-bbdd84d2da05 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:07.526480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae28f58-6abd-4a5a-b098-bbdd84d2da05 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:07.532427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43910b-eab9-4689-9d63-60dde06ab286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:07.533117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43910b-eab9-4689-9d63-60dde06ab286 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:07.533477 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43910b-eab9-4689-9d63-60dde06ab286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:07.533902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43910b-eab9-4689-9d63-60dde06ab286 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:07.535267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43910b-eab9-4689-9d63-60dde06ab286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:07.537392 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43910b-eab9-4689-9d63-60dde06ab286 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:07.594727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 914/1826] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:07 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:07.639250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 913/1827] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:07 2022] POST /identity/v3/projects => generated 369 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:07.642994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fbe74-7902-418a-b04c-2ca618d9b5ac None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:07.664423 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fbe74-7902-418a-b04c-2ca618d9b5ac None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:07.921635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d96afa-38a5-4105-83ac-f7e3251dc5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:07.922265 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d96afa-38a5-4105-83ac-f7e3251dc5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:07.922724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d96afa-38a5-4105-83ac-f7e3251dc5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:07.922859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d96afa-38a5-4105-83ac-f7e3251dc5e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:07.928202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d96afa-38a5-4105-83ac-f7e3251dc5e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:07.930288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d96afa-38a5-4105-83ac-f7e3251dc5e3 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:07.984537 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 915/1828] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:07 2022] POST /identity/v3/users => generated 285 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:33:07.985767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43910b-eab9-4689-9d63-60dde06ab286 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:08.000707 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43910b-eab9-4689-9d63-60dde06ab286 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:08.015613 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102aefa-6e46-44e6-abf7-72671143d3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:08.016608 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102aefa-6e46-44e6-abf7-72671143d3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:08.016750 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102aefa-6e46-44e6-abf7-72671143d3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:08.017132 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102aefa-6e46-44e6-abf7-72671143d3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:08.019536 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102aefa-6e46-44e6-abf7-72671143d3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:08.023625 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102aefa-6e46-44e6-abf7-72671143d3d1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:08.028024 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:08.055143 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 914/1829] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:08.055484 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d96afa-38a5-4105-83ac-f7e3251dc5e3 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:08.100204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d96afa-38a5-4105-83ac-f7e3251dc5e3 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:08.111123 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac3816-1d38-4843-ad7b-a356215a154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:08.112139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac3816-1d38-4843-ad7b-a356215a154e admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:08.112433 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac3816-1d38-4843-ad7b-a356215a154e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:08.112857 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac3816-1d38-4843-ad7b-a356215a154e admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:08.113660 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac3816-1d38-4843-ad7b-a356215a154e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:08.115896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac3816-1d38-4843-ad7b-a356215a154e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:08.164448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 916/1830] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:08.168408 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102aefa-6e46-44e6-abf7-72671143d3d1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:08.182953 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102aefa-6e46-44e6-abf7-72671143d3d1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:08.205062 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4b35b-60f4-4741-b2d3-82e1f6a3dbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:08.205745 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4b35b-60f4-4741-b2d3-82e1f6a3dbbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:08.206042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4b35b-60f4-4741-b2d3-82e1f6a3dbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:08.206304 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4b35b-60f4-4741-b2d3-82e1f6a3dbbc admin admin] PATH_INFO: `/v3/projects/ac362025f7c040b4a18a214f88aa7dc0/users/5edc1db90e844ccdbd0776276255f755/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:08.287996 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4b35b-60f4-4741-b2d3-82e1f6a3dbbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac362025f7c040b4a18a214f88aa7dc0, user_id=5edc1db90e844ccdbd0776276255f755, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:08.297792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4b35b-60f4-4741-b2d3-82e1f6a3dbbc admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:08.343138 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 915/1831] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:08 2022] PUT /identity/v3/projects/ac362025f7c040b4a18a214f88aa7dc0/users/5edc1db90e844ccdbd0776276255f755/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:08.356817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9603e-c318-48e8-be79-dd839dfd44da None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:08.357310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9603e-c318-48e8-be79-dd839dfd44da None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:08.357392 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9603e-c318-48e8-be79-dd839dfd44da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:08.436866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-79b9603e-c318-48e8-be79-dd839dfd44da None None] MFA Rules not processed for user `5edc1db90e844ccdbd0776276255f755`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:08.442378 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-79b9603e-c318-48e8-be79-dd839dfd44da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:08.568750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 917/1832] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:08.575821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4b35b-60f4-4741-b2d3-82e1f6a3dbbc admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:08.742970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9603e-c318-48e8-be79-dd839dfd44da None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:08.746662 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-79b9603e-c318-48e8-be79-dd839dfd44da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:08.780551 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:08.885930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4b35b-60f4-4741-b2d3-82e1f6a3dbbc admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:08.903886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee86a49-1562-4e97-9cfa-edf1dc402603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:08.904523 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86a49-1562-4e97-9cfa-edf1dc402603 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:08.904803 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86a49-1562-4e97-9cfa-edf1dc402603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:08.905079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86a49-1562-4e97-9cfa-edf1dc402603 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:08.905728 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee86a49-1562-4e97-9cfa-edf1dc402603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:08.917226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee86a49-1562-4e97-9cfa-edf1dc402603 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:08.994925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 916/1833] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:08 2022] POST /identity/v3/projects => generated 367 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:08.994925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee86a49-1562-4e97-9cfa-edf1dc402603 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:08.997718 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4ee86a49-1562-4e97-9cfa-edf1dc402603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:09.032084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9603e-c318-48e8-be79-dd839dfd44da None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:09.195043 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:09.195815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:09.196192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:09.196561 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1 admin admin] PATH_INFO: `/v3/projects/e77c6bdca36743eca66a4e8fd3dc77a1` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:09.197835 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee86a49-1562-4e97-9cfa-edf1dc402603 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:09.197973 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e77c6bdca36743eca66a4e8fd3dc77a1)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:09.203616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:09.206929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedbfb4-e590-444a-8548-f1339b97008e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:09.207685 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedbfb4-e590-444a-8548-f1339b97008e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:09.207970 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedbfb4-e590-444a-8548-f1339b97008e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:09.208245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedbfb4-e590-444a-8548-f1339b97008e admin admin] PATH_INFO: `/v3/projects/ae5fe29878e44491902c653049118ea7` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:09.216430 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedbfb4-e590-444a-8548-f1339b97008e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae5fe29878e44491902c653049118ea7)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:09.218763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedbfb4-e590-444a-8548-f1339b97008e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:09.329905 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e77c6bdca36743eca66a4e8fd3dc77a1', 'request_id': 'req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:09.338102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1fedbfb4-e590-444a-8548-f1339b97008e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae5fe29878e44491902c653049118ea7', 'request_id': 'req-1fedbfb4-e590-444a-8548-f1339b97008e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:09.348578 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1fedbfb4-e590-444a-8548-f1339b97008e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae5fe29878e44491902c653049118ea7', 'request_id': 'req-1fedbfb4-e590-444a-8548-f1339b97008e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:09.350042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e77c6bdca36743eca66a4e8fd3dc77a1', 'request_id': 'req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:09.355703 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:09.357306 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1fedbfb4-e590-444a-8548-f1339b97008e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae5fe29878e44491902c653049118ea7', 'request_id': 'req-1fedbfb4-e590-444a-8548-f1339b97008e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:09.370288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e77c6bdca36743eca66a4e8fd3dc77a1', 'request_id': 'req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:09.383473 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1fedbfb4-e590-444a-8548-f1339b97008e admin admin] The token cache is being invalidate because project ae5fe29878e44491902c653049118ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:09.383767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1fedbfb4-e590-444a-8548-f1339b97008e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:09.388549 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1fedbfb4-e590-444a-8548-f1339b97008e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:09.392166 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 917/1834] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:08 2022] DELETE /identity/v3/projects/ae5fe29878e44491902c653049118ea7 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:09.393071 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedbfb4-e590-444a-8548-f1339b97008e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:09.395102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1fedbfb4-e590-444a-8548-f1339b97008e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:09.397044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1 admin admin] The token cache is being invalidate because project e77c6bdca36743eca66a4e8fd3dc77a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:09.399205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:09.402477 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:09.404383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 918/1835] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:08 2022] DELETE /identity/v3/projects/e77c6bdca36743eca66a4e8fd3dc77a1 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:09.405269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:09.409988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:09.467899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:09.492479 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1e98b-39d8-4a8c-beae-2a93d4037fd1 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:09.535617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedbfb4-e590-444a-8548-f1339b97008e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:09.546148 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483adc4-d953-468e-bd93-e6fb958b2f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:09.546906 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483adc4-d953-468e-bd93-e6fb958b2f37 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:09.547254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483adc4-d953-468e-bd93-e6fb958b2f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:09.547603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483adc4-d953-468e-bd93-e6fb958b2f37 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:09.548331 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483adc4-d953-468e-bd93-e6fb958b2f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:09.550933 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483adc4-d953-468e-bd93-e6fb958b2f37 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:09.593830 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 918/1836] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:09 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:09.595846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38535ed-8290-4f20-9204-693eb7bce64d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:09.596229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38535ed-8290-4f20-9204-693eb7bce64d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:09.596537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38535ed-8290-4f20-9204-693eb7bce64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:09.621870 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b38535ed-8290-4f20-9204-693eb7bce64d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:09.624031 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b38535ed-8290-4f20-9204-693eb7bce64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:09.642062 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 919/1837] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:09.642062 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38535ed-8290-4f20-9204-693eb7bce64d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:09.642062 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b38535ed-8290-4f20-9204-693eb7bce64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:09.653547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0c8af-629a-4f0c-9449-e740dffc0da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:09.654201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0c8af-629a-4f0c-9449-e740dffc0da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:09.654483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0c8af-629a-4f0c-9449-e740dffc0da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:09.654791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0c8af-629a-4f0c-9449-e740dffc0da3 admin admin] PATH_INFO: `/v3/users/97e00c3cb5fa445d8f43ddc26938b8a9` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:09.656473 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0c8af-629a-4f0c-9449-e740dffc0da3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e00c3cb5fa445d8f43ddc26938b8a9)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:09.657597 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38535ed-8290-4f20-9204-693eb7bce64d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:09.658539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0c8af-629a-4f0c-9449-e740dffc0da3 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:09.663433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3427968-a02d-41d5-9747-315ba87a73a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:09.664259 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3427968-a02d-41d5-9747-315ba87a73a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:09.664612 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3427968-a02d-41d5-9747-315ba87a73a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:09.664993 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3427968-a02d-41d5-9747-315ba87a73a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:09.665914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3427968-a02d-41d5-9747-315ba87a73a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:09.667624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3427968-a02d-41d5-9747-315ba87a73a6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:09.682338 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 920/1838] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:09.684934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f8e47-47fd-4fe2-a6b5-4d0ccd026f63 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:09.685578 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f8e47-47fd-4fe2-a6b5-4d0ccd026f63 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:09.686029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f8e47-47fd-4fe2-a6b5-4d0ccd026f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:09.721335 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-764f8e47-47fd-4fe2-a6b5-4d0ccd026f63 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:09.722550 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-764f8e47-47fd-4fe2-a6b5-4d0ccd026f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:09.736624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 921/1839] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:09.738431 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f8e47-47fd-4fe2-a6b5-4d0ccd026f63 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:09.756091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-19c0c8af-629a-4f0c-9449-e740dffc0da3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e00c3cb5fa445d8f43ddc26938b8a9'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:09.756958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-19c0c8af-629a-4f0c-9449-e740dffc0da3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e00c3cb5fa445d8f43ddc26938b8a9'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:09.770666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f8e47-47fd-4fe2-a6b5-4d0ccd026f63 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:09.783739 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50bfb7-770f-4062-9f93-908fca5a09d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:09.784676 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50bfb7-770f-4062-9f93-908fca5a09d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:09.785111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50bfb7-770f-4062-9f93-908fca5a09d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:09.785527 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50bfb7-770f-4062-9f93-908fca5a09d0 admin admin] PATH_INFO: `/v3/projects/526f111cab354e609b10ea5e0be184b5/users/09d4c416219841569cb50bdb03613d4f/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:09.786164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-19c0c8af-629a-4f0c-9449-e740dffc0da3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e00c3cb5fa445d8f43ddc26938b8a9'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:09.798175 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-19c0c8af-629a-4f0c-9449-e740dffc0da3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e00c3cb5fa445d8f43ddc26938b8a9'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:09.806498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50bfb7-770f-4062-9f93-908fca5a09d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=526f111cab354e609b10ea5e0be184b5, user_id=09d4c416219841569cb50bdb03613d4f, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:09.809575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50bfb7-770f-4062-9f93-908fca5a09d0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:09.820631 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-19c0c8af-629a-4f0c-9449-e740dffc0da3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e00c3cb5fa445d8f43ddc26938b8a9'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:09.829373 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 922/1840] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:09 2022] PUT /identity/v3/projects/526f111cab354e609b10ea5e0be184b5/users/09d4c416219841569cb50bdb03613d4f/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:09.829373 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50bfb7-770f-4062-9f93-908fca5a09d0 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:09.831425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fc50bfb7-770f-4062-9f93-908fca5a09d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:09.848264 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 919/1841] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:09 2022] DELETE /identity/v3/users/97e00c3cb5fa445d8f43ddc26938b8a9 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:09.848264 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0c8af-629a-4f0c-9449-e740dffc0da3 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:09.850365 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-19c0c8af-629a-4f0c-9449-e740dffc0da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:09.933504 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50bfb7-770f-4062-9f93-908fca5a09d0 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:10.006388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0c8af-629a-4f0c-9449-e740dffc0da3 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:10.014552 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:10.020202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd44c0d-2603-497a-b303-a16e9ebce0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:10.020978 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd44c0d-2603-497a-b303-a16e9ebce0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.021265 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd44c0d-2603-497a-b303-a16e9ebce0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.022714 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd44c0d-2603-497a-b303-a16e9ebce0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.023702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd44c0d-2603-497a-b303-a16e9ebce0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:10.028157 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd44c0d-2603-497a-b303-a16e9ebce0f2 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:10.055221 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 920/1842] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:10.057702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fe01d-fb2a-40ed-b1d8-19cf30c4cd5a None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.058155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fe01d-fb2a-40ed-b1d8-19cf30c4cd5a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.058522 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fe01d-fb2a-40ed-b1d8-19cf30c4cd5a None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.060683 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 921/1843] 10.222.0.71 () {54 vars in 921 bytes} [Thu Sep 1 16:33:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:33:10.061643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fe01d-fb2a-40ed-b1d8-19cf30c4cd5a None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:10.078878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9275456-4e53-4996-ad1b-6ef086255a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:10.079649 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9275456-4e53-4996-ad1b-6ef086255a5e admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.080664 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9275456-4e53-4996-ad1b-6ef086255a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.080980 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9275456-4e53-4996-ad1b-6ef086255a5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.081754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9275456-4e53-4996-ad1b-6ef086255a5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:10.082083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9275456-4e53-4996-ad1b-6ef086255a5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:10.084137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fe01d-fb2a-40ed-b1d8-19cf30c4cd5a None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:10.085238 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9275456-4e53-4996-ad1b-6ef086255a5e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:10.091460 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df1438-c5fa-4930-be61-d2ed4ac52258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:10.092162 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df1438-c5fa-4930-be61-d2ed4ac52258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.092477 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df1438-c5fa-4930-be61-d2ed4ac52258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.092722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df1438-c5fa-4930-be61-d2ed4ac52258 admin admin] PATH_INFO: `/v3/projects/526f111cab354e609b10ea5e0be184b5/users/09d4c416219841569cb50bdb03613d4f/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.097011 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df1438-c5fa-4930-be61-d2ed4ac52258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=526f111cab354e609b10ea5e0be184b5, user_id=09d4c416219841569cb50bdb03613d4f, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:10.101444 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df1438-c5fa-4930-be61-d2ed4ac52258 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:10.112448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:10.116878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 923/1844] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:33:10.118318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57596a5e-aa4a-4025-a9d9-9ef65b07ec18 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.118607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57596a5e-aa4a-4025-a9d9-9ef65b07ec18 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.118940 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57596a5e-aa4a-4025-a9d9-9ef65b07ec18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.123839 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 922/1845] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:10 2022] PUT /identity/v3/projects/526f111cab354e609b10ea5e0be184b5/users/09d4c416219841569cb50bdb03613d4f/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:10.136775 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df1438-c5fa-4930-be61-d2ed4ac52258 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:10.164791 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-57596a5e-aa4a-4025-a9d9-9ef65b07ec18 None None] MFA Rules not processed for user `dae8db0856ed44088f0bd3cb93701de0`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:10.172498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-57596a5e-aa4a-4025-a9d9-9ef65b07ec18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:10.238404 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df1438-c5fa-4930-be61-d2ed4ac52258 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:10.246204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e226f4f-23ca-4a5e-b8f3-fa141c330203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:10.246856 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e226f4f-23ca-4a5e-b8f3-fa141c330203 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.247139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e226f4f-23ca-4a5e-b8f3-fa141c330203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.247411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e226f4f-23ca-4a5e-b8f3-fa141c330203 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.248525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e226f4f-23ca-4a5e-b8f3-fa141c330203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:10.251610 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e226f4f-23ca-4a5e-b8f3-fa141c330203 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:10.296432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 923/1846] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:10 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:10.297913 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9056cb-4892-44bb-beb4-4fd901ce3e5b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.298198 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9056cb-4892-44bb-beb4-4fd901ce3e5b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.298526 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9056cb-4892-44bb-beb4-4fd901ce3e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.319712 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 924/1847] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Sep 1 16:33:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:10.320712 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57596a5e-aa4a-4025-a9d9-9ef65b07ec18 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:10.332045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57596a5e-aa4a-4025-a9d9-9ef65b07ec18 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:10.336715 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-6b9056cb-4892-44bb-beb4-4fd901ce3e5b None None] MFA Rules not processed for user `09d4c416219841569cb50bdb03613d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:10.339275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6b9056cb-4892-44bb-beb4-4fd901ce3e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:10.412781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052486f-5361-4449-a872-348f79cee38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:10.414228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052486f-5361-4449-a872-348f79cee38f admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.417769 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052486f-5361-4449-a872-348f79cee38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.418166 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052486f-5361-4449-a872-348f79cee38f admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.419474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052486f-5361-4449-a872-348f79cee38f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:10.422340 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052486f-5361-4449-a872-348f79cee38f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:10.461996 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 925/1848] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:10 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:10.466752 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06628a7-d42b-42e1-a9cb-a81b139c3502 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.467084 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06628a7-d42b-42e1-a9cb-a81b139c3502 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.467369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06628a7-d42b-42e1-a9cb-a81b139c3502 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.469768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 926/1849] 10.222.0.71 () {54 vars in 961 bytes} [Thu Sep 1 16:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:33:10.470760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06628a7-d42b-42e1-a9cb-a81b139c3502 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:10.488683 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 924/1850] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:10.491184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d3c8b-a939-45f7-8972-5cc0f8801f5c None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.491714 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d3c8b-a939-45f7-8972-5cc0f8801f5c None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.492232 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d3c8b-a939-45f7-8972-5cc0f8801f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.502991 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06628a7-d42b-42e1-a9cb-a81b139c3502 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:10.512290 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00009f34-f635-4c26-98e4-548be826b2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:10.513389 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00009f34-f635-4c26-98e4-548be826b2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.513763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00009f34-f635-4c26-98e4-548be826b2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.514113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00009f34-f635-4c26-98e4-548be826b2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.518686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00009f34-f635-4c26-98e4-548be826b2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:10.518850 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00009f34-f635-4c26-98e4-548be826b2f0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:10.523544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-cc4d3c8b-a939-45f7-8972-5cc0f8801f5c None None] MFA Rules not processed for user `dae8db0856ed44088f0bd3cb93701de0`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:10.528259 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-cc4d3c8b-a939-45f7-8972-5cc0f8801f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:10.538079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 927/1851] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:10.538920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00009f34-f635-4c26-98e4-548be826b2f0 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:10.542387 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-00009f34-f635-4c26-98e4-548be826b2f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:10.621318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:10.629212 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00009f34-f635-4c26-98e4-548be826b2f0 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:10.643035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50ea69-13eb-4d9c-a271-d2ce98ee9b96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:10.643680 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ea69-13eb-4d9c-a271-d2ce98ee9b96 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.644115 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ea69-13eb-4d9c-a271-d2ce98ee9b96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.644222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 925/1852] 10.222.0.71 () {58 vars in 1058 bytes} [Thu Sep 1 16:33:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:10.644300 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ea69-13eb-4d9c-a271-d2ce98ee9b96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.645128 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d3c8b-a939-45f7-8972-5cc0f8801f5c None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:10.655830 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d3c8b-a939-45f7-8972-5cc0f8801f5c None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:10.656526 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50ea69-13eb-4d9c-a271-d2ce98ee9b96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:10.657967 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50ea69-13eb-4d9c-a271-d2ce98ee9b96 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:10.660649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1b3f8-f4f0-4be7-9f0b-abe0958d8740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:10.661264 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1b3f8-f4f0-4be7-9f0b-abe0958d8740 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.661544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1b3f8-f4f0-4be7-9f0b-abe0958d8740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.661819 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1b3f8-f4f0-4be7-9f0b-abe0958d8740 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.662459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1b3f8-f4f0-4be7-9f0b-abe0958d8740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:10.664529 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1b3f8-f4f0-4be7-9f0b-abe0958d8740 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:10.666266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:10.674195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 928/1853] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:10.675170 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50ea69-13eb-4d9c-a271-d2ce98ee9b96 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:10.678673 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ee50ea69-13eb-4d9c-a271-d2ce98ee9b96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:10.687355 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 926/1854] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:10.688137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1b3f8-f4f0-4be7-9f0b-abe0958d8740 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:10.701264 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50ea69-13eb-4d9c-a271-d2ce98ee9b96 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:10.706577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1b3f8-f4f0-4be7-9f0b-abe0958d8740 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:10.709797 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf712d3-206d-4461-b020-0220634ad66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:10.711918 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf712d3-206d-4461-b020-0220634ad66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.712371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf712d3-206d-4461-b020-0220634ad66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.713087 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf712d3-206d-4461-b020-0220634ad66c admin admin] PATH_INFO: `/v3/projects/7c487ba33b6046af8318f8b6c7b1aa2f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.715981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf712d3-206d-4461-b020-0220634ad66c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c487ba33b6046af8318f8b6c7b1aa2f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:10.718214 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf712d3-206d-4461-b020-0220634ad66c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:10.718594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8571790-0977-4d3f-8482-80082ab9dcb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae8db0856ed44088f0bd3cb93701de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:10.719724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8571790-0977-4d3f-8482-80082ab9dcb0 service placement] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.720083 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8571790-0977-4d3f-8482-80082ab9dcb0 service placement] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.720458 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8571790-0977-4d3f-8482-80082ab9dcb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.731073 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8571790-0977-4d3f-8482-80082ab9dcb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:10.733015 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8571790-0977-4d3f-8482-80082ab9dcb0 service placement] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:10.747843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 927/1855] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:10.748744 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8571790-0977-4d3f-8482-80082ab9dcb0 service placement] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:10.766430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8571790-0977-4d3f-8482-80082ab9dcb0 service placement] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:10.782806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bc008-c939-41b6-8075-78a933c005a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:10.784552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bc008-c939-41b6-8075-78a933c005a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.785289 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bc008-c939-41b6-8075-78a933c005a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.785289 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bc008-c939-41b6-8075-78a933c005a0 admin admin] PATH_INFO: `/v3/projects/cd611cd01df74fc39f2c50265e0d25fc/users/2b3823171bdd4b3b8275786f09215f90/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.803075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ddf712d3-206d-4461-b020-0220634ad66c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c487ba33b6046af8318f8b6c7b1aa2f', 'request_id': 'req-ddf712d3-206d-4461-b020-0220634ad66c'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:10.812351 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ddf712d3-206d-4461-b020-0220634ad66c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c487ba33b6046af8318f8b6c7b1aa2f', 'request_id': 'req-ddf712d3-206d-4461-b020-0220634ad66c'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:10.819246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bc008-c939-41b6-8075-78a933c005a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd611cd01df74fc39f2c50265e0d25fc, user_id=2b3823171bdd4b3b8275786f09215f90, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:10.822332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bc008-c939-41b6-8075-78a933c005a0 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:10.827436 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ddf712d3-206d-4461-b020-0220634ad66c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c487ba33b6046af8318f8b6c7b1aa2f', 'request_id': 'req-ddf712d3-206d-4461-b020-0220634ad66c'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:10.849896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 928/1856] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:10 2022] PUT /identity/v3/projects/cd611cd01df74fc39f2c50265e0d25fc/users/2b3823171bdd4b3b8275786f09215f90/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:10.852410 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ddf712d3-206d-4461-b020-0220634ad66c admin admin] The token cache is being invalidate because project 7c487ba33b6046af8318f8b6c7b1aa2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:10.853617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ddf712d3-206d-4461-b020-0220634ad66c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:10.855063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ddf712d3-206d-4461-b020-0220634ad66c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:10.861684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bc008-c939-41b6-8075-78a933c005a0 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:10.861936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 929/1857] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:10 2022] DELETE /identity/v3/projects/7c487ba33b6046af8318f8b6c7b1aa2f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:10.863698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ad912-c18f-4fe9-8094-3fe4eb5d8bd3 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.864024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6d1bc008-c939-41b6-8075-78a933c005a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:10.864156 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ad912-c18f-4fe9-8094-3fe4eb5d8bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.864570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ad912-c18f-4fe9-8094-3fe4eb5d8bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.928179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-469ad912-c18f-4fe9-8094-3fe4eb5d8bd3 None None] MFA Rules not processed for user `2b3823171bdd4b3b8275786f09215f90`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:10.929630 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-469ad912-c18f-4fe9-8094-3fe4eb5d8bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:10.961164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bc008-c939-41b6-8075-78a933c005a0 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:10.967342 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625681b-74ad-45c8-8005-b66273298486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:10.968052 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625681b-74ad-45c8-8005-b66273298486 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:10.968426 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625681b-74ad-45c8-8005-b66273298486 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:10.968772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625681b-74ad-45c8-8005-b66273298486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:10.970709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1625681b-74ad-45c8-8005-b66273298486 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:11.009741 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 930/1858] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:11.010880 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ad912-c18f-4fe9-8094-3fe4eb5d8bd3 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:11.014441 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-469ad912-c18f-4fe9-8094-3fe4eb5d8bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:11.049021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625681b-74ad-45c8-8005-b66273298486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:11.050550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625681b-74ad-45c8-8005-b66273298486 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:11.059896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 929/1859] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:11.060700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625681b-74ad-45c8-8005-b66273298486 service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:11.062055 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1625681b-74ad-45c8-8005-b66273298486 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:11.101978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ad912-c18f-4fe9-8094-3fe4eb5d8bd3 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:11.107514 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65ad11-f628-4e04-8c62-e09375e24176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:11.108087 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65ad11-f628-4e04-8c62-e09375e24176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:11.108591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65ad11-f628-4e04-8c62-e09375e24176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:11.108930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65ad11-f628-4e04-8c62-e09375e24176 admin admin] PATH_INFO: `/v3/users/a68a733e29594964a8f1ccd0b6490071` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:11.110070 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65ad11-f628-4e04-8c62-e09375e24176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a68a733e29594964a8f1ccd0b6490071)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:11.112871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65ad11-f628-4e04-8c62-e09375e24176 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:11.115904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:11.151599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625681b-74ad-45c8-8005-b66273298486 service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:11.158136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a08b0-fd6c-4a97-b40e-d1e03880655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:11.159117 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a08b0-fd6c-4a97-b40e-d1e03880655a admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:11.160143 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a08b0-fd6c-4a97-b40e-d1e03880655a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:11.160470 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a08b0-fd6c-4a97-b40e-d1e03880655a admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:11.161152 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a08b0-fd6c-4a97-b40e-d1e03880655a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:11.163250 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a08b0-fd6c-4a97-b40e-d1e03880655a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:11.185518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:11.188081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fa65ad11-f628-4e04-8c62-e09375e24176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a68a733e29594964a8f1ccd0b6490071'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:11.189751 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fa65ad11-f628-4e04-8c62-e09375e24176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a68a733e29594964a8f1ccd0b6490071'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:11.199184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 930/1860] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:11 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:11.200033 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a08b0-fd6c-4a97-b40e-d1e03880655a admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:11.203223 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-184a08b0-fd6c-4a97-b40e-d1e03880655a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:11.208250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fa65ad11-f628-4e04-8c62-e09375e24176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a68a733e29594964a8f1ccd0b6490071'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:11.228856 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fa65ad11-f628-4e04-8c62-e09375e24176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a68a733e29594964a8f1ccd0b6490071'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:11.239224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fa65ad11-f628-4e04-8c62-e09375e24176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a68a733e29594964a8f1ccd0b6490071'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:11.246577 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 931/1861] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:11 2022] DELETE /identity/v3/users/a68a733e29594964a8f1ccd0b6490071 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:11.363117 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a08b0-fd6c-4a97-b40e-d1e03880655a admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:11.489849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d55b4-ea04-4065-bc1e-efd2e5958a19 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:11.490136 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d55b4-ea04-4065-bc1e-efd2e5958a19 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:11.490415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d55b4-ea04-4065-bc1e-efd2e5958a19 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:11.492053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 932/1862] 10.222.0.71 () {54 vars in 921 bytes} [Thu Sep 1 16:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:33:11.519237 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff71745-f647-49a9-ae0a-b37e32dca296 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:11.519879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff71745-f647-49a9-ae0a-b37e32dca296 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:11.520148 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff71745-f647-49a9-ae0a-b37e32dca296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:11.536727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a83be4-d73c-4f78-afe1-c295fb36a6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:11.537486 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a83be4-d73c-4f78-afe1-c295fb36a6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:11.537740 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a83be4-d73c-4f78-afe1-c295fb36a6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:11.538075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a83be4-d73c-4f78-afe1-c295fb36a6c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:11.538751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a83be4-d73c-4f78-afe1-c295fb36a6c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:11.540887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a83be4-d73c-4f78-afe1-c295fb36a6c6 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:11.546958 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-fff71745-f647-49a9-ae0a-b37e32dca296 None None] MFA Rules not processed for user `dae8db0856ed44088f0bd3cb93701de0`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:11.548340 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fff71745-f647-49a9-ae0a-b37e32dca296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:11.570462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 931/1863] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:11 2022] POST /identity/v3/users => generated 299 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:11.574434 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a83be4-d73c-4f78-afe1-c295fb36a6c6 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:11.592000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a83be4-d73c-4f78-afe1-c295fb36a6c6 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:11.597398 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b4801-6f9e-4003-9dce-bc633cce350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:11.598357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4801-6f9e-4003-9dce-bc633cce350c admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:11.599041 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4801-6f9e-4003-9dce-bc633cce350c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:11.599203 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4801-6f9e-4003-9dce-bc633cce350c admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:11.600111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b4801-6f9e-4003-9dce-bc633cce350c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:11.601637 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b4801-6f9e-4003-9dce-bc633cce350c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:11.636094 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 932/1864] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:11.636094 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b4801-6f9e-4003-9dce-bc633cce350c admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:11.636753 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f49b4801-6f9e-4003-9dce-bc633cce350c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:11.647923 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 933/1865] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Sep 1 16:33:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:11.648794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff71745-f647-49a9-ae0a-b37e32dca296 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:11.654494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b4801-6f9e-4003-9dce-bc633cce350c admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:11.660756 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff433d2-6e93-427b-afd7-cad592a41b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:11.661584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff433d2-6e93-427b-afd7-cad592a41b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:11.662126 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff433d2-6e93-427b-afd7-cad592a41b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:11.662226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff71745-f647-49a9-ae0a-b37e32dca296 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:11.662510 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff433d2-6e93-427b-afd7-cad592a41b9b admin admin] PATH_INFO: `/v3/users/ecc3f19588aa4093b59a25a8a978c97b` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:11.663959 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff433d2-6e93-427b-afd7-cad592a41b9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc3f19588aa4093b59a25a8a978c97b)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:11.666480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff433d2-6e93-427b-afd7-cad592a41b9b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:11.668269 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362969d4-28f8-4804-ad63-4697ffdbbd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:11.668955 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362969d4-28f8-4804-ad63-4697ffdbbd69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:11.669237 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362969d4-28f8-4804-ad63-4697ffdbbd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:11.669516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362969d4-28f8-4804-ad63-4697ffdbbd69 admin admin] PATH_INFO: `/v3/projects/7b4964276d604a4da30ff54a37e0995c/users/300531e9dd50442aba38b1827ed8720f/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:11.691064 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362969d4-28f8-4804-ad63-4697ffdbbd69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4964276d604a4da30ff54a37e0995c, user_id=300531e9dd50442aba38b1827ed8720f, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:11.694635 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362969d4-28f8-4804-ad63-4697ffdbbd69 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:11.722656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 934/1866] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:11 2022] PUT /identity/v3/projects/7b4964276d604a4da30ff54a37e0995c/users/300531e9dd50442aba38b1827ed8720f/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:11.722656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362969d4-28f8-4804-ad63-4697ffdbbd69 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:11.724829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-362969d4-28f8-4804-ad63-4697ffdbbd69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:11.744328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-0ff433d2-6e93-427b-afd7-cad592a41b9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc3f19588aa4093b59a25a8a978c97b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:11.745279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-0ff433d2-6e93-427b-afd7-cad592a41b9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc3f19588aa4093b59a25a8a978c97b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:11.773363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-0ff433d2-6e93-427b-afd7-cad592a41b9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc3f19588aa4093b59a25a8a978c97b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:11.784144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-0ff433d2-6e93-427b-afd7-cad592a41b9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc3f19588aa4093b59a25a8a978c97b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:11.796699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:11.798325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:11.803682 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-0ff433d2-6e93-427b-afd7-cad592a41b9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc3f19588aa4093b59a25a8a978c97b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:11.815372 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 933/1867] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:11 2022] DELETE /identity/v3/users/ecc3f19588aa4093b59a25a8a978c97b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:11.816599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff433d2-6e93-427b-afd7-cad592a41b9b admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:11.818281 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0ff433d2-6e93-427b-afd7-cad592a41b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:11.822289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362969d4-28f8-4804-ad63-4697ffdbbd69 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:11.917848 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969bf6d-046c-4052-aa75-a4519a3ea7b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae8db0856ed44088f0bd3cb93701de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:11.919322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969bf6d-046c-4052-aa75-a4519a3ea7b0 service placement] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:11.919794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969bf6d-046c-4052-aa75-a4519a3ea7b0 service placement] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:11.920362 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969bf6d-046c-4052-aa75-a4519a3ea7b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:11.923680 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7969bf6d-046c-4052-aa75-a4519a3ea7b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:11.923935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff433d2-6e93-427b-afd7-cad592a41b9b admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:11.930010 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bf3f8-f89d-48ad-9ccd-27c375eeb53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:11.930641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bf3f8-f89d-48ad-9ccd-27c375eeb53e admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:11.930940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bf3f8-f89d-48ad-9ccd-27c375eeb53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:11.931279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bf3f8-f89d-48ad-9ccd-27c375eeb53e admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:11.931920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bf3f8-f89d-48ad-9ccd-27c375eeb53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:11.933958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bf3f8-f89d-48ad-9ccd-27c375eeb53e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:11.939982 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969bf6d-046c-4052-aa75-a4519a3ea7b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:11.941566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969bf6d-046c-4052-aa75-a4519a3ea7b0 service placement] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:11.950831 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 934/1868] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:11.952633 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bf3f8-f89d-48ad-9ccd-27c375eeb53e admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:11.958142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 935/1869] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:11.963403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969bf6d-046c-4052-aa75-a4519a3ea7b0 service placement] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:11.964829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bf3f8-f89d-48ad-9ccd-27c375eeb53e admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:11.964949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7969bf6d-046c-4052-aa75-a4519a3ea7b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:11.970038 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7caa04-8ca7-4a37-a057-d8477838876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:11.970497 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7caa04-8ca7-4a37-a057-d8477838876d admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:11.970929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7caa04-8ca7-4a37-a057-d8477838876d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:11.971284 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7caa04-8ca7-4a37-a057-d8477838876d admin admin] PATH_INFO: `/v3/projects/7b4964276d604a4da30ff54a37e0995c/users/300531e9dd50442aba38b1827ed8720f/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:11.973384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7caa04-8ca7-4a37-a057-d8477838876d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4964276d604a4da30ff54a37e0995c, user_id=300531e9dd50442aba38b1827ed8720f, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:11.987211 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969bf6d-046c-4052-aa75-a4519a3ea7b0 service placement] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:11.988734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7caa04-8ca7-4a37-a057-d8477838876d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:11.992490 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a0256-942c-41e5-af1c-d21db223b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:11.993142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a0256-942c-41e5-af1c-d21db223b106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:11.993421 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a0256-942c-41e5-af1c-d21db223b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:11.994265 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a0256-942c-41e5-af1c-d21db223b106 admin admin] PATH_INFO: `/v3/projects/ce13ae7e616049b28778c87e866c5ccc` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:11.995554 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a0256-942c-41e5-af1c-d21db223b106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce13ae7e616049b28778c87e866c5ccc)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:11.997701 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a0256-942c-41e5-af1c-d21db223b106 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:12.007439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 935/1870] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:11 2022] PUT /identity/v3/projects/7b4964276d604a4da30ff54a37e0995c/users/300531e9dd50442aba38b1827ed8720f/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:12.015660 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbcd70-e80c-488d-9024-f354519e9c09 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:12.015946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbcd70-e80c-488d-9024-f354519e9c09 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:12.016224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbcd70-e80c-488d-9024-f354519e9c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:12.050500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-cfdbcd70-e80c-488d-9024-f354519e9c09 None None] MFA Rules not processed for user `300531e9dd50442aba38b1827ed8720f`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:12.051984 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-cfdbcd70-e80c-488d-9024-f354519e9c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:12.065010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8c0a0256-942c-41e5-af1c-d21db223b106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce13ae7e616049b28778c87e866c5ccc', 'request_id': 'req-8c0a0256-942c-41e5-af1c-d21db223b106'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.073004 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8c0a0256-942c-41e5-af1c-d21db223b106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce13ae7e616049b28778c87e866c5ccc', 'request_id': 'req-8c0a0256-942c-41e5-af1c-d21db223b106'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.086504 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8c0a0256-942c-41e5-af1c-d21db223b106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce13ae7e616049b28778c87e866c5ccc', 'request_id': 'req-8c0a0256-942c-41e5-af1c-d21db223b106'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.106993 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8c0a0256-942c-41e5-af1c-d21db223b106 admin admin] The token cache is being invalidate because project ce13ae7e616049b28778c87e866c5ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:12.107250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8c0a0256-942c-41e5-af1c-d21db223b106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.107910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8c0a0256-942c-41e5-af1c-d21db223b106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.109695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 936/1871] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:11 2022] DELETE /identity/v3/projects/ce13ae7e616049b28778c87e866c5ccc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:12.110488 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a0256-942c-41e5-af1c-d21db223b106 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:12.111664 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8c0a0256-942c-41e5-af1c-d21db223b106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:12.183865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 936/1872] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:12.186189 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c2bbe-11a2-4888-b430-90557c3d4ca0 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:12.186734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c2bbe-11a2-4888-b430-90557c3d4ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:12.187228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c2bbe-11a2-4888-b430-90557c3d4ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:12.211726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a0256-942c-41e5-af1c-d21db223b106 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:12.212360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-d71c2bbe-11a2-4888-b430-90557c3d4ca0 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:12.213797 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d71c2bbe-11a2-4888-b430-90557c3d4ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:12.216796 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338288b-d167-43f7-bd8b-f8de32b622a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:12.217437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338288b-d167-43f7-bd8b-f8de32b622a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:12.217719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338288b-d167-43f7-bd8b-f8de32b622a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:12.218121 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338288b-d167-43f7-bd8b-f8de32b622a5 admin admin] PATH_INFO: `/v3/projects/777ce7ea5aae4e3abcf5bb5fced111f1` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:12.219328 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338288b-d167-43f7-bd8b-f8de32b622a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=777ce7ea5aae4e3abcf5bb5fced111f1)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:12.221222 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338288b-d167-43f7-bd8b-f8de32b622a5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:12.223543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 937/1873] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:12.224816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c2bbe-11a2-4888-b430-90557c3d4ca0 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:12.226264 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d71c2bbe-11a2-4888-b430-90557c3d4ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:12.233736 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:12.293984 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1338288b-d167-43f7-bd8b-f8de32b622a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777ce7ea5aae4e3abcf5bb5fced111f1', 'request_id': 'req-1338288b-d167-43f7-bd8b-f8de32b622a5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.295996 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c2bbe-11a2-4888-b430-90557c3d4ca0 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:12.305455 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1338288b-d167-43f7-bd8b-f8de32b622a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777ce7ea5aae4e3abcf5bb5fced111f1', 'request_id': 'req-1338288b-d167-43f7-bd8b-f8de32b622a5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.308243 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:12.320138 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1338288b-d167-43f7-bd8b-f8de32b622a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777ce7ea5aae4e3abcf5bb5fced111f1', 'request_id': 'req-1338288b-d167-43f7-bd8b-f8de32b622a5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.340539 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1338288b-d167-43f7-bd8b-f8de32b622a5 admin admin] The token cache is being invalidate because project 777ce7ea5aae4e3abcf5bb5fced111f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:12.340842 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1338288b-d167-43f7-bd8b-f8de32b622a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.341878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1338288b-d167-43f7-bd8b-f8de32b622a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.346573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 937/1874] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:12 2022] DELETE /identity/v3/projects/777ce7ea5aae4e3abcf5bb5fced111f1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:12.346573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a62145-383d-4538-ad39-be9948d6ac3d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:12.346573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a62145-383d-4538-ad39-be9948d6ac3d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:12.346573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a62145-383d-4538-ad39-be9948d6ac3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:12.373009 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92311d31-92ea-46e0-ae30-1906f1f391fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:12.373649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92311d31-92ea-46e0-ae30-1906f1f391fd service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:12.373930 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92311d31-92ea-46e0-ae30-1906f1f391fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:12.374203 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92311d31-92ea-46e0-ae30-1906f1f391fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:12.380930 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-92311d31-92ea-46e0-ae30-1906f1f391fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:12.385512 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f5a62145-383d-4538-ad39-be9948d6ac3d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:12.387115 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f5a62145-383d-4538-ad39-be9948d6ac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:12.513568 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92311d31-92ea-46e0-ae30-1906f1f391fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:12.517253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92311d31-92ea-46e0-ae30-1906f1f391fd service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:12.523910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 938/1875] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:12.525374 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a62145-383d-4538-ad39-be9948d6ac3d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:12.527032 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f5a62145-383d-4538-ad39-be9948d6ac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:12.541744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a62145-383d-4538-ad39-be9948d6ac3d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:12.547438 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f5287-c575-45d6-8154-8f8b74038b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:12.548495 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f5287-c575-45d6-8154-8f8b74038b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:12.549044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f5287-c575-45d6-8154-8f8b74038b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:12.549321 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f5287-c575-45d6-8154-8f8b74038b75 admin admin] PATH_INFO: `/v3/users/4f1b6090ae504b41b06e5bc5d7911a92` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:12.550548 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f5287-c575-45d6-8154-8f8b74038b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f1b6090ae504b41b06e5bc5d7911a92)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:12.551727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 938/1876] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:12.552502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f5287-c575-45d6-8154-8f8b74038b75 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:12.555598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92311d31-92ea-46e0-ae30-1906f1f391fd service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:12.569295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92311d31-92ea-46e0-ae30-1906f1f391fd service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:12.576083 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f420741-432e-4936-b121-10519d7431bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:12.576812 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f420741-432e-4936-b121-10519d7431bc admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:12.577239 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f420741-432e-4936-b121-10519d7431bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:12.577606 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f420741-432e-4936-b121-10519d7431bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:12.578328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f420741-432e-4936-b121-10519d7431bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:12.578742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f420741-432e-4936-b121-10519d7431bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:12.582697 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f420741-432e-4936-b121-10519d7431bc admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:12.615875 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 939/1877] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:33:12.631071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f420741-432e-4936-b121-10519d7431bc admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:12.648843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f420741-432e-4936-b121-10519d7431bc admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:12.654069 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fb1f5287-c575-45d6-8154-8f8b74038b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f1b6090ae504b41b06e5bc5d7911a92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.654786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fb1f5287-c575-45d6-8154-8f8b74038b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f1b6090ae504b41b06e5bc5d7911a92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.655053 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24088d3-9392-40f6-a992-dac28cd2771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:12.655718 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24088d3-9392-40f6-a992-dac28cd2771e admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:12.656154 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24088d3-9392-40f6-a992-dac28cd2771e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:12.656517 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24088d3-9392-40f6-a992-dac28cd2771e admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:12.657349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24088d3-9392-40f6-a992-dac28cd2771e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:12.659691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24088d3-9392-40f6-a992-dac28cd2771e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:12.667053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fb1f5287-c575-45d6-8154-8f8b74038b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f1b6090ae504b41b06e5bc5d7911a92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.683622 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fb1f5287-c575-45d6-8154-8f8b74038b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f1b6090ae504b41b06e5bc5d7911a92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.698088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fb1f5287-c575-45d6-8154-8f8b74038b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f1b6090ae504b41b06e5bc5d7911a92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.699267 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 940/1878] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:12 2022] POST /identity/v3/projects => generated 393 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:12.699951 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24088d3-9392-40f6-a992-dac28cd2771e admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:12.704022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b24088d3-9392-40f6-a992-dac28cd2771e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:12.710054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 939/1879] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:12 2022] DELETE /identity/v3/users/4f1b6090ae504b41b06e5bc5d7911a92 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:12.710054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f5287-c575-45d6-8154-8f8b74038b75 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:12.711040 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fb1f5287-c575-45d6-8154-8f8b74038b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:12.736510 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:12.829354 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f5287-c575-45d6-8154-8f8b74038b75 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:12.829903 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24088d3-9392-40f6-a992-dac28cd2771e admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:12.836936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66208332-b5d9-4342-80fa-ede1ac106cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:12.838863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66208332-b5d9-4342-80fa-ede1ac106cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:12.839352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0db8a-3524-4610-b87d-0db08ca50cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:12.839500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66208332-b5d9-4342-80fa-ede1ac106cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:12.839989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66208332-b5d9-4342-80fa-ede1ac106cd8 admin admin] PATH_INFO: `/v3/users/2b3823171bdd4b3b8275786f09215f90` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:12.840573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0db8a-3524-4610-b87d-0db08ca50cfd admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:12.841011 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0db8a-3524-4610-b87d-0db08ca50cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:12.841443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0db8a-3524-4610-b87d-0db08ca50cfd admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:12.841557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66208332-b5d9-4342-80fa-ede1ac106cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3823171bdd4b3b8275786f09215f90)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:12.842865 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0db8a-3524-4610-b87d-0db08ca50cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:12.843989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66208332-b5d9-4342-80fa-ede1ac106cd8 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:12.846933 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0db8a-3524-4610-b87d-0db08ca50cfd admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:12.891581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 940/1880] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:12 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:12.893950 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0db8a-3524-4610-b87d-0db08ca50cfd admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:12.904528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:12.917213 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0db8a-3524-4610-b87d-0db08ca50cfd admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:12.929136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-66208332-b5d9-4342-80fa-ede1ac106cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3823171bdd4b3b8275786f09215f90'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.930519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-66208332-b5d9-4342-80fa-ede1ac106cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3823171bdd4b3b8275786f09215f90'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.935197 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0e9c5-49da-4b4b-ace0-0ec849cd9602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:12.936354 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0e9c5-49da-4b4b-ace0-0ec849cd9602 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:12.936871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0e9c5-49da-4b4b-ace0-0ec849cd9602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:12.937152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0e9c5-49da-4b4b-ace0-0ec849cd9602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:12.937820 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0e9c5-49da-4b4b-ace0-0ec849cd9602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:12.939921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0e9c5-49da-4b4b-ace0-0ec849cd9602 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:12.947604 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-66208332-b5d9-4342-80fa-ede1ac106cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3823171bdd4b3b8275786f09215f90'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.959493 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-66208332-b5d9-4342-80fa-ede1ac106cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3823171bdd4b3b8275786f09215f90'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.970580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 941/1881] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:12.971942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0e9c5-49da-4b4b-ace0-0ec849cd9602 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:12.973193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-66208332-b5d9-4342-80fa-ede1ac106cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3823171bdd4b3b8275786f09215f90'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:12.981456 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2fb0e9c5-49da-4b4b-ace0-0ec849cd9602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:12.986492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 941/1882] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:12 2022] DELETE /identity/v3/users/2b3823171bdd4b3b8275786f09215f90 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:12.988422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7eb70c-58d4-4cf1-9c61-dbfb1bbd5ea8 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:12.988935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7eb70c-58d4-4cf1-9c61-dbfb1bbd5ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:12.989887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7eb70c-58d4-4cf1-9c61-dbfb1bbd5ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.006120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0e9c5-49da-4b4b-ace0-0ec849cd9602 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:13.018800 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-7b7eb70c-58d4-4cf1-9c61-dbfb1bbd5ea8 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:13.020158 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7b7eb70c-58d4-4cf1-9c61-dbfb1bbd5ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:13.103583 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdba85-5019-43a4-bd33-2239db8322fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:13.104474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdba85-5019-43a4-bd33-2239db8322fc admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:13.105055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdba85-5019-43a4-bd33-2239db8322fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:13.105504 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdba85-5019-43a4-bd33-2239db8322fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.107012 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdba85-5019-43a4-bd33-2239db8322fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:13.109040 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdba85-5019-43a4-bd33-2239db8322fc admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:13.129071 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 942/1883] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:13.130092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdba85-5019-43a4-bd33-2239db8322fc admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:13.132310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e7cdba85-5019-43a4-bd33-2239db8322fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:13.137355 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 942/1884] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:13.138398 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7eb70c-58d4-4cf1-9c61-dbfb1bbd5ea8 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:13.154528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7eb70c-58d4-4cf1-9c61-dbfb1bbd5ea8 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:13.158012 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdba85-5019-43a4-bd33-2239db8322fc admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:13.162387 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0a831-2a1e-4d5a-9da8-bf59a2d16a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:13.163700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0a831-2a1e-4d5a-9da8-bf59a2d16a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:13.164161 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0a831-2a1e-4d5a-9da8-bf59a2d16a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:13.164629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0a831-2a1e-4d5a-9da8-bf59a2d16a14 admin admin] PATH_INFO: `/v3/projects/ab9afd7c143544438c68cf4ea49d0ff4/users/cf4cf6b6c70f44b581749915779a5869/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.167858 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92247cfa-7704-43d0-92d8-2beda8b5a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:13.168590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92247cfa-7704-43d0-92d8-2beda8b5a436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:13.168876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92247cfa-7704-43d0-92d8-2beda8b5a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:13.169153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92247cfa-7704-43d0-92d8-2beda8b5a436 admin admin] PATH_INFO: `/v3/projects/d519d76fd62747feb929244b653e5362` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.170329 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92247cfa-7704-43d0-92d8-2beda8b5a436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d519d76fd62747feb929244b653e5362)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:13.172788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92247cfa-7704-43d0-92d8-2beda8b5a436 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:13.197657 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0a831-2a1e-4d5a-9da8-bf59a2d16a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab9afd7c143544438c68cf4ea49d0ff4, user_id=cf4cf6b6c70f44b581749915779a5869, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:13.200926 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0a831-2a1e-4d5a-9da8-bf59a2d16a14 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:13.230293 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 943/1885] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:13 2022] PUT /identity/v3/projects/ab9afd7c143544438c68cf4ea49d0ff4/users/cf4cf6b6c70f44b581749915779a5869/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:13.235898 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0a831-2a1e-4d5a-9da8-bf59a2d16a14 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:13.238235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b8e0a831-2a1e-4d5a-9da8-bf59a2d16a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:13.261050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-92247cfa-7704-43d0-92d8-2beda8b5a436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd519d76fd62747feb929244b653e5362', 'request_id': 'req-92247cfa-7704-43d0-92d8-2beda8b5a436'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:13.269739 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-92247cfa-7704-43d0-92d8-2beda8b5a436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd519d76fd62747feb929244b653e5362', 'request_id': 'req-92247cfa-7704-43d0-92d8-2beda8b5a436'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:13.279459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-92247cfa-7704-43d0-92d8-2beda8b5a436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd519d76fd62747feb929244b653e5362', 'request_id': 'req-92247cfa-7704-43d0-92d8-2beda8b5a436'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:13.295233 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-92247cfa-7704-43d0-92d8-2beda8b5a436 admin admin] The token cache is being invalidate because project d519d76fd62747feb929244b653e5362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:13.295504 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-92247cfa-7704-43d0-92d8-2beda8b5a436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:13.296280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-92247cfa-7704-43d0-92d8-2beda8b5a436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:13.299002 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 943/1886] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:13 2022] DELETE /identity/v3/projects/d519d76fd62747feb929244b653e5362 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:13.303497 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c4b6c-5b50-4ae5-9f59-0da7c79e34d7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:13.303782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c4b6c-5b50-4ae5-9f59-0da7c79e34d7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:13.304054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c4b6c-5b50-4ae5-9f59-0da7c79e34d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.316161 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0a831-2a1e-4d5a-9da8-bf59a2d16a14 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:13.324948 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:13.337014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-466c4b6c-5b50-4ae5-9f59-0da7c79e34d7 None None] MFA Rules not processed for user `cf4cf6b6c70f44b581749915779a5869`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:13.339555 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-466c4b6c-5b50-4ae5-9f59-0da7c79e34d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:13.357735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:13.370345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edea88-452c-4ef7-bb7b-a97cd593dd01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:13.371109 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edea88-452c-4ef7-bb7b-a97cd593dd01 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:13.371388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edea88-452c-4ef7-bb7b-a97cd593dd01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:13.371661 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edea88-452c-4ef7-bb7b-a97cd593dd01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.373422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b9edea88-452c-4ef7-bb7b-a97cd593dd01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:13.406341 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 944/1887] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:13.407533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95b839-f59e-4f5e-9789-48fe248dc180 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:13.407819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95b839-f59e-4f5e-9789-48fe248dc180 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:13.408092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95b839-f59e-4f5e-9789-48fe248dc180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.426826 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-af95b839-f59e-4f5e-9789-48fe248dc180 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:13.428073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-af95b839-f59e-4f5e-9789-48fe248dc180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:13.439961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edea88-452c-4ef7-bb7b-a97cd593dd01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:13.441381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edea88-452c-4ef7-bb7b-a97cd593dd01 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:13.451488 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 944/1888] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:13.452818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edea88-452c-4ef7-bb7b-a97cd593dd01 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:13.454500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b9edea88-452c-4ef7-bb7b-a97cd593dd01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:13.466984 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edea88-452c-4ef7-bb7b-a97cd593dd01 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:13.473022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982acf6-26ee-4456-9b08-72936e545487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:13.473625 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982acf6-26ee-4456-9b08-72936e545487 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:13.473905 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982acf6-26ee-4456-9b08-72936e545487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:13.474180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982acf6-26ee-4456-9b08-72936e545487 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.474962 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982acf6-26ee-4456-9b08-72936e545487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:13.476976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982acf6-26ee-4456-9b08-72936e545487 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:13.490824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 945/1889] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:13.499597 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368748-0426-4ba3-9878-10af9e3254c1 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:13.499955 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368748-0426-4ba3-9878-10af9e3254c1 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:13.500252 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368748-0426-4ba3-9878-10af9e3254c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.509664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 945/1890] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:13 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:13.513934 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982acf6-26ee-4456-9b08-72936e545487 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:13.524807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8f368748-0426-4ba3-9878-10af9e3254c1 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:13.526328 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8f368748-0426-4ba3-9878-10af9e3254c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:13.591133 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 946/1891] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:13.592128 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982acf6-26ee-4456-9b08-72936e545487 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:13.595460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f368748-0426-4ba3-9878-10af9e3254c1 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:13.598190 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9570bb-62f5-460b-8146-098a3413b453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:13.598964 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9570bb-62f5-460b-8146-098a3413b453 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:13.599246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9570bb-62f5-460b-8146-098a3413b453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:13.599518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9570bb-62f5-460b-8146-098a3413b453 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.600297 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9570bb-62f5-460b-8146-098a3413b453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:13.604185 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9570bb-62f5-460b-8146-098a3413b453 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:13.613005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f368748-0426-4ba3-9878-10af9e3254c1 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:13.624687 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35606759-0700-45f4-814d-23d02d8094c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:13.624687 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35606759-0700-45f4-814d-23d02d8094c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:13.624687 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35606759-0700-45f4-814d-23d02d8094c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:13.624687 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35606759-0700-45f4-814d-23d02d8094c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.625090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35606759-0700-45f4-814d-23d02d8094c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:13.625090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35606759-0700-45f4-814d-23d02d8094c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:13.626667 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35606759-0700-45f4-814d-23d02d8094c1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:13.638661 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 946/1892] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:13 2022] POST /identity/v3/users => generated 303 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:33:13.640514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9570bb-62f5-460b-8146-098a3413b453 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:13.643361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 947/1893] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:33:13.647935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35606759-0700-45f4-814d-23d02d8094c1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:13.651931 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9570bb-62f5-460b-8146-098a3413b453 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:13.657220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff6481-fef5-4138-aec4-3a01e7414cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:13.658207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6481-fef5-4138-aec4-3a01e7414cdf admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:13.658207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6481-fef5-4138-aec4-3a01e7414cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:13.658394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6481-fef5-4138-aec4-3a01e7414cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.658982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff6481-fef5-4138-aec4-3a01e7414cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:13.660674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff6481-fef5-4138-aec4-3a01e7414cdf admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:13.663388 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35606759-0700-45f4-814d-23d02d8094c1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:13.675963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 947/1894] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:13.676905 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449dac2-84dc-4cdc-b197-27091aa843b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:13.679805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449dac2-84dc-4cdc-b197-27091aa843b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:13.680097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449dac2-84dc-4cdc-b197-27091aa843b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:13.680283 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff6481-fef5-4138-aec4-3a01e7414cdf admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:13.680437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449dac2-84dc-4cdc-b197-27091aa843b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.681221 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449dac2-84dc-4cdc-b197-27091aa843b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:13.685981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449dac2-84dc-4cdc-b197-27091aa843b9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:13.690852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff6481-fef5-4138-aec4-3a01e7414cdf admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:13.696009 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab70ae-8f05-495e-8ff4-9d3864c45c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:13.697384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab70ae-8f05-495e-8ff4-9d3864c45c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:13.697731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab70ae-8f05-495e-8ff4-9d3864c45c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:13.698069 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab70ae-8f05-495e-8ff4-9d3864c45c8b admin admin] PATH_INFO: `/v3/projects/d180884c66c9487da139853b7db4436c/users/fb074e19abd64ce78ac9e5b284646975/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.720344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 948/1895] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:13 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:13.720563 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab70ae-8f05-495e-8ff4-9d3864c45c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d180884c66c9487da139853b7db4436c, user_id=fb074e19abd64ce78ac9e5b284646975, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:13.721805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449dac2-84dc-4cdc-b197-27091aa843b9 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:13.723464 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab70ae-8f05-495e-8ff4-9d3864c45c8b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:13.732793 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:13.745769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 948/1896] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:13 2022] PUT /identity/v3/projects/d180884c66c9487da139853b7db4436c/users/fb074e19abd64ce78ac9e5b284646975/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:13.750672 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab70ae-8f05-495e-8ff4-9d3864c45c8b admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:13.778453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:13.805874 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449dac2-84dc-4cdc-b197-27091aa843b9 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:13.816726 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab70ae-8f05-495e-8ff4-9d3864c45c8b admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:13.821512 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce020904-e4c7-4a08-81da-d816418f1ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:13.822761 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce020904-e4c7-4a08-81da-d816418f1ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:13.823047 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce020904-e4c7-4a08-81da-d816418f1ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:13.823324 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce020904-e4c7-4a08-81da-d816418f1ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.824001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce020904-e4c7-4a08-81da-d816418f1ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:13.825618 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce020904-e4c7-4a08-81da-d816418f1ca2 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:13.836144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 949/1897] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:13.837199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce020904-e4c7-4a08-81da-d816418f1ca2 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:13.839663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ce020904-e4c7-4a08-81da-d816418f1ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:13.852164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce020904-e4c7-4a08-81da-d816418f1ca2 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:13.857246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482facf-11f2-4e67-927a-d3e658631cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:13.857866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482facf-11f2-4e67-927a-d3e658631cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:13.858155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482facf-11f2-4e67-927a-d3e658631cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:13.858428 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482facf-11f2-4e67-927a-d3e658631cec admin admin] PATH_INFO: `/v3/projects/cd611cd01df74fc39f2c50265e0d25fc` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.859582 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482facf-11f2-4e67-927a-d3e658631cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd611cd01df74fc39f2c50265e0d25fc)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:13.861451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482facf-11f2-4e67-927a-d3e658631cec admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:13.867708 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3780e1-52b8-4cce-9ac7-abb69c5666e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:13.870296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3780e1-52b8-4cce-9ac7-abb69c5666e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:13.870296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3780e1-52b8-4cce-9ac7-abb69c5666e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:13.870296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3780e1-52b8-4cce-9ac7-abb69c5666e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.870296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3780e1-52b8-4cce-9ac7-abb69c5666e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:13.871925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3780e1-52b8-4cce-9ac7-abb69c5666e4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:13.896471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 949/1898] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:13 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:13.901189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3780e1-52b8-4cce-9ac7-abb69c5666e4 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:13.913036 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3780e1-52b8-4cce-9ac7-abb69c5666e4 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:13.924435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6482facf-11f2-4e67-927a-d3e658631cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd611cd01df74fc39f2c50265e0d25fc', 'request_id': 'req-6482facf-11f2-4e67-927a-d3e658631cec'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:13.934909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6482facf-11f2-4e67-927a-d3e658631cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd611cd01df74fc39f2c50265e0d25fc', 'request_id': 'req-6482facf-11f2-4e67-927a-d3e658631cec'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:13.942739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6482facf-11f2-4e67-927a-d3e658631cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd611cd01df74fc39f2c50265e0d25fc', 'request_id': 'req-6482facf-11f2-4e67-927a-d3e658631cec'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:13.957528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6482facf-11f2-4e67-927a-d3e658631cec admin admin] The token cache is being invalidate because project cd611cd01df74fc39f2c50265e0d25fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:13.958054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6482facf-11f2-4e67-927a-d3e658631cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:13.958894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6482facf-11f2-4e67-927a-d3e658631cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:13.964328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 950/1899] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:13 2022] DELETE /identity/v3/projects/cd611cd01df74fc39f2c50265e0d25fc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:13.964328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482facf-11f2-4e67-927a-d3e658631cec admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:13.964328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6482facf-11f2-4e67-927a-d3e658631cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:13.990267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac88b1-d9b4-4cdd-8fae-e681f382b7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:13.991262 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac88b1-d9b4-4cdd-8fae-e681f382b7c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:13.991690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac88b1-d9b4-4cdd-8fae-e681f382b7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:13.992127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac88b1-d9b4-4cdd-8fae-e681f382b7c7 admin admin] PATH_INFO: `/v3/projects/d180884c66c9487da139853b7db4436c/users/fb074e19abd64ce78ac9e5b284646975/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:13.995315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac88b1-d9b4-4cdd-8fae-e681f382b7c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d180884c66c9487da139853b7db4436c, user_id=fb074e19abd64ce78ac9e5b284646975, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:13.999369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac88b1-d9b4-4cdd-8fae-e681f382b7c7 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:14.015875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 950/1900] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:13 2022] PUT /identity/v3/projects/d180884c66c9487da139853b7db4436c/users/fb074e19abd64ce78ac9e5b284646975/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:14.017094 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac88b1-d9b4-4cdd-8fae-e681f382b7c7 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:14.018695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-65ac88b1-d9b4-4cdd-8fae-e681f382b7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:14.055254 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482facf-11f2-4e67-927a-d3e658631cec admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:14.086258 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:14.117857 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:14.124787 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac88b1-d9b4-4cdd-8fae-e681f382b7c7 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:14.134529 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea48c0a-c117-4491-b5bb-77b3e92da594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:14.135062 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e1b13-2cbb-4c2d-88b2-0001e4770aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:14.135296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea48c0a-c117-4491-b5bb-77b3e92da594 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:14.135635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea48c0a-c117-4491-b5bb-77b3e92da594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:14.135908 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e1b13-2cbb-4c2d-88b2-0001e4770aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:14.136036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea48c0a-c117-4491-b5bb-77b3e92da594 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:14.136601 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea48c0a-c117-4491-b5bb-77b3e92da594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:14.136797 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e1b13-2cbb-4c2d-88b2-0001e4770aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:14.137074 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e1b13-2cbb-4c2d-88b2-0001e4770aab admin admin] PATH_INFO: `/v3/users/300531e9dd50442aba38b1827ed8720f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:14.138229 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea48c0a-c117-4491-b5bb-77b3e92da594 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:14.138404 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e1b13-2cbb-4c2d-88b2-0001e4770aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=300531e9dd50442aba38b1827ed8720f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:14.140502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e1b13-2cbb-4c2d-88b2-0001e4770aab admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:14.154909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 951/1901] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:14.154909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed527afb-ec1b-43c7-b497-fd2b23acda80 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:14.154909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed527afb-ec1b-43c7-b497-fd2b23acda80 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:14.154909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed527afb-ec1b-43c7-b497-fd2b23acda80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:14.182794 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-ed527afb-ec1b-43c7-b497-fd2b23acda80 None None] MFA Rules not processed for user `fb074e19abd64ce78ac9e5b284646975`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:14.184066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ed527afb-ec1b-43c7-b497-fd2b23acda80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:14.192682 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-780e1b13-2cbb-4c2d-88b2-0001e4770aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300531e9dd50442aba38b1827ed8720f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:14.193444 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-780e1b13-2cbb-4c2d-88b2-0001e4770aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300531e9dd50442aba38b1827ed8720f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:14.202889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-780e1b13-2cbb-4c2d-88b2-0001e4770aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300531e9dd50442aba38b1827ed8720f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:14.215950 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-780e1b13-2cbb-4c2d-88b2-0001e4770aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300531e9dd50442aba38b1827ed8720f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:14.223380 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-780e1b13-2cbb-4c2d-88b2-0001e4770aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300531e9dd50442aba38b1827ed8720f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:14.230635 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 951/1902] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:14 2022] DELETE /identity/v3/users/300531e9dd50442aba38b1827ed8720f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:14.231566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e1b13-2cbb-4c2d-88b2-0001e4770aab admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:14.232926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-780e1b13-2cbb-4c2d-88b2-0001e4770aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:14.298533 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 952/1903] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:14 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:14.306553 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed527afb-ec1b-43c7-b497-fd2b23acda80 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:14.310353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ed527afb-ec1b-43c7-b497-fd2b23acda80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:14.391088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e1b13-2cbb-4c2d-88b2-0001e4770aab admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:14.407295 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142470dd-541f-4682-9617-6066819fe4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:14.408557 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142470dd-541f-4682-9617-6066819fe4de admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:14.409934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142470dd-541f-4682-9617-6066819fe4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:14.410386 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed527afb-ec1b-43c7-b497-fd2b23acda80 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:14.412640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142470dd-541f-4682-9617-6066819fe4de admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:14.413487 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142470dd-541f-4682-9617-6066819fe4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:14.417279 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142470dd-541f-4682-9617-6066819fe4de admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:14.440724 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 952/1904] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:14.444201 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142470dd-541f-4682-9617-6066819fe4de admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:14.456381 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142470dd-541f-4682-9617-6066819fe4de admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:14.469094 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324f447-1b82-4896-8bfb-396a0032c1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:14.471626 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f447-1b82-4896-8bfb-396a0032c1db admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:14.472084 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f447-1b82-4896-8bfb-396a0032c1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:14.472513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f447-1b82-4896-8bfb-396a0032c1db admin admin] PATH_INFO: `/v3/projects/2c900f7e9f484ee08ce96cef8885ccb4/users/e1c77825a9a44c91a5e6d82d7eb30146/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:14.493094 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c2a9d-5bb4-427d-8c92-2df94c0650b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:14.493835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c2a9d-5bb4-427d-8c92-2df94c0650b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:14.494226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c2a9d-5bb4-427d-8c92-2df94c0650b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:14.494714 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c2a9d-5bb4-427d-8c92-2df94c0650b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:14.499807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324f447-1b82-4896-8bfb-396a0032c1db admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c900f7e9f484ee08ce96cef8885ccb4, user_id=e1c77825a9a44c91a5e6d82d7eb30146, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:14.502454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324f447-1b82-4896-8bfb-396a0032c1db admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:14.517365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 953/1905] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:14 2022] PUT /identity/v3/projects/2c900f7e9f484ee08ce96cef8885ccb4/users/e1c77825a9a44c91a5e6d82d7eb30146/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:14.529048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c98240-9489-410a-a737-d2f5383922fd None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:14.529558 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c98240-9489-410a-a737-d2f5383922fd None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:14.530319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c98240-9489-410a-a737-d2f5383922fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:14.583198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-06c98240-9489-410a-a737-d2f5383922fd None None] MFA Rules not processed for user `e1c77825a9a44c91a5e6d82d7eb30146`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:14.587108 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-06c98240-9489-410a-a737-d2f5383922fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:14.595847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:14.604452 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:14.636024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c2a9d-5bb4-427d-8c92-2df94c0650b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:14.637992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c2a9d-5bb4-427d-8c92-2df94c0650b6 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:14.652875 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 953/1906] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:14 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:14.677522 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c2a9d-5bb4-427d-8c92-2df94c0650b6 service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:14.679009 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b58c2a9d-5bb4-427d-8c92-2df94c0650b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:14.702534 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 954/1907] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:14.705937 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c98240-9489-410a-a737-d2f5383922fd None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:14.716220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c2a9d-5bb4-427d-8c92-2df94c0650b6 service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:14.789598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599dd5c-8059-43f7-a96f-79f3084c2223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:14.790236 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599dd5c-8059-43f7-a96f-79f3084c2223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:14.790724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599dd5c-8059-43f7-a96f-79f3084c2223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:14.791027 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599dd5c-8059-43f7-a96f-79f3084c2223 admin admin] PATH_INFO: `/v3/projects/7b4964276d604a4da30ff54a37e0995c` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:14.792132 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599dd5c-8059-43f7-a96f-79f3084c2223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b4964276d604a4da30ff54a37e0995c)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:14.794076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599dd5c-8059-43f7-a96f-79f3084c2223 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:14.800627 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c98240-9489-410a-a737-d2f5383922fd None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:14.807050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3af07c-808d-4c19-9f19-9d79f966d6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:14.808122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3af07c-808d-4c19-9f19-9d79f966d6dc admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:14.808496 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3af07c-808d-4c19-9f19-9d79f966d6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:14.808873 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3af07c-808d-4c19-9f19-9d79f966d6dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:14.809902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3af07c-808d-4c19-9f19-9d79f966d6dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:14.812371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3af07c-808d-4c19-9f19-9d79f966d6dc admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:14.848666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 955/1908] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:14 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:14.849662 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3af07c-808d-4c19-9f19-9d79f966d6dc admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:14.857351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-0599dd5c-8059-43f7-a96f-79f3084c2223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b4964276d604a4da30ff54a37e0995c', 'request_id': 'req-0599dd5c-8059-43f7-a96f-79f3084c2223'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:14.865250 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-0599dd5c-8059-43f7-a96f-79f3084c2223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b4964276d604a4da30ff54a37e0995c', 'request_id': 'req-0599dd5c-8059-43f7-a96f-79f3084c2223'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:14.872216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-0599dd5c-8059-43f7-a96f-79f3084c2223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b4964276d604a4da30ff54a37e0995c', 'request_id': 'req-0599dd5c-8059-43f7-a96f-79f3084c2223'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:14.883472 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-0599dd5c-8059-43f7-a96f-79f3084c2223 admin admin] The token cache is being invalidate because project 7b4964276d604a4da30ff54a37e0995c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:14.883767 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-0599dd5c-8059-43f7-a96f-79f3084c2223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:14.884940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-0599dd5c-8059-43f7-a96f-79f3084c2223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:14.886483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 954/1909] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:14 2022] DELETE /identity/v3/projects/7b4964276d604a4da30ff54a37e0995c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:14.887272 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599dd5c-8059-43f7-a96f-79f3084c2223 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:14.888593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0599dd5c-8059-43f7-a96f-79f3084c2223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:14.920993 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3af07c-808d-4c19-9f19-9d79f966d6dc admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:14.924941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a2c49-15a1-4c12-be8c-8f35ac876888 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:14.925597 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a2c49-15a1-4c12-be8c-8f35ac876888 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:14.925937 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a2c49-15a1-4c12-be8c-8f35ac876888 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:14.926277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a2c49-15a1-4c12-be8c-8f35ac876888 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:14.928754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-010a2c49-15a1-4c12-be8c-8f35ac876888 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:14.968774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599dd5c-8059-43f7-a96f-79f3084c2223 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:14.980059 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:14.999862 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:15.003045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a2c49-15a1-4c12-be8c-8f35ac876888 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:15.005781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a2c49-15a1-4c12-be8c-8f35ac876888 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:15.017353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 956/1910] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:15.018410 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466a035-7066-4acd-b2b6-43cf68cc4201 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.018785 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466a035-7066-4acd-b2b6-43cf68cc4201 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.019066 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466a035-7066-4acd-b2b6-43cf68cc4201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.044490 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-c466a035-7066-4acd-b2b6-43cf68cc4201 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:15.045796 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c466a035-7066-4acd-b2b6-43cf68cc4201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:15.047717 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e07c6c-c116-4400-85e7-72a8301b1c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:15.048656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e07c6c-c116-4400-85e7-72a8301b1c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.049093 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e07c6c-c116-4400-85e7-72a8301b1c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.049371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e07c6c-c116-4400-85e7-72a8301b1c90 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.050014 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e07c6c-c116-4400-85e7-72a8301b1c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:15.052047 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e07c6c-c116-4400-85e7-72a8301b1c90 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:15.058118 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 957/1911] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:15.067101 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cf845-d3ee-4de5-81b8-78c22249e7df None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.067542 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cf845-d3ee-4de5-81b8-78c22249e7df None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.068003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cf845-d3ee-4de5-81b8-78c22249e7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.086315 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 955/1912] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:14 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:15.090353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e07c6c-c116-4400-85e7-72a8301b1c90 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:15.094541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-157cf845-d3ee-4de5-81b8-78c22249e7df None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:15.095853 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-157cf845-d3ee-4de5-81b8-78c22249e7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:15.104372 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e07c6c-c116-4400-85e7-72a8301b1c90 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:15.105115 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 958/1913] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:15.105914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cf845-d3ee-4de5-81b8-78c22249e7df None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:15.107817 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-157cf845-d3ee-4de5-81b8-78c22249e7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:15.112427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d1d9a-5409-40e9-9ff2-d5042f4f41e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:15.113043 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d1d9a-5409-40e9-9ff2-d5042f4f41e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.113328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d1d9a-5409-40e9-9ff2-d5042f4f41e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.113663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d1d9a-5409-40e9-9ff2-d5042f4f41e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.114299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d1d9a-5409-40e9-9ff2-d5042f4f41e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:15.115920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d1d9a-5409-40e9-9ff2-d5042f4f41e5 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:15.120154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cf845-d3ee-4de5-81b8-78c22249e7df None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:15.126487 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab313c7-0b3d-4153-82ec-83ccd1142d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:15.127282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab313c7-0b3d-4153-82ec-83ccd1142d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.127570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab313c7-0b3d-4153-82ec-83ccd1142d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.127846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab313c7-0b3d-4153-82ec-83ccd1142d14 admin admin] PATH_INFO: `/v3/users/5edc1db90e844ccdbd0776276255f755` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.129014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab313c7-0b3d-4153-82ec-83ccd1142d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5edc1db90e844ccdbd0776276255f755)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:15.130014 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 956/1914] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:15.130985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d1d9a-5409-40e9-9ff2-d5042f4f41e5 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:15.131096 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab313c7-0b3d-4153-82ec-83ccd1142d14 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:15.147650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d1d9a-5409-40e9-9ff2-d5042f4f41e5 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:15.156095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbce3dc-21c4-4a67-8abd-31b0230ff6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:15.157383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbce3dc-21c4-4a67-8abd-31b0230ff6be admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.157873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbce3dc-21c4-4a67-8abd-31b0230ff6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.158393 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbce3dc-21c4-4a67-8abd-31b0230ff6be admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.159257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbce3dc-21c4-4a67-8abd-31b0230ff6be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:15.159661 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbce3dc-21c4-4a67-8abd-31b0230ff6be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:15.162336 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbce3dc-21c4-4a67-8abd-31b0230ff6be admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:15.178188 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 957/1915] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:33:15.179451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbce3dc-21c4-4a67-8abd-31b0230ff6be admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:15.190362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbce3dc-21c4-4a67-8abd-31b0230ff6be admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:15.195792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b493fad-a432-46b5-944c-e23308beab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:15.197226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b493fad-a432-46b5-944c-e23308beab2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.197651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b493fad-a432-46b5-944c-e23308beab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.198099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b493fad-a432-46b5-944c-e23308beab2e admin admin] PATH_INFO: `/v3/projects/ca0241fa078d411797d1e0b6abb24cae/users/4cfb68cf01ac446b80db57759415259a/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.215572 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b493fad-a432-46b5-944c-e23308beab2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0241fa078d411797d1e0b6abb24cae, user_id=4cfb68cf01ac446b80db57759415259a, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:15.218845 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b493fad-a432-46b5-944c-e23308beab2e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:15.227155 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cab313c7-0b3d-4153-82ec-83ccd1142d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5edc1db90e844ccdbd0776276255f755'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:15.228847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cab313c7-0b3d-4153-82ec-83ccd1142d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5edc1db90e844ccdbd0776276255f755'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:15.239204 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cab313c7-0b3d-4153-82ec-83ccd1142d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5edc1db90e844ccdbd0776276255f755'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:15.246949 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 958/1916] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:15 2022] PUT /identity/v3/projects/ca0241fa078d411797d1e0b6abb24cae/users/4cfb68cf01ac446b80db57759415259a/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:15.250841 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b493fad-a432-46b5-944c-e23308beab2e admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:15.253666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2b493fad-a432-46b5-944c-e23308beab2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:15.268602 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cab313c7-0b3d-4153-82ec-83ccd1142d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5edc1db90e844ccdbd0776276255f755'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:15.280910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cab313c7-0b3d-4153-82ec-83ccd1142d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5edc1db90e844ccdbd0776276255f755'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:15.290723 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 959/1917] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:15 2022] DELETE /identity/v3/users/5edc1db90e844ccdbd0776276255f755 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:15.291783 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab313c7-0b3d-4153-82ec-83ccd1142d14 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:15.294909 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cab313c7-0b3d-4153-82ec-83ccd1142d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:15.349416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b493fad-a432-46b5-944c-e23308beab2e admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:15.446194 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6977b-c939-4079-b987-5bfcf3f707a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:15.447196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6977b-c939-4079-b987-5bfcf3f707a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.447544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6977b-c939-4079-b987-5bfcf3f707a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.447883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6977b-c939-4079-b987-5bfcf3f707a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.448599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6977b-c939-4079-b987-5bfcf3f707a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:15.450890 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6977b-c939-4079-b987-5bfcf3f707a2 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:15.458227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:15.459067 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab313c7-0b3d-4153-82ec-83ccd1142d14 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:15.478733 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b79467-946f-4067-b43d-6bb2b3cd834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:15.478733 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b79467-946f-4067-b43d-6bb2b3cd834c admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.478733 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b79467-946f-4067-b43d-6bb2b3cd834c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.478733 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b79467-946f-4067-b43d-6bb2b3cd834c admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.479319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b79467-946f-4067-b43d-6bb2b3cd834c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:15.479319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b79467-946f-4067-b43d-6bb2b3cd834c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:15.484688 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 959/1918] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:15 2022] POST /identity/v3/projects => generated 371 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:15.486737 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb6ec0-2631-43ff-b156-b536d5acc06e None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.486737 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb6ec0-2631-43ff-b156-b536d5acc06e None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.486737 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb6ec0-2631-43ff-b156-b536d5acc06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.488907 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 960/1919] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:15.489033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b79467-946f-4067-b43d-6bb2b3cd834c admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:15.500468 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b79467-946f-4067-b43d-6bb2b3cd834c admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:15.506572 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-e2eb6ec0-2631-43ff-b156-b536d5acc06e None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:15.507807 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e2eb6ec0-2631-43ff-b156-b536d5acc06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:15.552535 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:15.565968 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf55ea4-9b4d-4b51-abe9-3010f3f7d032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:15.567309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf55ea4-9b4d-4b51-abe9-3010f3f7d032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.570506 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf55ea4-9b4d-4b51-abe9-3010f3f7d032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.570925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf55ea4-9b4d-4b51-abe9-3010f3f7d032 admin admin] PATH_INFO: `/v3/projects/ca0241fa078d411797d1e0b6abb24cae/users/4cfb68cf01ac446b80db57759415259a/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.576050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf55ea4-9b4d-4b51-abe9-3010f3f7d032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0241fa078d411797d1e0b6abb24cae, user_id=4cfb68cf01ac446b80db57759415259a, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:15.576050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf55ea4-9b4d-4b51-abe9-3010f3f7d032 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:15.577342 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 960/1920] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:15.578376 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb6ec0-2631-43ff-b156-b536d5acc06e None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:15.591858 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 961/1921] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:15 2022] PUT /identity/v3/projects/ca0241fa078d411797d1e0b6abb24cae/users/4cfb68cf01ac446b80db57759415259a/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:15.592649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb6ec0-2631-43ff-b156-b536d5acc06e None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:15.592767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf55ea4-9b4d-4b51-abe9-3010f3f7d032 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:15.594428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-baf55ea4-9b4d-4b51-abe9-3010f3f7d032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:15.659454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf55ea4-9b4d-4b51-abe9-3010f3f7d032 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:15.663965 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fd76d-070c-4a98-98e4-1fdab7378867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:15.664659 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fd76d-070c-4a98-98e4-1fdab7378867 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.665986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fd76d-070c-4a98-98e4-1fdab7378867 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.666324 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fd76d-070c-4a98-98e4-1fdab7378867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.683636 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f33ce-3ef0-4d95-8aac-6b4d1c9539af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:15.684276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f33ce-3ef0-4d95-8aac-6b4d1c9539af admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.684518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f33ce-3ef0-4d95-8aac-6b4d1c9539af admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.684784 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f33ce-3ef0-4d95-8aac-6b4d1c9539af admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.685457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f33ce-3ef0-4d95-8aac-6b4d1c9539af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:15.687547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f33ce-3ef0-4d95-8aac-6b4d1c9539af admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:15.715892 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 961/1922] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:15 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:15.717237 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63329d-54d1-4a77-8d82-dd8b125f7d56 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.717529 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63329d-54d1-4a77-8d82-dd8b125f7d56 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.717803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63329d-54d1-4a77-8d82-dd8b125f7d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.759730 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-fe63329d-54d1-4a77-8d82-dd8b125f7d56 None None] MFA Rules not processed for user `4cfb68cf01ac446b80db57759415259a`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:15.760958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-fe63329d-54d1-4a77-8d82-dd8b125f7d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:15.774305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fd76d-070c-4a98-98e4-1fdab7378867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:15.776602 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fd76d-070c-4a98-98e4-1fdab7378867 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:15.788005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 962/1923] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:15.789479 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fd76d-070c-4a98-98e4-1fdab7378867 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:15.801053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fd76d-070c-4a98-98e4-1fdab7378867 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:15.806452 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb66d31-c3dd-4bac-ae4c-2db92f2b4cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:15.807323 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb66d31-c3dd-4bac-ae4c-2db92f2b4cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.807729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb66d31-c3dd-4bac-ae4c-2db92f2b4cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.808007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb66d31-c3dd-4bac-ae4c-2db92f2b4cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.808681 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb66d31-c3dd-4bac-ae4c-2db92f2b4cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:15.810442 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb66d31-c3dd-4bac-ae4c-2db92f2b4cc3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:15.827253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 963/1924] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:15.828531 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb66d31-c3dd-4bac-ae4c-2db92f2b4cc3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:15.842667 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 962/1925] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:15.844468 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb66d31-c3dd-4bac-ae4c-2db92f2b4cc3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:15.857027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0efbf-163c-4438-a059-608e655aaa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:15.858033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0efbf-163c-4438-a059-608e655aaa85 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.858395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0efbf-163c-4438-a059-608e655aaa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.858630 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0efbf-163c-4438-a059-608e655aaa85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.859915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0efbf-163c-4438-a059-608e655aaa85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:15.860152 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63329d-54d1-4a77-8d82-dd8b125f7d56 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:15.861574 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-fe63329d-54d1-4a77-8d82-dd8b125f7d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:15.862301 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0efbf-163c-4438-a059-608e655aaa85 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:15.876814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:15.885178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 964/1926] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:15.889638 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0efbf-163c-4438-a059-608e655aaa85 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:15.904585 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0efbf-163c-4438-a059-608e655aaa85 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:15.911404 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db6ca0-fb64-45b6-a782-73af1b055497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:15.912328 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db6ca0-fb64-45b6-a782-73af1b055497 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.912775 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db6ca0-fb64-45b6-a782-73af1b055497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.913525 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db6ca0-fb64-45b6-a782-73af1b055497 admin admin] PATH_INFO: `/v3/projects/6ee09808668f484c9164bb1c4a35f17b/users/b1a677deace64c7bb290de26a890c074/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.932020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db6ca0-fb64-45b6-a782-73af1b055497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee09808668f484c9164bb1c4a35f17b, user_id=b1a677deace64c7bb290de26a890c074, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:15.934308 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db6ca0-fb64-45b6-a782-73af1b055497 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:15.968166 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 965/1927] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:15 2022] PUT /identity/v3/projects/6ee09808668f484c9164bb1c4a35f17b/users/b1a677deace64c7bb290de26a890c074/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:15.983363 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69179afe-5c91-480e-a2e1-4fe6c73d961c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.983786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69179afe-5c91-480e-a2e1-4fe6c73d961c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.984152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69179afe-5c91-480e-a2e1-4fe6c73d961c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.994326 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63329d-54d1-4a77-8d82-dd8b125f7d56 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:16.045976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-69179afe-5c91-480e-a2e1-4fe6c73d961c None None] MFA Rules not processed for user `b1a677deace64c7bb290de26a890c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:16.047551 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-69179afe-5c91-480e-a2e1-4fe6c73d961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:16.084328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8781dcf-cb16-424d-8f2f-efc0610e93d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:16.086772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8781dcf-cb16-424d-8f2f-efc0610e93d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:16.087616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8781dcf-cb16-424d-8f2f-efc0610e93d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:16.089001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8781dcf-cb16-424d-8f2f-efc0610e93d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:16.112944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:16.151871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 966/1928] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:16.164005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69179afe-5c91-480e-a2e1-4fe6c73d961c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:16.165682 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-69179afe-5c91-480e-a2e1-4fe6c73d961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:16.179676 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69179afe-5c91-480e-a2e1-4fe6c73d961c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:16.184244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201e8de-2995-43f4-9ee9-7caf95679a6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:16.184856 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201e8de-2995-43f4-9ee9-7caf95679a6f service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:16.185137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201e8de-2995-43f4-9ee9-7caf95679a6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:16.185411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201e8de-2995-43f4-9ee9-7caf95679a6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:16.185709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8781dcf-cb16-424d-8f2f-efc0610e93d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:16.187335 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8781dcf-cb16-424d-8f2f-efc0610e93d2 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:16.196842 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201e8de-2995-43f4-9ee9-7caf95679a6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:16.198265 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201e8de-2995-43f4-9ee9-7caf95679a6f service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:16.202643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 963/1929] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:33:16.203679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8781dcf-cb16-424d-8f2f-efc0610e93d2 service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:16.205162 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f8781dcf-cb16-424d-8f2f-efc0610e93d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:16.211404 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 967/1930] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:33:16.239841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201e8de-2995-43f4-9ee9-7caf95679a6f service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:16.299666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8781dcf-cb16-424d-8f2f-efc0610e93d2 service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:16.305535 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3560613-d8f9-469b-9b23-e70a7156cf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:16.307033 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3560613-d8f9-469b-9b23-e70a7156cf46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:16.307331 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3560613-d8f9-469b-9b23-e70a7156cf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:16.307618 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3560613-d8f9-469b-9b23-e70a7156cf46 admin admin] PATH_INFO: `/v3/projects/ac362025f7c040b4a18a214f88aa7dc0` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:16.308624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201e8de-2995-43f4-9ee9-7caf95679a6f service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:16.308757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3560613-d8f9-469b-9b23-e70a7156cf46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac362025f7c040b4a18a214f88aa7dc0)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:16.310631 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3560613-d8f9-469b-9b23-e70a7156cf46 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:16.314052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504a917-a65a-4096-9fec-3b8645b8db54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:16.314863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504a917-a65a-4096-9fec-3b8645b8db54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:16.315214 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504a917-a65a-4096-9fec-3b8645b8db54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:16.315557 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504a917-a65a-4096-9fec-3b8645b8db54 admin admin] PATH_INFO: `/v3/users/b1a677deace64c7bb290de26a890c074` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:16.316781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504a917-a65a-4096-9fec-3b8645b8db54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a677deace64c7bb290de26a890c074)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:16.319896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504a917-a65a-4096-9fec-3b8645b8db54 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:16.322632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:16.376603 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b3560613-d8f9-469b-9b23-e70a7156cf46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac362025f7c040b4a18a214f88aa7dc0', 'request_id': 'req-b3560613-d8f9-469b-9b23-e70a7156cf46'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:16.380458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1504a917-a65a-4096-9fec-3b8645b8db54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a677deace64c7bb290de26a890c074'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:16.382224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1504a917-a65a-4096-9fec-3b8645b8db54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a677deace64c7bb290de26a890c074'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:16.385382 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b3560613-d8f9-469b-9b23-e70a7156cf46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac362025f7c040b4a18a214f88aa7dc0', 'request_id': 'req-b3560613-d8f9-469b-9b23-e70a7156cf46'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:16.395727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b3560613-d8f9-469b-9b23-e70a7156cf46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac362025f7c040b4a18a214f88aa7dc0', 'request_id': 'req-b3560613-d8f9-469b-9b23-e70a7156cf46'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:16.407909 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1504a917-a65a-4096-9fec-3b8645b8db54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a677deace64c7bb290de26a890c074'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:16.414963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b3560613-d8f9-469b-9b23-e70a7156cf46 admin admin] The token cache is being invalidate because project ac362025f7c040b4a18a214f88aa7dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:16.417044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b3560613-d8f9-469b-9b23-e70a7156cf46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:16.417431 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b3560613-d8f9-469b-9b23-e70a7156cf46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:16.419549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 964/1931] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:16 2022] DELETE /identity/v3/projects/ac362025f7c040b4a18a214f88aa7dc0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:16.424129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3560613-d8f9-469b-9b23-e70a7156cf46 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:16.424993 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1504a917-a65a-4096-9fec-3b8645b8db54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a677deace64c7bb290de26a890c074'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:16.430582 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b3560613-d8f9-469b-9b23-e70a7156cf46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:16.437814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1504a917-a65a-4096-9fec-3b8645b8db54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a677deace64c7bb290de26a890c074'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:16.450508 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 968/1932] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:16 2022] DELETE /identity/v3/users/b1a677deace64c7bb290de26a890c074 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:16.452910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917bd19-46d3-464c-bcb6-0e7bf91a784f None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:16.453203 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917bd19-46d3-464c-bcb6-0e7bf91a784f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:16.453481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917bd19-46d3-464c-bcb6-0e7bf91a784f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:16.481716 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5917bd19-46d3-464c-bcb6-0e7bf91a784f None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:16.483172 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5917bd19-46d3-464c-bcb6-0e7bf91a784f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:16.539518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3560613-d8f9-469b-9b23-e70a7156cf46 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:16.549740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:16.608549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ef2ad-0694-467c-875d-1154d5cb28f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:16.610508 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ef2ad-0694-467c-875d-1154d5cb28f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:16.619168 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ef2ad-0694-467c-875d-1154d5cb28f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:16.619834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ef2ad-0694-467c-875d-1154d5cb28f0 admin admin] PATH_INFO: `/v3/users/09d4c416219841569cb50bdb03613d4f` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:16.622264 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ef2ad-0694-467c-875d-1154d5cb28f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d4c416219841569cb50bdb03613d4f)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:16.629307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 969/1933] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:16.635259 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ef2ad-0694-467c-875d-1154d5cb28f0 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:16.641814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917bd19-46d3-464c-bcb6-0e7bf91a784f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:16.643579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5917bd19-46d3-464c-bcb6-0e7bf91a784f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:16.732181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-981ef2ad-0694-467c-875d-1154d5cb28f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d4c416219841569cb50bdb03613d4f'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:16.732972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-981ef2ad-0694-467c-875d-1154d5cb28f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d4c416219841569cb50bdb03613d4f'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:16.734229 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:16.772441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-981ef2ad-0694-467c-875d-1154d5cb28f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d4c416219841569cb50bdb03613d4f'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:16.786530 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917bd19-46d3-464c-bcb6-0e7bf91a784f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:16.799909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-981ef2ad-0694-467c-875d-1154d5cb28f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d4c416219841569cb50bdb03613d4f'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:16.808456 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf929ee-e030-4ccd-951a-702fa142e314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:16.809152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf929ee-e030-4ccd-951a-702fa142e314 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:16.809475 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf929ee-e030-4ccd-951a-702fa142e314 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:16.809702 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf929ee-e030-4ccd-951a-702fa142e314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:16.810903 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-981ef2ad-0694-467c-875d-1154d5cb28f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d4c416219841569cb50bdb03613d4f'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:16.814598 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fbf929ee-e030-4ccd-951a-702fa142e314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:16.822961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 965/1934] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:16 2022] DELETE /identity/v3/users/09d4c416219841569cb50bdb03613d4f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:16.839211 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf929ee-e030-4ccd-951a-702fa142e314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:16.840740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf929ee-e030-4ccd-951a-702fa142e314 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:16.869462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ef2ad-0694-467c-875d-1154d5cb28f0 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:16.871693 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-981ef2ad-0694-467c-875d-1154d5cb28f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:16.877570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 970/1935] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:17.018733 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ef2ad-0694-467c-875d-1154d5cb28f0 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:17.024122 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3317a-2a77-46e8-b8ac-c90339112bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:17.025898 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3317a-2a77-46e8-b8ac-c90339112bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:17.026344 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3317a-2a77-46e8-b8ac-c90339112bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:17.026923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3317a-2a77-46e8-b8ac-c90339112bfe admin admin] PATH_INFO: `/v3/users/e1c77825a9a44c91a5e6d82d7eb30146` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:17.030552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3317a-2a77-46e8-b8ac-c90339112bfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1c77825a9a44c91a5e6d82d7eb30146)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:17.033835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3317a-2a77-46e8-b8ac-c90339112bfe admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:17.116162 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-8fb3317a-2a77-46e8-b8ac-c90339112bfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1c77825a9a44c91a5e6d82d7eb30146'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:17.117197 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-8fb3317a-2a77-46e8-b8ac-c90339112bfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1c77825a9a44c91a5e6d82d7eb30146'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:17.158272 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-8fb3317a-2a77-46e8-b8ac-c90339112bfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1c77825a9a44c91a5e6d82d7eb30146'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:17.171691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-8fb3317a-2a77-46e8-b8ac-c90339112bfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1c77825a9a44c91a5e6d82d7eb30146'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:17.186427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-8fb3317a-2a77-46e8-b8ac-c90339112bfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1c77825a9a44c91a5e6d82d7eb30146'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:17.211036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 966/1936] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:16 2022] DELETE /identity/v3/users/e1c77825a9a44c91a5e6d82d7eb30146 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:17.215198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a85ca7-948b-433a-9a0d-6dd06c03724d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:17.215482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a85ca7-948b-433a-9a0d-6dd06c03724d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:17.215754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a85ca7-948b-433a-9a0d-6dd06c03724d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:17.235510 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-12a85ca7-948b-433a-9a0d-6dd06c03724d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:17.236759 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-12a85ca7-948b-433a-9a0d-6dd06c03724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:17.327824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 971/1937] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:17.341598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3317a-2a77-46e8-b8ac-c90339112bfe admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:17.343362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-8fb3317a-2a77-46e8-b8ac-c90339112bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:17.375208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a85ca7-948b-433a-9a0d-6dd06c03724d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:17.377315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-12a85ca7-948b-433a-9a0d-6dd06c03724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:17.395999 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a85ca7-948b-433a-9a0d-6dd06c03724d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:17.417568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc7316-c9b6-404b-b7ba-16ea4777019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:17.418486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc7316-c9b6-404b-b7ba-16ea4777019b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:17.418991 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc7316-c9b6-404b-b7ba-16ea4777019b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:17.419547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc7316-c9b6-404b-b7ba-16ea4777019b admin admin] PATH_INFO: `/v3/projects/6ee09808668f484c9164bb1c4a35f17b` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:17.421218 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:17.424359 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc7316-c9b6-404b-b7ba-16ea4777019b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ee09808668f484c9164bb1c4a35f17b)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:17.428600 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc7316-c9b6-404b-b7ba-16ea4777019b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:17.444213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3317a-2a77-46e8-b8ac-c90339112bfe admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:17.457376 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8b59d-4ce2-4374-86ff-668f9c823d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:17.458100 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8b59d-4ce2-4374-86ff-668f9c823d21 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:17.458722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8b59d-4ce2-4374-86ff-668f9c823d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:17.459062 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8b59d-4ce2-4374-86ff-668f9c823d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:17.486049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8b59d-4ce2-4374-86ff-668f9c823d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:17.487840 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8b59d-4ce2-4374-86ff-668f9c823d21 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:17.511038 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 967/1938] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:17.511493 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8b59d-4ce2-4374-86ff-668f9c823d21 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:17.516451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-46d8b59d-4ce2-4374-86ff-668f9c823d21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:17.529115 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-44bc7316-c9b6-404b-b7ba-16ea4777019b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ee09808668f484c9164bb1c4a35f17b', 'request_id': 'req-44bc7316-c9b6-404b-b7ba-16ea4777019b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:17.537082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-44bc7316-c9b6-404b-b7ba-16ea4777019b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ee09808668f484c9164bb1c4a35f17b', 'request_id': 'req-44bc7316-c9b6-404b-b7ba-16ea4777019b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:17.548141 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-44bc7316-c9b6-404b-b7ba-16ea4777019b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ee09808668f484c9164bb1c4a35f17b', 'request_id': 'req-44bc7316-c9b6-404b-b7ba-16ea4777019b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:17.551479 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8b59d-4ce2-4374-86ff-668f9c823d21 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:17.573433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-44bc7316-c9b6-404b-b7ba-16ea4777019b admin admin] The token cache is being invalidate because project 6ee09808668f484c9164bb1c4a35f17b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:17.573728 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-44bc7316-c9b6-404b-b7ba-16ea4777019b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:17.574661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-44bc7316-c9b6-404b-b7ba-16ea4777019b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:17.576821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 972/1939] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:17 2022] DELETE /identity/v3/projects/6ee09808668f484c9164bb1c4a35f17b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:17.581594 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bc3b6-7886-41e1-ae73-7ddc9625abb3 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:17.581883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bc3b6-7886-41e1-ae73-7ddc9625abb3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:17.582207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bc3b6-7886-41e1-ae73-7ddc9625abb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:17.617519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2e8bc3b6-7886-41e1-ae73-7ddc9625abb3 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:17.621516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2e8bc3b6-7886-41e1-ae73-7ddc9625abb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:17.629550 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:17.676304 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa4cdb-f982-4391-9b4e-06f9eb35f1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:17.677898 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa4cdb-f982-4391-9b4e-06f9eb35f1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:17.678478 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa4cdb-f982-4391-9b4e-06f9eb35f1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:17.678927 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa4cdb-f982-4391-9b4e-06f9eb35f1c6 admin admin] PATH_INFO: `/v3/projects/526f111cab354e609b10ea5e0be184b5` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:17.681652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa4cdb-f982-4391-9b4e-06f9eb35f1c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=526f111cab354e609b10ea5e0be184b5)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:17.683799 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa4cdb-f982-4391-9b4e-06f9eb35f1c6 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:17.708775 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 973/1940] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:17.718026 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8528-2817-402b-918f-67585860bb83 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:17.718377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8528-2817-402b-918f-67585860bb83 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:17.718783 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8528-2817-402b-918f-67585860bb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:17.761026 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b42f8528-2817-402b-918f-67585860bb83 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:17.762410 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b42f8528-2817-402b-918f-67585860bb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:17.765139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c2fa4cdb-f982-4391-9b4e-06f9eb35f1c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526f111cab354e609b10ea5e0be184b5', 'request_id': 'req-c2fa4cdb-f982-4391-9b4e-06f9eb35f1c6'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:17.775985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c2fa4cdb-f982-4391-9b4e-06f9eb35f1c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526f111cab354e609b10ea5e0be184b5', 'request_id': 'req-c2fa4cdb-f982-4391-9b4e-06f9eb35f1c6'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:17.786047 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c2fa4cdb-f982-4391-9b4e-06f9eb35f1c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526f111cab354e609b10ea5e0be184b5', 'request_id': 'req-c2fa4cdb-f982-4391-9b4e-06f9eb35f1c6'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:17.799817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c2fa4cdb-f982-4391-9b4e-06f9eb35f1c6 admin admin] The token cache is being invalidate because project 526f111cab354e609b10ea5e0be184b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:17.800121 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c2fa4cdb-f982-4391-9b4e-06f9eb35f1c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:17.801237 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c2fa4cdb-f982-4391-9b4e-06f9eb35f1c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:17.806853 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 968/1941] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:17 2022] DELETE /identity/v3/projects/526f111cab354e609b10ea5e0be184b5 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:17.808755 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459ee00-efc0-439b-b369-6ef2eb5ba19d None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:17.809042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459ee00-efc0-439b-b369-6ef2eb5ba19d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:17.809329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459ee00-efc0-439b-b369-6ef2eb5ba19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:17.855757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-5459ee00-efc0-439b-b369-6ef2eb5ba19d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:17.856793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5459ee00-efc0-439b-b369-6ef2eb5ba19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:17.892604 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 974/1942] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:17.895953 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f8528-2817-402b-918f-67585860bb83 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:17.914713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f8528-2817-402b-918f-67585860bb83 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:17.929931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6270453-006f-4e68-92c6-1f124b0706be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:17.930737 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6270453-006f-4e68-92c6-1f124b0706be admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:17.931220 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6270453-006f-4e68-92c6-1f124b0706be admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:17.931588 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6270453-006f-4e68-92c6-1f124b0706be admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:17.933377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6270453-006f-4e68-92c6-1f124b0706be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:17.933855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6270453-006f-4e68-92c6-1f124b0706be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:17.935801 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6270453-006f-4e68-92c6-1f124b0706be admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:17.954448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 975/1943] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:33:17.958664 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6270453-006f-4e68-92c6-1f124b0706be admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:17.969139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 969/1944] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:17.976845 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6ed49-cad2-4ede-909d-636aaefb4e25 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:17.977320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6ed49-cad2-4ede-909d-636aaefb4e25 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:17.978349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6ed49-cad2-4ede-909d-636aaefb4e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:17.986269 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6270453-006f-4e68-92c6-1f124b0706be admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:18.002011 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffd117-2f8a-422f-9252-cb4a39cb04a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:18.002781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffd117-2f8a-422f-9252-cb4a39cb04a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:18.003161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffd117-2f8a-422f-9252-cb4a39cb04a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:18.003534 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffd117-2f8a-422f-9252-cb4a39cb04a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:18.004495 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffd117-2f8a-422f-9252-cb4a39cb04a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:18.009476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffd117-2f8a-422f-9252-cb4a39cb04a9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:18.010799 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-49d6ed49-cad2-4ede-909d-636aaefb4e25 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:18.012240 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-49d6ed49-cad2-4ede-909d-636aaefb4e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:18.022297 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 970/1945] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:18.027115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6ed49-cad2-4ede-909d-636aaefb4e25 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:18.042739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6ed49-cad2-4ede-909d-636aaefb4e25 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:18.064420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ce757-e46f-4c8b-b9c3-a2c553ea0260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:18.065306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ce757-e46f-4c8b-b9c3-a2c553ea0260 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:18.065685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ce757-e46f-4c8b-b9c3-a2c553ea0260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:18.066055 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ce757-e46f-4c8b-b9c3-a2c553ea0260 admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:18.066847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ce757-e46f-4c8b-b9c3-a2c553ea0260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:18.067257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ce757-e46f-4c8b-b9c3-a2c553ea0260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:18.070364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 976/1946] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:17 2022] POST /identity/v3/projects => generated 361 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:18.070509 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ce757-e46f-4c8b-b9c3-a2c553ea0260 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:18.074219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffd117-2f8a-422f-9252-cb4a39cb04a9 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:18.079756 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:18.089852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 971/1947] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:33:18.110938 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ce757-e46f-4c8b-b9c3-a2c553ea0260 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:18.130706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ce757-e46f-4c8b-b9c3-a2c553ea0260 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:18.169502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffd117-2f8a-422f-9252-cb4a39cb04a9 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:18.178804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638f6c9-b7ba-4ef6-9095-e9f8bd30ed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:18.179888 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638f6c9-b7ba-4ef6-9095-e9f8bd30ed93 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:18.180740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638f6c9-b7ba-4ef6-9095-e9f8bd30ed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:18.181319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638f6c9-b7ba-4ef6-9095-e9f8bd30ed93 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:18.183145 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638f6c9-b7ba-4ef6-9095-e9f8bd30ed93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:18.185488 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638f6c9-b7ba-4ef6-9095-e9f8bd30ed93 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:18.222568 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f7c2f-c579-47bf-a499-873b5c7ad2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:18.223403 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f7c2f-c579-47bf-a499-873b5c7ad2bd admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:18.223686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f7c2f-c579-47bf-a499-873b5c7ad2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:18.224173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f7c2f-c579-47bf-a499-873b5c7ad2bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:18.224280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 977/1948] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:18 2022] POST /identity/v3/users => generated 281 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:18.224674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f7c2f-c579-47bf-a499-873b5c7ad2bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:18.228106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f7c2f-c579-47bf-a499-873b5c7ad2bd admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:18.232044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638f6c9-b7ba-4ef6-9095-e9f8bd30ed93 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:18.248858 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638f6c9-b7ba-4ef6-9095-e9f8bd30ed93 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:18.256175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5307e5-f3af-4b61-9a32-a5659597ac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:18.258227 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5307e5-f3af-4b61-9a32-a5659597ac83 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:18.258227 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5307e5-f3af-4b61-9a32-a5659597ac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:18.258227 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5307e5-f3af-4b61-9a32-a5659597ac83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:18.258568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5307e5-f3af-4b61-9a32-a5659597ac83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:18.260191 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5307e5-f3af-4b61-9a32-a5659597ac83 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:18.262225 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:18.271089 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 972/1949] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:18 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:18.275777 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f7c2f-c579-47bf-a499-873b5c7ad2bd admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:18.286671 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 978/1950] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:18.288172 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5307e5-f3af-4b61-9a32-a5659597ac83 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:18.300098 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5307e5-f3af-4b61-9a32-a5659597ac83 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:18.362416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f7c2f-c579-47bf-a499-873b5c7ad2bd admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:18.369435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978355c-5f27-4988-b334-2276201688a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:18.370410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978355c-5f27-4988-b334-2276201688a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:18.370825 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978355c-5f27-4988-b334-2276201688a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:18.371192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978355c-5f27-4988-b334-2276201688a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:18.371949 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978355c-5f27-4988-b334-2276201688a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:18.374224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978355c-5f27-4988-b334-2276201688a8 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:18.397918 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac8659-c606-4a76-81e4-77b72f0379ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:18.398721 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac8659-c606-4a76-81e4-77b72f0379ef admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:18.399004 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac8659-c606-4a76-81e4-77b72f0379ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:18.399276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac8659-c606-4a76-81e4-77b72f0379ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:18.400554 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac8659-c606-4a76-81e4-77b72f0379ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:18.402100 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 973/1951] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:18 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:33:18.402226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac8659-c606-4a76-81e4-77b72f0379ef admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:18.406352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978355c-5f27-4988-b334-2276201688a8 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:18.414009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 979/1952] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:18.418533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac8659-c606-4a76-81e4-77b72f0379ef admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:18.419036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978355c-5f27-4988-b334-2276201688a8 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:18.424545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50773ddd-ad9d-43ce-83b0-f04a95652d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:18.425436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50773ddd-ad9d-43ce-83b0-f04a95652d0a admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:18.425907 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50773ddd-ad9d-43ce-83b0-f04a95652d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:18.426411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50773ddd-ad9d-43ce-83b0-f04a95652d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:18.427177 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50773ddd-ad9d-43ce-83b0-f04a95652d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:18.429109 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50773ddd-ad9d-43ce-83b0-f04a95652d0a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:18.438932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac8659-c606-4a76-81e4-77b72f0379ef admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:18.444370 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 974/1953] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:18.445422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50773ddd-ad9d-43ce-83b0-f04a95652d0a admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:18.452113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234445b-acd3-4caa-8770-74e377c069d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:18.452870 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234445b-acd3-4caa-8770-74e377c069d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:18.453146 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234445b-acd3-4caa-8770-74e377c069d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:18.453426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234445b-acd3-4caa-8770-74e377c069d2 admin admin] PATH_INFO: `/v3/projects/99dc569fe17f4ddc8b79285b0309cb16/users/77223a286597498aa9eeebc30e804f2d/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:18.466007 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50773ddd-ad9d-43ce-83b0-f04a95652d0a admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:18.478653 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad003ff-c9f9-4f47-99bc-28591880b732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:18.480615 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad003ff-c9f9-4f47-99bc-28591880b732 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:18.480911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad003ff-c9f9-4f47-99bc-28591880b732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:18.481192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad003ff-c9f9-4f47-99bc-28591880b732 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:18.481857 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad003ff-c9f9-4f47-99bc-28591880b732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:18.485116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad003ff-c9f9-4f47-99bc-28591880b732 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:18.487106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234445b-acd3-4caa-8770-74e377c069d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99dc569fe17f4ddc8b79285b0309cb16, user_id=77223a286597498aa9eeebc30e804f2d, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:18.491847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234445b-acd3-4caa-8770-74e377c069d2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:18.514735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 975/1954] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:18.518135 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad003ff-c9f9-4f47-99bc-28591880b732 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:18.519857 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 980/1955] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:18 2022] PUT /identity/v3/projects/99dc569fe17f4ddc8b79285b0309cb16/users/77223a286597498aa9eeebc30e804f2d/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:18.532141 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0b88e-3307-47ae-beb5-e2b49458b745 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:18.532422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0b88e-3307-47ae-beb5-e2b49458b745 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:18.532722 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0b88e-3307-47ae-beb5-e2b49458b745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:18.535597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad003ff-c9f9-4f47-99bc-28591880b732 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:18.567583 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8ac0b88e-3307-47ae-beb5-e2b49458b745 None None] MFA Rules not processed for user `77223a286597498aa9eeebc30e804f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:18.569049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8ac0b88e-3307-47ae-beb5-e2b49458b745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:18.639855 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:18.663268 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219cc8a-5ef6-4f51-9d2a-6719206cd321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:18.665401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219cc8a-5ef6-4f51-9d2a-6719206cd321 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:18.666130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219cc8a-5ef6-4f51-9d2a-6719206cd321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:18.666520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219cc8a-5ef6-4f51-9d2a-6719206cd321 admin admin] PATH_INFO: `/v3/projects/f798fd76a80d40cbb976902246e19bc5/users/e4ddfe4bec744161910484365ee7b036/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:18.686161 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219cc8a-5ef6-4f51-9d2a-6719206cd321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f798fd76a80d40cbb976902246e19bc5, user_id=e4ddfe4bec744161910484365ee7b036, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:18.690669 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 981/1956] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:18.690852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219cc8a-5ef6-4f51-9d2a-6719206cd321 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:18.720015 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 976/1957] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:18 2022] PUT /identity/v3/projects/f798fd76a80d40cbb976902246e19bc5/users/e4ddfe4bec744161910484365ee7b036/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:18.731548 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521efdb7-d2ef-4cab-bf64-45577165a9ac None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:18.731824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521efdb7-d2ef-4cab-bf64-45577165a9ac None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:18.732102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521efdb7-d2ef-4cab-bf64-45577165a9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:18.737446 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219cc8a-5ef6-4f51-9d2a-6719206cd321 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:18.740116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b219cc8a-5ef6-4f51-9d2a-6719206cd321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:18.768801 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-521efdb7-d2ef-4cab-bf64-45577165a9ac None None] MFA Rules not processed for user `e4ddfe4bec744161910484365ee7b036`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:18.771019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-521efdb7-d2ef-4cab-bf64-45577165a9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:18.848344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:18.849465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219cc8a-5ef6-4f51-9d2a-6719206cd321 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:18.856275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539373ac-cd55-4cfd-8d80-57e70f107ffa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:18.857184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539373ac-cd55-4cfd-8d80-57e70f107ffa service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:18.857569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539373ac-cd55-4cfd-8d80-57e70f107ffa service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:18.858741 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539373ac-cd55-4cfd-8d80-57e70f107ffa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:18.877041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 982/1958] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:18.881453 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521efdb7-d2ef-4cab-bf64-45577165a9ac None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:18.954112 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539373ac-cd55-4cfd-8d80-57e70f107ffa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:18.955744 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539373ac-cd55-4cfd-8d80-57e70f107ffa service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:18.963565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521efdb7-d2ef-4cab-bf64-45577165a9ac None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:18.965584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 977/1959] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:33:18.966921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b50af-83ce-46de-b5ca-6ffdaeb9ad68 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:18.967208 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b50af-83ce-46de-b5ca-6ffdaeb9ad68 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:18.967471 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b50af-83ce-46de-b5ca-6ffdaeb9ad68 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:18.968490 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffeacd-503a-4c6c-b11e-43a4597b0033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:18.968956 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 978/1960] 10.222.0.71 () {54 vars in 921 bytes} [Thu Sep 1 16:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:33:18.969278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffeacd-503a-4c6c-b11e-43a4597b0033 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:18.969562 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffeacd-503a-4c6c-b11e-43a4597b0033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:18.969661 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b50af-83ce-46de-b5ca-6ffdaeb9ad68 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:18.969834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffeacd-503a-4c6c-b11e-43a4597b0033 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:18.970606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ffeacd-503a-4c6c-b11e-43a4597b0033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:18.971227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a60b50af-83ce-46de-b5ca-6ffdaeb9ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:18.972727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ffeacd-503a-4c6c-b11e-43a4597b0033 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:18.994790 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b50af-83ce-46de-b5ca-6ffdaeb9ad68 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:19.001032 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cfed7-dd75-4542-a912-3980934e45c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:19.001941 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cfed7-dd75-4542-a912-3980934e45c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:19.002540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cfed7-dd75-4542-a912-3980934e45c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:19.002540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cfed7-dd75-4542-a912-3980934e45c7 admin admin] PATH_INFO: `/v3/projects/2c900f7e9f484ee08ce96cef8885ccb4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:19.003885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cfed7-dd75-4542-a912-3980934e45c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c900f7e9f484ee08ce96cef8885ccb4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:19.005865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cfed7-dd75-4542-a912-3980934e45c7 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:19.006963 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 983/1961] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:18 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:19.007935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffeacd-503a-4c6c-b11e-43a4597b0033 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:19.060444 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2e7cfed7-dd75-4542-a912-3980934e45c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c900f7e9f484ee08ce96cef8885ccb4', 'request_id': 'req-2e7cfed7-dd75-4542-a912-3980934e45c7'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.067844 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2e7cfed7-dd75-4542-a912-3980934e45c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c900f7e9f484ee08ce96cef8885ccb4', 'request_id': 'req-2e7cfed7-dd75-4542-a912-3980934e45c7'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.074886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffeacd-503a-4c6c-b11e-43a4597b0033 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:19.077961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2e7cfed7-dd75-4542-a912-3980934e45c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c900f7e9f484ee08ce96cef8885ccb4', 'request_id': 'req-2e7cfed7-dd75-4542-a912-3980934e45c7'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.091455 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2e7cfed7-dd75-4542-a912-3980934e45c7 admin admin] The token cache is being invalidate because project 2c900f7e9f484ee08ce96cef8885ccb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:19.091821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2e7cfed7-dd75-4542-a912-3980934e45c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.092561 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2e7cfed7-dd75-4542-a912-3980934e45c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.094345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 979/1962] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:18 2022] DELETE /identity/v3/projects/2c900f7e9f484ee08ce96cef8885ccb4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:19.095450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc68125-4457-43e4-867c-6b3e8f8fc2cd None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:19.095791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc68125-4457-43e4-867c-6b3e8f8fc2cd None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:19.096124 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc68125-4457-43e4-867c-6b3e8f8fc2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:19.116443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-5bc68125-4457-43e4-867c-6b3e8f8fc2cd None None] MFA Rules not processed for user `ed71d63cd24f4a6caf6ebba2c30d3608`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:19.117685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5bc68125-4457-43e4-867c-6b3e8f8fc2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:19.123145 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:19.138840 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bcabaa-f4c7-4478-a3f8-e7c7c0ae2806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:19.139885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcabaa-f4c7-4478-a3f8-e7c7c0ae2806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:19.140164 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcabaa-f4c7-4478-a3f8-e7c7c0ae2806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:19.140438 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcabaa-f4c7-4478-a3f8-e7c7c0ae2806 admin admin] PATH_INFO: `/v3/users/77223a286597498aa9eeebc30e804f2d` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:19.142108 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bcabaa-f4c7-4478-a3f8-e7c7c0ae2806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77223a286597498aa9eeebc30e804f2d)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:19.144054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bcabaa-f4c7-4478-a3f8-e7c7c0ae2806 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:19.171229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:19.206355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-99bcabaa-f4c7-4478-a3f8-e7c7c0ae2806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77223a286597498aa9eeebc30e804f2d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.207337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-99bcabaa-f4c7-4478-a3f8-e7c7c0ae2806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77223a286597498aa9eeebc30e804f2d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.214683 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 980/1963] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Sep 1 16:33:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:19.216163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc68125-4457-43e4-867c-6b3e8f8fc2cd None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:19.217765 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5bc68125-4457-43e4-867c-6b3e8f8fc2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:19.234558 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-99bcabaa-f4c7-4478-a3f8-e7c7c0ae2806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77223a286597498aa9eeebc30e804f2d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.245605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc68125-4457-43e4-867c-6b3e8f8fc2cd None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:19.251944 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d43c26-41f4-444d-ade1-8a64d039dd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:19.253583 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43c26-41f4-444d-ade1-8a64d039dd8a admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:19.254288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43c26-41f4-444d-ade1-8a64d039dd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:19.254777 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43c26-41f4-444d-ade1-8a64d039dd8a admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:19.255909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d43c26-41f4-444d-ade1-8a64d039dd8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:19.256376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-99bcabaa-f4c7-4478-a3f8-e7c7c0ae2806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77223a286597498aa9eeebc30e804f2d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.259260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d43c26-41f4-444d-ade1-8a64d039dd8a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:19.272182 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-99bcabaa-f4c7-4478-a3f8-e7c7c0ae2806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77223a286597498aa9eeebc30e804f2d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.295540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 981/1964] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:19 2022] POST /identity/v3/users => generated 299 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:19.295540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d43c26-41f4-444d-ade1-8a64d039dd8a admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:19.295812 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 984/1965] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:19 2022] DELETE /identity/v3/users/77223a286597498aa9eeebc30e804f2d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:19.295932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d6d43c26-41f4-444d-ade1-8a64d039dd8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:19.296352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc465c4-3a8b-417f-86c1-4ec24ad95ab6 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:19.296533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc465c4-3a8b-417f-86c1-4ec24ad95ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:19.296812 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc465c4-3a8b-417f-86c1-4ec24ad95ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:19.305349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d43c26-41f4-444d-ade1-8a64d039dd8a admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:19.321670 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-6cc465c4-3a8b-417f-86c1-4ec24ad95ab6 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:19.323180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6cc465c4-3a8b-417f-86c1-4ec24ad95ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:19.371396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c44696-f53d-4e81-9790-06252f16ea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:19.372155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c44696-f53d-4e81-9790-06252f16ea6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:19.372970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c44696-f53d-4e81-9790-06252f16ea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:19.373445 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c44696-f53d-4e81-9790-06252f16ea6e admin admin] PATH_INFO: `/v3/users/4cfb68cf01ac446b80db57759415259a` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:19.374955 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c44696-f53d-4e81-9790-06252f16ea6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cfb68cf01ac446b80db57759415259a)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:19.377756 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c44696-f53d-4e81-9790-06252f16ea6e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:19.407176 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 985/1966] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:19.411473 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc465c4-3a8b-417f-86c1-4ec24ad95ab6 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:19.423230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc465c4-3a8b-417f-86c1-4ec24ad95ab6 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:19.429236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854054dc-6dc1-4c16-b675-2d98431e1d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:19.429913 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854054dc-6dc1-4c16-b675-2d98431e1d5c admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:19.430257 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854054dc-6dc1-4c16-b675-2d98431e1d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:19.430596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854054dc-6dc1-4c16-b675-2d98431e1d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:19.431587 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854054dc-6dc1-4c16-b675-2d98431e1d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:19.433136 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854054dc-6dc1-4c16-b675-2d98431e1d5c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:19.437426 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-82c44696-f53d-4e81-9790-06252f16ea6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cfb68cf01ac446b80db57759415259a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.438150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-82c44696-f53d-4e81-9790-06252f16ea6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cfb68cf01ac446b80db57759415259a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.447273 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 986/1967] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:19.447273 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854054dc-6dc1-4c16-b675-2d98431e1d5c admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:19.455168 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-82c44696-f53d-4e81-9790-06252f16ea6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cfb68cf01ac446b80db57759415259a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.456224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-854054dc-6dc1-4c16-b675-2d98431e1d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:19.464346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-82c44696-f53d-4e81-9790-06252f16ea6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cfb68cf01ac446b80db57759415259a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.470338 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854054dc-6dc1-4c16-b675-2d98431e1d5c admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:19.473103 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-82c44696-f53d-4e81-9790-06252f16ea6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cfb68cf01ac446b80db57759415259a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.476745 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1055c0d-5749-4f6c-9e1a-9817a3e7ee35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:19.478268 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1055c0d-5749-4f6c-9e1a-9817a3e7ee35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:19.478631 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1055c0d-5749-4f6c-9e1a-9817a3e7ee35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:19.478913 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1055c0d-5749-4f6c-9e1a-9817a3e7ee35 admin admin] PATH_INFO: `/v3/users/cf4cf6b6c70f44b581749915779a5869` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:19.480078 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1055c0d-5749-4f6c-9e1a-9817a3e7ee35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf4cf6b6c70f44b581749915779a5869)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:19.481995 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1055c0d-5749-4f6c-9e1a-9817a3e7ee35 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:19.482833 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 982/1968] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:19 2022] DELETE /identity/v3/users/4cfb68cf01ac446b80db57759415259a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:19.483720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c44696-f53d-4e81-9790-06252f16ea6e admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:19.485623 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-82c44696-f53d-4e81-9790-06252f16ea6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:19.492139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:19.535841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b1055c0d-5749-4f6c-9e1a-9817a3e7ee35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf4cf6b6c70f44b581749915779a5869'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.537264 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b1055c0d-5749-4f6c-9e1a-9817a3e7ee35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf4cf6b6c70f44b581749915779a5869'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.550294 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b1055c0d-5749-4f6c-9e1a-9817a3e7ee35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf4cf6b6c70f44b581749915779a5869'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.566916 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b1055c0d-5749-4f6c-9e1a-9817a3e7ee35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf4cf6b6c70f44b581749915779a5869'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.575236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b1055c0d-5749-4f6c-9e1a-9817a3e7ee35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf4cf6b6c70f44b581749915779a5869'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:19.577472 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:19.582859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 987/1969] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:19 2022] DELETE /identity/v3/users/cf4cf6b6c70f44b581749915779a5869 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:19.586402 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1055c0d-5749-4f6c-9e1a-9817a3e7ee35 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:19.586402 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b1055c0d-5749-4f6c-9e1a-9817a3e7ee35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:19.589459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c44696-f53d-4e81-9790-06252f16ea6e admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:19.669730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1055c0d-5749-4f6c-9e1a-9817a3e7ee35 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:19.675163 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965e467-7b37-4f9f-b92a-c9df00317746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:19.675867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965e467-7b37-4f9f-b92a-c9df00317746 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:19.676203 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965e467-7b37-4f9f-b92a-c9df00317746 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:19.676534 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965e467-7b37-4f9f-b92a-c9df00317746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:19.678550 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5965e467-7b37-4f9f-b92a-c9df00317746 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:19.683063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c9890-8171-46d5-9b89-7199ebe30111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:19.683691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c9890-8171-46d5-9b89-7199ebe30111 service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:19.684081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c9890-8171-46d5-9b89-7199ebe30111 service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:19.684365 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c9890-8171-46d5-9b89-7199ebe30111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:19.687064 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-946c9890-8171-46d5-9b89-7199ebe30111 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:19.702022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c9890-8171-46d5-9b89-7199ebe30111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:19.704682 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c9890-8171-46d5-9b89-7199ebe30111 service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:19.719182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 983/1970] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:19.720221 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c9890-8171-46d5-9b89-7199ebe30111 service nova] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:19.722079 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-946c9890-8171-46d5-9b89-7199ebe30111 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:19.792444 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965e467-7b37-4f9f-b92a-c9df00317746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:19.794849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965e467-7b37-4f9f-b92a-c9df00317746 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:19.811079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 988/1971] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:19.813129 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c760c-2b97-464d-901e-38f94ee6d64e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:19.813421 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c760c-2b97-464d-901e-38f94ee6d64e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:19.813696 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c760c-2b97-464d-901e-38f94ee6d64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:19.841024 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7b2c760c-2b97-464d-901e-38f94ee6d64e None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:19.843366 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7b2c760c-2b97-464d-901e-38f94ee6d64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:19.858303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 989/1972] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:19.876066 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c760c-2b97-464d-901e-38f94ee6d64e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:19.879827 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c9890-8171-46d5-9b89-7199ebe30111 service nova] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:19.896249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53a198-b310-4e13-921f-fc3c67301848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:19.896943 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53a198-b310-4e13-921f-fc3c67301848 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:19.897222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53a198-b310-4e13-921f-fc3c67301848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:19.897519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53a198-b310-4e13-921f-fc3c67301848 admin admin] PATH_INFO: `/v3/projects/bffe5964705549dcbf218874b064c4f1/users/19be6014bcdf431da05f5d23499cd443/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:19.900281 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c760c-2b97-464d-901e-38f94ee6d64e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:19.908341 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd455b82-24d6-4949-a6e8-689e59360257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:19.909599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd455b82-24d6-4949-a6e8-689e59360257 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:19.910148 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd455b82-24d6-4949-a6e8-689e59360257 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:19.910697 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd455b82-24d6-4949-a6e8-689e59360257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:19.926912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53a198-b310-4e13-921f-fc3c67301848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bffe5964705549dcbf218874b064c4f1, user_id=19be6014bcdf431da05f5d23499cd443, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:19.928339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd455b82-24d6-4949-a6e8-689e59360257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:19.929557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53a198-b310-4e13-921f-fc3c67301848 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:19.931896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd455b82-24d6-4949-a6e8-689e59360257 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:19.951128 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 990/1973] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:19.953644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 984/1974] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:19 2022] PUT /identity/v3/projects/bffe5964705549dcbf218874b064c4f1/users/19be6014bcdf431da05f5d23499cd443/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:19.958169 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd455b82-24d6-4949-a6e8-689e59360257 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:19.973623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd455b82-24d6-4949-a6e8-689e59360257 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:19.974769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53a198-b310-4e13-921f-fc3c67301848 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:19.980827 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1b53a198-b310-4e13-921f-fc3c67301848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:20.004705 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:20.063029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f28b81-a895-4af9-897e-b036829fea8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:20.063647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f28b81-a895-4af9-897e-b036829fea8f admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:20.063930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f28b81-a895-4af9-897e-b036829fea8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:20.064427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f28b81-a895-4af9-897e-b036829fea8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:20.066234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f28b81-a895-4af9-897e-b036829fea8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:20.068185 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f28b81-a895-4af9-897e-b036829fea8f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:20.082295 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 991/1975] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:20.086804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f28b81-a895-4af9-897e-b036829fea8f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:20.097911 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f28b81-a895-4af9-897e-b036829fea8f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:20.104588 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c20f93-6b6c-4b5d-b4d9-8a928e74d060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:20.105385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c20f93-6b6c-4b5d-b4d9-8a928e74d060 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:20.105725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c20f93-6b6c-4b5d-b4d9-8a928e74d060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:20.106076 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c20f93-6b6c-4b5d-b4d9-8a928e74d060 admin admin] PATH_INFO: `/v3/projects/bffe5964705549dcbf218874b064c4f1/users/19be6014bcdf431da05f5d23499cd443/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:20.109441 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c20f93-6b6c-4b5d-b4d9-8a928e74d060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bffe5964705549dcbf218874b064c4f1, user_id=19be6014bcdf431da05f5d23499cd443, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:20.112208 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c20f93-6b6c-4b5d-b4d9-8a928e74d060 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:20.126255 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 992/1976] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:20 2022] PUT /identity/v3/projects/bffe5964705549dcbf218874b064c4f1/users/19be6014bcdf431da05f5d23499cd443/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:20.136984 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bd874-b4eb-4678-858f-7c564c6ca359 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:20.137767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bd874-b4eb-4678-858f-7c564c6ca359 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:20.137767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bd874-b4eb-4678-858f-7c564c6ca359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:20.170726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:20.172089 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53a198-b310-4e13-921f-fc3c67301848 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:20.174802 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b09bd874-b4eb-4678-858f-7c564c6ca359 None None] MFA Rules not processed for user `19be6014bcdf431da05f5d23499cd443`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:20.176749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b09bd874-b4eb-4678-858f-7c564c6ca359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:20.244548 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ccf63-2169-4e93-aec5-dad8682df91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:20.245240 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ccf63-2169-4e93-aec5-dad8682df91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:20.245527 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ccf63-2169-4e93-aec5-dad8682df91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:20.245802 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ccf63-2169-4e93-aec5-dad8682df91c admin admin] PATH_INFO: `/v3/projects/ca0241fa078d411797d1e0b6abb24cae` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:20.247001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ccf63-2169-4e93-aec5-dad8682df91c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0241fa078d411797d1e0b6abb24cae)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:20.248899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ccf63-2169-4e93-aec5-dad8682df91c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:20.265753 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 993/1977] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:20.278446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bd874-b4eb-4678-858f-7c564c6ca359 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:20.280005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b09bd874-b4eb-4678-858f-7c564c6ca359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:20.312855 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3e7ccf63-2169-4e93-aec5-dad8682df91c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0241fa078d411797d1e0b6abb24cae', 'request_id': 'req-3e7ccf63-2169-4e93-aec5-dad8682df91c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.325899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3e7ccf63-2169-4e93-aec5-dad8682df91c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0241fa078d411797d1e0b6abb24cae', 'request_id': 'req-3e7ccf63-2169-4e93-aec5-dad8682df91c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.348686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3e7ccf63-2169-4e93-aec5-dad8682df91c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0241fa078d411797d1e0b6abb24cae', 'request_id': 'req-3e7ccf63-2169-4e93-aec5-dad8682df91c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.374084 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bd874-b4eb-4678-858f-7c564c6ca359 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:20.389622 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3e7ccf63-2169-4e93-aec5-dad8682df91c admin admin] The token cache is being invalidate because project ca0241fa078d411797d1e0b6abb24cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:20.390312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3e7ccf63-2169-4e93-aec5-dad8682df91c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.391832 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3e7ccf63-2169-4e93-aec5-dad8682df91c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.394192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 985/1978] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:19 2022] DELETE /identity/v3/projects/ca0241fa078d411797d1e0b6abb24cae => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:20.397533 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ccf63-2169-4e93-aec5-dad8682df91c admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:20.398953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-3e7ccf63-2169-4e93-aec5-dad8682df91c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:20.445198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b2809-15ff-4857-bf00-22f8f4345be4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:20.446249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b2809-15ff-4857-bf00-22f8f4345be4 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:20.447219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b2809-15ff-4857-bf00-22f8f4345be4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:20.447870 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b2809-15ff-4857-bf00-22f8f4345be4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:20.450011 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3a9b2809-15ff-4857-bf00-22f8f4345be4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:20.455616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:20.482263 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ccf63-2169-4e93-aec5-dad8682df91c admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:20.488666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7702b-3732-49c4-8481-171a3e52c4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:20.489398 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7702b-3732-49c4-8481-171a3e52c4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:20.489724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7702b-3732-49c4-8481-171a3e52c4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:20.490212 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7702b-3732-49c4-8481-171a3e52c4ca admin admin] PATH_INFO: `/v3/projects/99dc569fe17f4ddc8b79285b0309cb16` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:20.491471 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7702b-3732-49c4-8481-171a3e52c4ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=99dc569fe17f4ddc8b79285b0309cb16)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:20.495429 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7702b-3732-49c4-8481-171a3e52c4ca admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:20.534319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b2809-15ff-4857-bf00-22f8f4345be4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:20.535857 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b2809-15ff-4857-bf00-22f8f4345be4 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:20.558822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 994/1979] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:33:20.564440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036db3b3-a941-43ac-8640-a58a4a3db011 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:20.564440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036db3b3-a941-43ac-8640-a58a4a3db011 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:20.564440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036db3b3-a941-43ac-8640-a58a4a3db011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:20.574018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:20.581170 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1cf7702b-3732-49c4-8481-171a3e52c4ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99dc569fe17f4ddc8b79285b0309cb16', 'request_id': 'req-1cf7702b-3732-49c4-8481-171a3e52c4ca'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.587617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-036db3b3-a941-43ac-8640-a58a4a3db011 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:20.588777 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-036db3b3-a941-43ac-8640-a58a4a3db011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:20.591898 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1cf7702b-3732-49c4-8481-171a3e52c4ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99dc569fe17f4ddc8b79285b0309cb16', 'request_id': 'req-1cf7702b-3732-49c4-8481-171a3e52c4ca'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.599482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1cf7702b-3732-49c4-8481-171a3e52c4ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99dc569fe17f4ddc8b79285b0309cb16', 'request_id': 'req-1cf7702b-3732-49c4-8481-171a3e52c4ca'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.637844 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1cf7702b-3732-49c4-8481-171a3e52c4ca admin admin] The token cache is being invalidate because project 99dc569fe17f4ddc8b79285b0309cb16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:20.638448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1cf7702b-3732-49c4-8481-171a3e52c4ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.639297 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1cf7702b-3732-49c4-8481-171a3e52c4ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.641882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 986/1980] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:20 2022] DELETE /identity/v3/projects/99dc569fe17f4ddc8b79285b0309cb16 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:20.642760 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7702b-3732-49c4-8481-171a3e52c4ca admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:20.644678 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1cf7702b-3732-49c4-8481-171a3e52c4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:20.688890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 995/1981] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:20.690604 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036db3b3-a941-43ac-8640-a58a4a3db011 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:20.692862 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-036db3b3-a941-43ac-8640-a58a4a3db011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:20.723458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036db3b3-a941-43ac-8640-a58a4a3db011 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:20.732821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b379e04-28d2-475f-8d12-0c99cdd29365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:20.734050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b379e04-28d2-475f-8d12-0c99cdd29365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:20.734331 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b379e04-28d2-475f-8d12-0c99cdd29365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:20.734607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b379e04-28d2-475f-8d12-0c99cdd29365 admin admin] PATH_INFO: `/v3/users/e4ddfe4bec744161910484365ee7b036` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:20.736300 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b379e04-28d2-475f-8d12-0c99cdd29365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4ddfe4bec744161910484365ee7b036)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:20.739009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b379e04-28d2-475f-8d12-0c99cdd29365 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:20.782801 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7702b-3732-49c4-8481-171a3e52c4ca admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:20.789511 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505500b1-861a-4f3c-8ab7-5a4408293d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:20.790180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505500b1-861a-4f3c-8ab7-5a4408293d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:20.790465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505500b1-861a-4f3c-8ab7-5a4408293d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:20.790780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505500b1-861a-4f3c-8ab7-5a4408293d49 admin admin] PATH_INFO: `/v3/projects/ab9afd7c143544438c68cf4ea49d0ff4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:20.791969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505500b1-861a-4f3c-8ab7-5a4408293d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab9afd7c143544438c68cf4ea49d0ff4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:20.793998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505500b1-861a-4f3c-8ab7-5a4408293d49 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:20.794185 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2b379e04-28d2-475f-8d12-0c99cdd29365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4ddfe4bec744161910484365ee7b036'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.794909 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2b379e04-28d2-475f-8d12-0c99cdd29365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4ddfe4bec744161910484365ee7b036'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.804759 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2b379e04-28d2-475f-8d12-0c99cdd29365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4ddfe4bec744161910484365ee7b036'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.819325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2b379e04-28d2-475f-8d12-0c99cdd29365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4ddfe4bec744161910484365ee7b036'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.829624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2b379e04-28d2-475f-8d12-0c99cdd29365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4ddfe4bec744161910484365ee7b036'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.841799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 996/1982] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:20 2022] DELETE /identity/v3/users/e4ddfe4bec744161910484365ee7b036 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:20.843513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683668ac-a8c9-43ff-9660-ccf93737c5a8 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:20.843799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683668ac-a8c9-43ff-9660-ccf93737c5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:20.844069 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683668ac-a8c9-43ff-9660-ccf93737c5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:20.848919 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-505500b1-861a-4f3c-8ab7-5a4408293d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab9afd7c143544438c68cf4ea49d0ff4', 'request_id': 'req-505500b1-861a-4f3c-8ab7-5a4408293d49'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.859890 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-505500b1-861a-4f3c-8ab7-5a4408293d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab9afd7c143544438c68cf4ea49d0ff4', 'request_id': 'req-505500b1-861a-4f3c-8ab7-5a4408293d49'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.865577 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-683668ac-a8c9-43ff-9660-ccf93737c5a8 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:20.866817 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-683668ac-a8c9-43ff-9660-ccf93737c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:20.867645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-505500b1-861a-4f3c-8ab7-5a4408293d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab9afd7c143544438c68cf4ea49d0ff4', 'request_id': 'req-505500b1-861a-4f3c-8ab7-5a4408293d49'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.880219 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-505500b1-861a-4f3c-8ab7-5a4408293d49 admin admin] The token cache is being invalidate because project ab9afd7c143544438c68cf4ea49d0ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:20.880841 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-505500b1-861a-4f3c-8ab7-5a4408293d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.881280 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-505500b1-861a-4f3c-8ab7-5a4408293d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:20.886695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 987/1983] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:20 2022] DELETE /identity/v3/projects/ab9afd7c143544438c68cf4ea49d0ff4 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:20.886695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089b161-5c35-434f-9385-1e9317f9c533 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:20.886695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089b161-5c35-434f-9385-1e9317f9c533 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:20.886695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089b161-5c35-434f-9385-1e9317f9c533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:20.907826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-5089b161-5c35-434f-9385-1e9317f9c533 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:20.909099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5089b161-5c35-434f-9385-1e9317f9c533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:20.913948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:20.959140 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 997/1984] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:20.960822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deaf52-4106-4883-9a4e-6bb790d87a3e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:20.961108 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deaf52-4106-4883-9a4e-6bb790d87a3e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:20.961381 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deaf52-4106-4883-9a4e-6bb790d87a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:20.983021 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-78deaf52-4106-4883-9a4e-6bb790d87a3e None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:20.984848 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-78deaf52-4106-4883-9a4e-6bb790d87a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:20.986174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 988/1985] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:20.990173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089b161-5c35-434f-9385-1e9317f9c533 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:20.991936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5089b161-5c35-434f-9385-1e9317f9c533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:20.994881 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 998/1986] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:20.996337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8be90-b7ac-4548-900c-b2f891b68926 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:20.996621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8be90-b7ac-4548-900c-b2f891b68926 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:20.996981 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8be90-b7ac-4548-900c-b2f891b68926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:21.008244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089b161-5c35-434f-9385-1e9317f9c533 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:21.014123 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7657cf-4d90-4c4e-a640-f7be6c451687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:21.015549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7657cf-4d90-4c4e-a640-f7be6c451687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:21.015549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7657cf-4d90-4c4e-a640-f7be6c451687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:21.015781 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7657cf-4d90-4c4e-a640-f7be6c451687 admin admin] PATH_INFO: `/v3/users/fb074e19abd64ce78ac9e5b284646975` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:21.017054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7657cf-4d90-4c4e-a640-f7be6c451687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb074e19abd64ce78ac9e5b284646975)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:21.019086 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7657cf-4d90-4c4e-a640-f7be6c451687 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:21.028513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-48c8be90-b7ac-4548-900c-b2f891b68926 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:21.030249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-48c8be90-b7ac-4548-900c-b2f891b68926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:21.042310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 999/1987] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:21.043602 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8be90-b7ac-4548-900c-b2f891b68926 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:21.051942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:21.057046 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8be90-b7ac-4548-900c-b2f891b68926 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:21.064561 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f841db-a484-4432-ada9-612c374fe859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:21.065477 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f841db-a484-4432-ada9-612c374fe859 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:21.065964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f841db-a484-4432-ada9-612c374fe859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:21.066473 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f841db-a484-4432-ada9-612c374fe859 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:21.067379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f841db-a484-4432-ada9-612c374fe859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:21.068041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f841db-a484-4432-ada9-612c374fe859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:21.070546 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f841db-a484-4432-ada9-612c374fe859 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:21.090537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1000/1988] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:33:21.091881 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f841db-a484-4432-ada9-612c374fe859 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:21.095068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e4f841db-a484-4432-ada9-612c374fe859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:21.122244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ba7657cf-4d90-4c4e-a640-f7be6c451687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb074e19abd64ce78ac9e5b284646975'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:21.124253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ba7657cf-4d90-4c4e-a640-f7be6c451687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb074e19abd64ce78ac9e5b284646975'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:21.162296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ba7657cf-4d90-4c4e-a640-f7be6c451687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb074e19abd64ce78ac9e5b284646975'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:21.173208 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ba7657cf-4d90-4c4e-a640-f7be6c451687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb074e19abd64ce78ac9e5b284646975'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:21.183377 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ba7657cf-4d90-4c4e-a640-f7be6c451687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb074e19abd64ce78ac9e5b284646975'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:21.190994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 989/1989] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:20 2022] DELETE /identity/v3/users/fb074e19abd64ce78ac9e5b284646975 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:21.191822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7657cf-4d90-4c4e-a640-f7be6c451687 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:21.193273 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ba7657cf-4d90-4c4e-a640-f7be6c451687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:21.246080 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f841db-a484-4432-ada9-612c374fe859 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:21.318758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6250c0-f478-4145-b7f4-a40682785b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:21.319524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6250c0-f478-4145-b7f4-a40682785b8f service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:21.319896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6250c0-f478-4145-b7f4-a40682785b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:21.320267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6250c0-f478-4145-b7f4-a40682785b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:21.322452 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7657cf-4d90-4c4e-a640-f7be6c451687 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:21.322657 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ea6250c0-f478-4145-b7f4-a40682785b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:21.329676 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac1c6d-716c-4752-b2b5-51aa97a1afb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:21.330583 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac1c6d-716c-4752-b2b5-51aa97a1afb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:21.331311 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac1c6d-716c-4752-b2b5-51aa97a1afb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:21.331694 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac1c6d-716c-4752-b2b5-51aa97a1afb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:21.332524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac1c6d-716c-4752-b2b5-51aa97a1afb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:21.333749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac1c6d-716c-4752-b2b5-51aa97a1afb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:21.339003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac1c6d-716c-4752-b2b5-51aa97a1afb5 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:21.340703 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6250c0-f478-4145-b7f4-a40682785b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:21.342834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6250c0-f478-4145-b7f4-a40682785b8f service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:21.353645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1001/1990] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:21.357276 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 990/1991] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:33:21.358264 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6250c0-f478-4145-b7f4-a40682785b8f service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:21.358827 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac1c6d-716c-4752-b2b5-51aa97a1afb5 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:21.359973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ea6250c0-f478-4145-b7f4-a40682785b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:21.371021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac1c6d-716c-4752-b2b5-51aa97a1afb5 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:21.372971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6250c0-f478-4145-b7f4-a40682785b8f service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:21.377945 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a33726-8d48-4e7c-bb3f-c7895939807c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:21.378543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a33726-8d48-4e7c-bb3f-c7895939807c admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:21.378853 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d2edc-4d08-4de5-8067-b92bb6e703fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:21.379227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a33726-8d48-4e7c-bb3f-c7895939807c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:21.379823 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d2edc-4d08-4de5-8067-b92bb6e703fb admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:21.380256 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d2edc-4d08-4de5-8067-b92bb6e703fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:21.380532 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a33726-8d48-4e7c-bb3f-c7895939807c admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:21.380942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d2edc-4d08-4de5-8067-b92bb6e703fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:21.381410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a33726-8d48-4e7c-bb3f-c7895939807c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:21.382137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d2edc-4d08-4de5-8067-b92bb6e703fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:21.384403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d2edc-4d08-4de5-8067-b92bb6e703fb admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:21.385247 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a33726-8d48-4e7c-bb3f-c7895939807c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:21.408441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:21.420622 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1002/1992] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:21 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:21.425283 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d2edc-4d08-4de5-8067-b92bb6e703fb admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:21.444303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 991/1993] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:21 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:21.448587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a33726-8d48-4e7c-bb3f-c7895939807c admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:21.511790 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d2edc-4d08-4de5-8067-b92bb6e703fb admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:21.528181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a33726-8d48-4e7c-bb3f-c7895939807c admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:21.533868 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d267ce7-6798-4f5a-aed6-cc7e82e993b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:21.534490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d267ce7-6798-4f5a-aed6-cc7e82e993b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:21.534930 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d267ce7-6798-4f5a-aed6-cc7e82e993b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:21.535209 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d267ce7-6798-4f5a-aed6-cc7e82e993b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:21.535885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d267ce7-6798-4f5a-aed6-cc7e82e993b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:21.538676 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d267ce7-6798-4f5a-aed6-cc7e82e993b8 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:21.562207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:21.569483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 992/1994] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:21 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:21.570586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d267ce7-6798-4f5a-aed6-cc7e82e993b8 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:21.583458 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d267ce7-6798-4f5a-aed6-cc7e82e993b8 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:21.595709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27003a7-c2ee-454d-aedf-028e2c34b592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:21.596240 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27003a7-c2ee-454d-aedf-028e2c34b592 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:21.596519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27003a7-c2ee-454d-aedf-028e2c34b592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:21.596797 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27003a7-c2ee-454d-aedf-028e2c34b592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:21.597440 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27003a7-c2ee-454d-aedf-028e2c34b592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:21.599129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27003a7-c2ee-454d-aedf-028e2c34b592 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:21.612966 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb86924-4e31-4a25-ba6e-4afe90a8dfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:21.613590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb86924-4e31-4a25-ba6e-4afe90a8dfdc admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:21.613870 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb86924-4e31-4a25-ba6e-4afe90a8dfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:21.614142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb86924-4e31-4a25-ba6e-4afe90a8dfdc admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:21.614819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb86924-4e31-4a25-ba6e-4afe90a8dfdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:21.616718 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb86924-4e31-4a25-ba6e-4afe90a8dfdc admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:21.632278 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 993/1995] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:21.640041 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27003a7-c2ee-454d-aedf-028e2c34b592 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:21.645497 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1003/1996] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:21 2022] POST /identity/v3/users => generated 284 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:33:21.649652 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb86924-4e31-4a25-ba6e-4afe90a8dfdc admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:21.652852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27003a7-c2ee-454d-aedf-028e2c34b592 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:21.659841 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022540f7-55dd-4de4-a292-79727d08313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:21.660458 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022540f7-55dd-4de4-a292-79727d08313e admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:21.660795 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022540f7-55dd-4de4-a292-79727d08313e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:21.661075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022540f7-55dd-4de4-a292-79727d08313e admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:21.662011 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022540f7-55dd-4de4-a292-79727d08313e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:21.663709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022540f7-55dd-4de4-a292-79727d08313e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:21.666179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb86924-4e31-4a25-ba6e-4afe90a8dfdc admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:21.672921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053e6f1-1381-4615-97e2-d24d5216cde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:21.674081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053e6f1-1381-4615-97e2-d24d5216cde3 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:21.674886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053e6f1-1381-4615-97e2-d24d5216cde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:21.675312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053e6f1-1381-4615-97e2-d24d5216cde3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:21.676310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053e6f1-1381-4615-97e2-d24d5216cde3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:21.678298 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053e6f1-1381-4615-97e2-d24d5216cde3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:21.682786 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 994/1997] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:21.685527 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022540f7-55dd-4de4-a292-79727d08313e admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:21.696612 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1004/1998] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:21.699592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022540f7-55dd-4de4-a292-79727d08313e admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:21.700374 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053e6f1-1381-4615-97e2-d24d5216cde3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:21.713718 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42536a41-42b3-4e5d-82ab-109afd3ff978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:21.714890 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42536a41-42b3-4e5d-82ab-109afd3ff978 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:21.715732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42536a41-42b3-4e5d-82ab-109afd3ff978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:21.716047 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053e6f1-1381-4615-97e2-d24d5216cde3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:21.716613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42536a41-42b3-4e5d-82ab-109afd3ff978 admin admin] PATH_INFO: `/v3/projects/a86f4bcc8a394935a108ee5251164a1a/users/7181a4a541bb40c7867aa326d0734c0d/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:21.721610 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a4c35-e683-4317-97d3-58aeadb1ae0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:21.725087 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a4c35-e683-4317-97d3-58aeadb1ae0b admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:21.725689 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a4c35-e683-4317-97d3-58aeadb1ae0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:21.726230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a4c35-e683-4317-97d3-58aeadb1ae0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:21.727325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a4c35-e683-4317-97d3-58aeadb1ae0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:21.730213 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a4c35-e683-4317-97d3-58aeadb1ae0b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:21.751080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42536a41-42b3-4e5d-82ab-109afd3ff978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86f4bcc8a394935a108ee5251164a1a, user_id=7181a4a541bb40c7867aa326d0734c0d, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:21.756908 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42536a41-42b3-4e5d-82ab-109afd3ff978 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:21.758106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1005/1999] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:21.762425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a4c35-e683-4317-97d3-58aeadb1ae0b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:21.783811 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a4c35-e683-4317-97d3-58aeadb1ae0b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:21.794418 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 995/2000] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:21 2022] PUT /identity/v3/projects/a86f4bcc8a394935a108ee5251164a1a/users/7181a4a541bb40c7867aa326d0734c0d/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:21.795965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bc9d1-49a4-4217-a896-6eada9dfe382 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:21.797716 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bc9d1-49a4-4217-a896-6eada9dfe382 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:21.797992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bc9d1-49a4-4217-a896-6eada9dfe382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:21.847403 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-442bc9d1-49a4-4217-a896-6eada9dfe382 None None] MFA Rules not processed for user `7181a4a541bb40c7867aa326d0734c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:21.848925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-442bc9d1-49a4-4217-a896-6eada9dfe382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:21.879762 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb7c28-3c94-46a3-aa22-6e70712d64fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:21.880437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb7c28-3c94-46a3-aa22-6e70712d64fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:21.880715 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb7c28-3c94-46a3-aa22-6e70712d64fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:21.880988 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb7c28-3c94-46a3-aa22-6e70712d64fb admin admin] PATH_INFO: `/v3/projects/f193a5765c09455fb97c8b7ef6ca7ead/users/da35c95972654ee8a620e12162116db6/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:21.900453 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb7c28-3c94-46a3-aa22-6e70712d64fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f193a5765c09455fb97c8b7ef6ca7ead, user_id=da35c95972654ee8a620e12162116db6, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:21.903943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb7c28-3c94-46a3-aa22-6e70712d64fb admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:21.950405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 996/2001] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:21.951809 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bc9d1-49a4-4217-a896-6eada9dfe382 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:21.956390 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1006/2002] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:21 2022] PUT /identity/v3/projects/f193a5765c09455fb97c8b7ef6ca7ead/users/da35c95972654ee8a620e12162116db6/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:21.968155 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11b7cf-9a16-4266-ab7a-18cb75f5d574 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:21.968320 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11b7cf-9a16-4266-ab7a-18cb75f5d574 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:21.968491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11b7cf-9a16-4266-ab7a-18cb75f5d574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:21.975000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bc9d1-49a4-4217-a896-6eada9dfe382 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:22.030654 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5d11b7cf-9a16-4266-ab7a-18cb75f5d574 None None] MFA Rules not processed for user `da35c95972654ee8a620e12162116db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:22.031784 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5d11b7cf-9a16-4266-ab7a-18cb75f5d574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:22.045352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:22.102201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbea29-a644-4c65-82ae-6b2911eea6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:22.104961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbea29-a644-4c65-82ae-6b2911eea6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:22.105406 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbea29-a644-4c65-82ae-6b2911eea6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:22.105853 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbea29-a644-4c65-82ae-6b2911eea6d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:22.106832 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbea29-a644-4c65-82ae-6b2911eea6d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:22.111175 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbea29-a644-4c65-82ae-6b2911eea6d1 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:22.168387 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 997/2003] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:21 2022] POST /identity/v3/projects => generated 371 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:33:22.169626 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbea29-a644-4c65-82ae-6b2911eea6d1 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:22.177990 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1007/2004] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:22.182924 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11b7cf-9a16-4266-ab7a-18cb75f5d574 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:22.196185 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11b7cf-9a16-4266-ab7a-18cb75f5d574 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:22.217378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:22.317333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbea29-a644-4c65-82ae-6b2911eea6d1 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:22.326003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5673f4-da9e-4230-981b-6a12dec1c177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:22.326962 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5673f4-da9e-4230-981b-6a12dec1c177 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:22.327454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5673f4-da9e-4230-981b-6a12dec1c177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:22.327930 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5673f4-da9e-4230-981b-6a12dec1c177 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:22.328781 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5673f4-da9e-4230-981b-6a12dec1c177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:22.329449 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301c140-83b2-42f6-a22e-47dd2bbd5f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:22.330089 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301c140-83b2-42f6-a22e-47dd2bbd5f43 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:22.330370 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301c140-83b2-42f6-a22e-47dd2bbd5f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:22.330744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301c140-83b2-42f6-a22e-47dd2bbd5f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:22.331446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301c140-83b2-42f6-a22e-47dd2bbd5f43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:22.332885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5673f4-da9e-4230-981b-6a12dec1c177 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:22.338925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301c140-83b2-42f6-a22e-47dd2bbd5f43 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:22.370723 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 998/2005] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:22 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:22.371708 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5673f4-da9e-4230-981b-6a12dec1c177 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:22.387445 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5673f4-da9e-4230-981b-6a12dec1c177 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:22.392987 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f17168-fe75-45c3-b9c8-7795c8ca9ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:22.393819 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f17168-fe75-45c3-b9c8-7795c8ca9ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:22.394221 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f17168-fe75-45c3-b9c8-7795c8ca9ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:22.394607 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f17168-fe75-45c3-b9c8-7795c8ca9ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:22.395566 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f17168-fe75-45c3-b9c8-7795c8ca9ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:22.397553 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f17168-fe75-45c3-b9c8-7795c8ca9ac0 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:22.405438 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1008/2006] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:22 2022] POST /identity/v3/projects => generated 365 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:33:22.409330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301c140-83b2-42f6-a22e-47dd2bbd5f43 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:22.411294 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 999/2007] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:22.417092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f17168-fe75-45c3-b9c8-7795c8ca9ac0 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:22.430195 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f17168-fe75-45c3-b9c8-7795c8ca9ac0 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:22.485417 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301c140-83b2-42f6-a22e-47dd2bbd5f43 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:22.500669 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397df125-4f08-4e89-b1bc-c57e3eb4a877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:22.501445 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397df125-4f08-4e89-b1bc-c57e3eb4a877 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:22.502152 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397df125-4f08-4e89-b1bc-c57e3eb4a877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:22.502574 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397df125-4f08-4e89-b1bc-c57e3eb4a877 admin admin] PATH_INFO: `/v3/projects/a80bd538a1a443389576b12e7c8e6a67/users/65defba037434324a43f641d32a6b091/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:22.502703 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a1889-f5a5-4a37-a9e3-39101f0d95a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:22.503293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a1889-f5a5-4a37-a9e3-39101f0d95a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:22.503569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a1889-f5a5-4a37-a9e3-39101f0d95a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:22.503862 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a1889-f5a5-4a37-a9e3-39101f0d95a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:22.504501 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a1889-f5a5-4a37-a9e3-39101f0d95a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:22.506402 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a1889-f5a5-4a37-a9e3-39101f0d95a5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:22.535210 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397df125-4f08-4e89-b1bc-c57e3eb4a877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80bd538a1a443389576b12e7c8e6a67, user_id=65defba037434324a43f641d32a6b091, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:22.538655 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1009/2008] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:22 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:33:22.541125 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a1889-f5a5-4a37-a9e3-39101f0d95a5 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:22.542992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397df125-4f08-4e89-b1bc-c57e3eb4a877 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:22.554606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a1889-f5a5-4a37-a9e3-39101f0d95a5 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:22.558776 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1000/2009] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:22 2022] PUT /identity/v3/projects/a80bd538a1a443389576b12e7c8e6a67/users/65defba037434324a43f641d32a6b091/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:22.561993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397df125-4f08-4e89-b1bc-c57e3eb4a877 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:22.577780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:22.647771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b62417-b6bd-48db-9f03-4e6890b2d424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:22.648388 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b62417-b6bd-48db-9f03-4e6890b2d424 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:22.648665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b62417-b6bd-48db-9f03-4e6890b2d424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:22.648937 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b62417-b6bd-48db-9f03-4e6890b2d424 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:22.650144 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b62417-b6bd-48db-9f03-4e6890b2d424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:22.653867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b62417-b6bd-48db-9f03-4e6890b2d424 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:22.661328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397df125-4f08-4e89-b1bc-c57e3eb4a877 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:22.669192 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1010/2010] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:22.670642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b62417-b6bd-48db-9f03-4e6890b2d424 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:22.671472 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9b419-014a-44ff-a47e-64fd770e6a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:22.672295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9b419-014a-44ff-a47e-64fd770e6a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:22.672643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9b419-014a-44ff-a47e-64fd770e6a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:22.672989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9b419-014a-44ff-a47e-64fd770e6a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:22.673742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9b419-014a-44ff-a47e-64fd770e6a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:22.675706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9b419-014a-44ff-a47e-64fd770e6a43 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:22.683908 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b62417-b6bd-48db-9f03-4e6890b2d424 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:22.688327 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1001/2011] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:22.689831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a9af5-96ef-400b-b020-31e2420d8716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:22.690492 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a9af5-96ef-400b-b020-31e2420d8716 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:22.690815 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a9af5-96ef-400b-b020-31e2420d8716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:22.691159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a9af5-96ef-400b-b020-31e2420d8716 admin admin] PATH_INFO: `/v3/projects/a85416e5fa2c4ad49488c7e8f6eda8da/users/e603a96d92574b5f87b0784d5718d95b/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:22.692127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9b419-014a-44ff-a47e-64fd770e6a43 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:22.702042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9b419-014a-44ff-a47e-64fd770e6a43 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:22.707132 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff3e1d-55ce-407b-8279-dfea01599611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:22.707938 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff3e1d-55ce-407b-8279-dfea01599611 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:22.708224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff3e1d-55ce-407b-8279-dfea01599611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:22.708545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff3e1d-55ce-407b-8279-dfea01599611 admin admin] PATH_INFO: `/v3/projects/a80bd538a1a443389576b12e7c8e6a67/users/65defba037434324a43f641d32a6b091/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:22.710829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a9af5-96ef-400b-b020-31e2420d8716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85416e5fa2c4ad49488c7e8f6eda8da, user_id=e603a96d92574b5f87b0784d5718d95b, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:22.710951 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff3e1d-55ce-407b-8279-dfea01599611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80bd538a1a443389576b12e7c8e6a67, user_id=65defba037434324a43f641d32a6b091, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:22.715980 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff3e1d-55ce-407b-8279-dfea01599611 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:22.722173 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a9af5-96ef-400b-b020-31e2420d8716 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:22.726902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1002/2012] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:22 2022] PUT /identity/v3/projects/a80bd538a1a443389576b12e7c8e6a67/users/65defba037434324a43f641d32a6b091/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:22.745496 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ca7f5-1382-4d3c-a0ea-de403bbbe226 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:22.746067 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ca7f5-1382-4d3c-a0ea-de403bbbe226 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:22.746788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ca7f5-1382-4d3c-a0ea-de403bbbe226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:22.750725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1011/2013] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:22 2022] PUT /identity/v3/projects/a85416e5fa2c4ad49488c7e8f6eda8da/users/e603a96d92574b5f87b0784d5718d95b/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:22.757292 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a9af5-96ef-400b-b020-31e2420d8716 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:22.772093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:22.800010 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-e01ca7f5-1382-4d3c-a0ea-de403bbbe226 None None] MFA Rules not processed for user `65defba037434324a43f641d32a6b091`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:22.801771 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e01ca7f5-1382-4d3c-a0ea-de403bbbe226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:22.880230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a9af5-96ef-400b-b020-31e2420d8716 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:22.884689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1003/2014] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:22.885940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ca7f5-1382-4d3c-a0ea-de403bbbe226 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:22.887259 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e01ca7f5-1382-4d3c-a0ea-de403bbbe226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:22.889037 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b53e6-10db-4ad5-a23b-4fef953ee653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:22.889818 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b53e6-10db-4ad5-a23b-4fef953ee653 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:22.891024 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b53e6-10db-4ad5-a23b-4fef953ee653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:22.891448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b53e6-10db-4ad5-a23b-4fef953ee653 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:22.892362 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b53e6-10db-4ad5-a23b-4fef953ee653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:22.894136 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b53e6-10db-4ad5-a23b-4fef953ee653 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:22.901933 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ca7f5-1382-4d3c-a0ea-de403bbbe226 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:22.906820 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1012/2015] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:22.906942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a69f69-001d-4958-a88c-86e1f2ee207d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:22.907643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a69f69-001d-4958-a88c-86e1f2ee207d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:22.907927 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a69f69-001d-4958-a88c-86e1f2ee207d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:22.908015 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b53e6-10db-4ad5-a23b-4fef953ee653 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:22.908200 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a69f69-001d-4958-a88c-86e1f2ee207d admin admin] PATH_INFO: `/v3/projects/f798fd76a80d40cbb976902246e19bc5` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:22.910759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a69f69-001d-4958-a88c-86e1f2ee207d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f798fd76a80d40cbb976902246e19bc5)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:22.911464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e03b53e6-10db-4ad5-a23b-4fef953ee653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:22.912665 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a69f69-001d-4958-a88c-86e1f2ee207d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:22.925932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b53e6-10db-4ad5-a23b-4fef953ee653 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:22.931842 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:22.932575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:22.932899 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:22.933229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255 admin admin] PATH_INFO: `/v3/projects/d180884c66c9487da139853b7db4436c` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:22.934452 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d180884c66c9487da139853b7db4436c)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:22.936451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:22.974376 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b1a69f69-001d-4958-a88c-86e1f2ee207d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f798fd76a80d40cbb976902246e19bc5', 'request_id': 'req-b1a69f69-001d-4958-a88c-86e1f2ee207d'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:22.983659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b1a69f69-001d-4958-a88c-86e1f2ee207d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f798fd76a80d40cbb976902246e19bc5', 'request_id': 'req-b1a69f69-001d-4958-a88c-86e1f2ee207d'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:22.990464 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b1a69f69-001d-4958-a88c-86e1f2ee207d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f798fd76a80d40cbb976902246e19bc5', 'request_id': 'req-b1a69f69-001d-4958-a88c-86e1f2ee207d'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.000377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd180884c66c9487da139853b7db4436c', 'request_id': 'req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.003535 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b1a69f69-001d-4958-a88c-86e1f2ee207d admin admin] The token cache is being invalidate because project f798fd76a80d40cbb976902246e19bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:23.003899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b1a69f69-001d-4958-a88c-86e1f2ee207d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.004579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-b1a69f69-001d-4958-a88c-86e1f2ee207d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.006398 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1004/2016] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:22 2022] DELETE /identity/v3/projects/f798fd76a80d40cbb976902246e19bc5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:23.007090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a69f69-001d-4958-a88c-86e1f2ee207d admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:23.008507 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b1a69f69-001d-4958-a88c-86e1f2ee207d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:23.010903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd180884c66c9487da139853b7db4436c', 'request_id': 'req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.015282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:23.020196 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd180884c66c9487da139853b7db4436c', 'request_id': 'req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.038117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255 admin admin] The token cache is being invalidate because project d180884c66c9487da139853b7db4436c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:23.038825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.039998 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.041433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1013/2017] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:22 2022] DELETE /identity/v3/projects/d180884c66c9487da139853b7db4436c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:23.042605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:23.044028 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:23.075749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a69f69-001d-4958-a88c-86e1f2ee207d admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:23.123465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9fae2-b3c6-4462-a6d5-2de440a3e255 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:23.128813 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d262b34-f31d-4a0b-a3e2-0477983b99fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:23.130454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d262b34-f31d-4a0b-a3e2-0477983b99fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:23.130791 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d262b34-f31d-4a0b-a3e2-0477983b99fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:23.131075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d262b34-f31d-4a0b-a3e2-0477983b99fb admin admin] PATH_INFO: `/v3/projects/a85416e5fa2c4ad49488c7e8f6eda8da/users/e603a96d92574b5f87b0784d5718d95b/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:23.134460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d262b34-f31d-4a0b-a3e2-0477983b99fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85416e5fa2c4ad49488c7e8f6eda8da, user_id=e603a96d92574b5f87b0784d5718d95b, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:23.137293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d262b34-f31d-4a0b-a3e2-0477983b99fb admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:23.141432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314d293-055f-44c0-9f8f-20f366c7debd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:23.142045 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314d293-055f-44c0-9f8f-20f366c7debd service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:23.142319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314d293-055f-44c0-9f8f-20f366c7debd service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:23.142585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314d293-055f-44c0-9f8f-20f366c7debd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:23.144407 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6314d293-055f-44c0-9f8f-20f366c7debd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:23.148190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1014/2018] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:23 2022] PUT /identity/v3/projects/a85416e5fa2c4ad49488c7e8f6eda8da/users/e603a96d92574b5f87b0784d5718d95b/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:23.148767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d262b34-f31d-4a0b-a3e2-0477983b99fb admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:23.152107 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4d262b34-f31d-4a0b-a3e2-0477983b99fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:23.173053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:23.205886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314d293-055f-44c0-9f8f-20f366c7debd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:23.207452 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314d293-055f-44c0-9f8f-20f366c7debd service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:23.216447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1005/2019] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:23.217905 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8ec87-8d4f-4347-b9df-2406046d7100 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:23.217905 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8ec87-8d4f-4347-b9df-2406046d7100 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:23.218193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8ec87-8d4f-4347-b9df-2406046d7100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:23.221726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d262b34-f31d-4a0b-a3e2-0477983b99fb admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:23.226444 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1da97d-e353-4897-bac7-307eee14c938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:23.227113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1da97d-e353-4897-bac7-307eee14c938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:23.227396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1da97d-e353-4897-bac7-307eee14c938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:23.228218 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1da97d-e353-4897-bac7-307eee14c938 admin admin] PATH_INFO: `/v3/users/19be6014bcdf431da05f5d23499cd443` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:23.229367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1da97d-e353-4897-bac7-307eee14c938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19be6014bcdf431da05f5d23499cd443)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:23.231455 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1da97d-e353-4897-bac7-307eee14c938 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:23.240900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-bea8ec87-8d4f-4347-b9df-2406046d7100 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:23.242623 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-bea8ec87-8d4f-4347-b9df-2406046d7100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:23.260603 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1006/2020] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:23.260603 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960e1f3-e116-4810-95ce-3471795ef463 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:23.260603 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960e1f3-e116-4810-95ce-3471795ef463 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:23.260603 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960e1f3-e116-4810-95ce-3471795ef463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:23.284227 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5d1da97d-e353-4897-bac7-307eee14c938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19be6014bcdf431da05f5d23499cd443'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.285103 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5d1da97d-e353-4897-bac7-307eee14c938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19be6014bcdf431da05f5d23499cd443'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.292352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-6960e1f3-e116-4810-95ce-3471795ef463 None None] MFA Rules not processed for user `e603a96d92574b5f87b0784d5718d95b`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:23.293843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6960e1f3-e116-4810-95ce-3471795ef463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:23.295763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5d1da97d-e353-4897-bac7-307eee14c938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19be6014bcdf431da05f5d23499cd443'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.311484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5d1da97d-e353-4897-bac7-307eee14c938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19be6014bcdf431da05f5d23499cd443'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.320001 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5d1da97d-e353-4897-bac7-307eee14c938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19be6014bcdf431da05f5d23499cd443'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.330859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1015/2021] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:23 2022] DELETE /identity/v3/users/19be6014bcdf431da05f5d23499cd443 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:23.330859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9c100-81ae-4353-9df2-b13821eb27a3 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:23.330859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9c100-81ae-4353-9df2-b13821eb27a3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:23.330859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9c100-81ae-4353-9df2-b13821eb27a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:23.351101 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-01c9c100-81ae-4353-9df2-b13821eb27a3 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:23.353902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-01c9c100-81ae-4353-9df2-b13821eb27a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:23.361089 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:23.378077 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1007/2022] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:23.392840 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960e1f3-e116-4810-95ce-3471795ef463 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:23.394563 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6960e1f3-e116-4810-95ce-3471795ef463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:23.441906 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1016/2023] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:23.443286 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9c100-81ae-4353-9df2-b13821eb27a3 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:23.455097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9c100-81ae-4353-9df2-b13821eb27a3 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:23.461546 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14743d-446a-4088-bb41-5b6005208344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:23.462410 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14743d-446a-4088-bb41-5b6005208344 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:23.462795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14743d-446a-4088-bb41-5b6005208344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:23.463137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14743d-446a-4088-bb41-5b6005208344 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:23.463936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14743d-446a-4088-bb41-5b6005208344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:23.464312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14743d-446a-4088-bb41-5b6005208344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:23.465994 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14743d-446a-4088-bb41-5b6005208344 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:23.486719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1017/2024] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:33:23.486911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960e1f3-e116-4810-95ce-3471795ef463 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:23.488545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14743d-446a-4088-bb41-5b6005208344 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:23.501086 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14743d-446a-4088-bb41-5b6005208344 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:23.510676 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5bcd1-4023-4963-955b-dd38db959f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:23.511303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5bcd1-4023-4963-955b-dd38db959f2d admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:23.511747 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5bcd1-4023-4963-955b-dd38db959f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:23.512032 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5bcd1-4023-4963-955b-dd38db959f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:23.512653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5bcd1-4023-4963-955b-dd38db959f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:23.514585 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5bcd1-4023-4963-955b-dd38db959f2d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:23.563905 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:23.583029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1018/2025] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:23 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:23.587862 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5bcd1-4023-4963-955b-dd38db959f2d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:23.592318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecd470-b7bd-47f6-84cb-c87e56c22652 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:23.593202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecd470-b7bd-47f6-84cb-c87e56c22652 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:23.593638 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecd470-b7bd-47f6-84cb-c87e56c22652 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:23.594243 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecd470-b7bd-47f6-84cb-c87e56c22652 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:23.697257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecd470-b7bd-47f6-84cb-c87e56c22652 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:23.699769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecd470-b7bd-47f6-84cb-c87e56c22652 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:23.712819 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1008/2026] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:23.748063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecd470-b7bd-47f6-84cb-c87e56c22652 service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:23.750790 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-77ecd470-b7bd-47f6-84cb-c87e56c22652 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:23.753909 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5bcd1-4023-4963-955b-dd38db959f2d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:23.770315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f4e35-5bfb-4caa-b506-239a7b910449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:23.775390 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f4e35-5bfb-4caa-b506-239a7b910449 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:23.775390 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f4e35-5bfb-4caa-b506-239a7b910449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:23.780014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f4e35-5bfb-4caa-b506-239a7b910449 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:23.781011 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f4e35-5bfb-4caa-b506-239a7b910449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:23.782868 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f4e35-5bfb-4caa-b506-239a7b910449 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:23.797449 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecd470-b7bd-47f6-84cb-c87e56c22652 service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:23.810059 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea08ef0-8eae-4989-88e9-97d211788222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:23.810977 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea08ef0-8eae-4989-88e9-97d211788222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:23.811352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea08ef0-8eae-4989-88e9-97d211788222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:23.812313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea08ef0-8eae-4989-88e9-97d211788222 admin admin] PATH_INFO: `/v3/projects/bffe5964705549dcbf218874b064c4f1` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:23.813237 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea08ef0-8eae-4989-88e9-97d211788222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bffe5964705549dcbf218874b064c4f1)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:23.815619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea08ef0-8eae-4989-88e9-97d211788222 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:23.825979 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1019/2027] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:23 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:33:23.828534 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f4e35-5bfb-4caa-b506-239a7b910449 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:23.840600 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f4e35-5bfb-4caa-b506-239a7b910449 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:23.845508 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47481b-c165-4c49-8d5b-404a77bc9324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:23.846213 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47481b-c165-4c49-8d5b-404a77bc9324 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:23.846567 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47481b-c165-4c49-8d5b-404a77bc9324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:23.846885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47481b-c165-4c49-8d5b-404a77bc9324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:23.847534 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47481b-c165-4c49-8d5b-404a77bc9324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:23.849141 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47481b-c165-4c49-8d5b-404a77bc9324 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:23.859460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1020/2028] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:23.863361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47481b-c165-4c49-8d5b-404a77bc9324 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:23.876762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1ea08ef0-8eae-4989-88e9-97d211788222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bffe5964705549dcbf218874b064c4f1', 'request_id': 'req-1ea08ef0-8eae-4989-88e9-97d211788222'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.881049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:23.887242 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1ea08ef0-8eae-4989-88e9-97d211788222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bffe5964705549dcbf218874b064c4f1', 'request_id': 'req-1ea08ef0-8eae-4989-88e9-97d211788222'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.896288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1ea08ef0-8eae-4989-88e9-97d211788222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bffe5964705549dcbf218874b064c4f1', 'request_id': 'req-1ea08ef0-8eae-4989-88e9-97d211788222'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.908215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1ea08ef0-8eae-4989-88e9-97d211788222 admin admin] The token cache is being invalidate because project bffe5964705549dcbf218874b064c4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:23.908497 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1ea08ef0-8eae-4989-88e9-97d211788222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.909179 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1ea08ef0-8eae-4989-88e9-97d211788222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:23.911011 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1009/2029] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:23 2022] DELETE /identity/v3/projects/bffe5964705549dcbf218874b064c4f1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:23.911780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea08ef0-8eae-4989-88e9-97d211788222 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:23.913105 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1ea08ef0-8eae-4989-88e9-97d211788222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:23.926744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47481b-c165-4c49-8d5b-404a77bc9324 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:23.976193 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2ec94-4d52-4b85-b9ea-f04b6582c6d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:23.976791 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2ec94-4d52-4b85-b9ea-f04b6582c6d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:23.977068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2ec94-4d52-4b85-b9ea-f04b6582c6d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:23.977370 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2ec94-4d52-4b85-b9ea-f04b6582c6d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:23.979752 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d4c2ec94-4d52-4b85-b9ea-f04b6582c6d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:23.982218 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea08ef0-8eae-4989-88e9-97d211788222 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:23.987100 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca7987-785d-4495-94d0-e09b5169496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:23.987706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca7987-785d-4495-94d0-e09b5169496a admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:23.988074 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca7987-785d-4495-94d0-e09b5169496a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:23.988345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca7987-785d-4495-94d0-e09b5169496a admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:23.988982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca7987-785d-4495-94d0-e09b5169496a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:23.990714 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca7987-785d-4495-94d0-e09b5169496a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:24.002607 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1010/2030] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:24.003443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c36c6-afeb-4d78-a692-8c4dd97a267d None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.003727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c36c6-afeb-4d78-a692-8c4dd97a267d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.003999 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c36c6-afeb-4d78-a692-8c4dd97a267d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.023021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-958c36c6-afeb-4d78-a692-8c4dd97a267d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:24.024202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-958c36c6-afeb-4d78-a692-8c4dd97a267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:24.034133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1011/2031] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:24.035089 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c36c6-afeb-4d78-a692-8c4dd97a267d None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:24.036822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:24.046228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c36c6-afeb-4d78-a692-8c4dd97a267d None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:24.052154 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507221e-0e16-4779-8391-c29588ceb159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:24.052817 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2ec94-4d52-4b85-b9ea-f04b6582c6d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:24.053260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507221e-0e16-4779-8391-c29588ceb159 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.053481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507221e-0e16-4779-8391-c29588ceb159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.053849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507221e-0e16-4779-8391-c29588ceb159 admin admin] PATH_INFO: `/v3/projects/2871dd46268e4481b0c99bc8cc010285/users/e08f8e3c1b594042918b67562deb6240/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.054244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2ec94-4d52-4b85-b9ea-f04b6582c6d3 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:24.064012 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1021/2032] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:24.065441 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a4a56-8912-4f7f-bf7b-22dba8b92d80 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.065729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a4a56-8912-4f7f-bf7b-22dba8b92d80 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.066002 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a4a56-8912-4f7f-bf7b-22dba8b92d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.083296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507221e-0e16-4779-8391-c29588ceb159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2871dd46268e4481b0c99bc8cc010285, user_id=e08f8e3c1b594042918b67562deb6240, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:24.086843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507221e-0e16-4779-8391-c29588ceb159 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:24.093629 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-fb8a4a56-8912-4f7f-bf7b-22dba8b92d80 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:24.094955 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fb8a4a56-8912-4f7f-bf7b-22dba8b92d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:24.105138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1012/2033] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:24 2022] PUT /identity/v3/projects/2871dd46268e4481b0c99bc8cc010285/users/e08f8e3c1b594042918b67562deb6240/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:24.117208 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab61e6-28b5-4c5d-8566-6836de540bf6 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.117486 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab61e6-28b5-4c5d-8566-6836de540bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.117758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab61e6-28b5-4c5d-8566-6836de540bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.149235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-a0ab61e6-28b5-4c5d-8566-6836de540bf6 None None] MFA Rules not processed for user `e08f8e3c1b594042918b67562deb6240`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:24.150497 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a0ab61e6-28b5-4c5d-8566-6836de540bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:24.169248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1022/2034] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:24.170799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a4a56-8912-4f7f-bf7b-22dba8b92d80 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:24.195194 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a4a56-8912-4f7f-bf7b-22dba8b92d80 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:24.200914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8073a00-5b03-4660-b411-1b47a6d85520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:24.201530 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8073a00-5b03-4660-b411-1b47a6d85520 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.201808 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8073a00-5b03-4660-b411-1b47a6d85520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.202090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8073a00-5b03-4660-b411-1b47a6d85520 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.202759 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8073a00-5b03-4660-b411-1b47a6d85520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:24.203067 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8073a00-5b03-4660-b411-1b47a6d85520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:24.205158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8073a00-5b03-4660-b411-1b47a6d85520 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:24.220696 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1023/2035] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:33:24.225971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8073a00-5b03-4660-b411-1b47a6d85520 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:24.237209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8073a00-5b03-4660-b411-1b47a6d85520 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:24.249112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55040954-dce6-43a6-8031-f1f6b044e8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:24.250872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55040954-dce6-43a6-8031-f1f6b044e8ad admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.251068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55040954-dce6-43a6-8031-f1f6b044e8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.251319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55040954-dce6-43a6-8031-f1f6b044e8ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.253791 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55040954-dce6-43a6-8031-f1f6b044e8ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:24.254318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1013/2036] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:24.259343 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab61e6-28b5-4c5d-8566-6836de540bf6 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:24.260010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55040954-dce6-43a6-8031-f1f6b044e8ad admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:24.277282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab61e6-28b5-4c5d-8566-6836de540bf6 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:24.284479 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcea8ac-48c0-4344-9478-9e3c18aecdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:24.285168 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcea8ac-48c0-4344-9478-9e3c18aecdde admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.285779 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcea8ac-48c0-4344-9478-9e3c18aecdde admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.285899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcea8ac-48c0-4344-9478-9e3c18aecdde admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.287201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcea8ac-48c0-4344-9478-9e3c18aecdde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:24.289796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcea8ac-48c0-4344-9478-9e3c18aecdde admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:24.316437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1024/2037] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:24 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:33:24.317756 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55040954-dce6-43a6-8031-f1f6b044e8ad admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:24.325178 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1014/2038] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:24 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:24.329502 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcea8ac-48c0-4344-9478-9e3c18aecdde admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:24.354557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:24.407651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55040954-dce6-43a6-8031-f1f6b044e8ad admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:24.463445 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcea8ac-48c0-4344-9478-9e3c18aecdde admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:24.475720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dc818-f547-44c8-8fac-83132ad9a8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:24.478785 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dc818-f547-44c8-8fac-83132ad9a8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.481166 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dc818-f547-44c8-8fac-83132ad9a8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.481526 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dc818-f547-44c8-8fac-83132ad9a8c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.482630 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3dc818-f547-44c8-8fac-83132ad9a8c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:24.484886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3dc818-f547-44c8-8fac-83132ad9a8c1 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:24.532265 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e860f2-42b7-4214-afe8-3935999a763a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:24.532943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e860f2-42b7-4214-afe8-3935999a763a admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.533240 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e860f2-42b7-4214-afe8-3935999a763a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.533528 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e860f2-42b7-4214-afe8-3935999a763a admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.534132 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e860f2-42b7-4214-afe8-3935999a763a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:24.537616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1015/2039] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:24 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:24.537763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e860f2-42b7-4214-afe8-3935999a763a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:24.542044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dc818-f547-44c8-8fac-83132ad9a8c1 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:24.553032 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dc818-f547-44c8-8fac-83132ad9a8c1 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:24.563320 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:24.565751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538cbbf-ade7-41d2-afd5-654d8c03b2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:24.566921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538cbbf-ade7-41d2-afd5-654d8c03b2af admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.567376 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538cbbf-ade7-41d2-afd5-654d8c03b2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.568025 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538cbbf-ade7-41d2-afd5-654d8c03b2af admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.569287 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538cbbf-ade7-41d2-afd5-654d8c03b2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:24.573702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538cbbf-ade7-41d2-afd5-654d8c03b2af admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:24.590854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1025/2040] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:24 2022] POST /identity/v3/users => generated 294 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:24.591046 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1016/2041] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:24.594361 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538cbbf-ade7-41d2-afd5-654d8c03b2af admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:24.594516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e860f2-42b7-4214-afe8-3935999a763a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:24.609002 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e860f2-42b7-4214-afe8-3935999a763a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:24.610734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538cbbf-ade7-41d2-afd5-654d8c03b2af admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:24.614754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6fc42-d7b9-460e-88c5-05d5f7a20463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:24.616346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6fc42-d7b9-460e-88c5-05d5f7a20463 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.616625 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6fc42-d7b9-460e-88c5-05d5f7a20463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.616902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6fc42-d7b9-460e-88c5-05d5f7a20463 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.617557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6fc42-d7b9-460e-88c5-05d5f7a20463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:24.617828 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7e9b5-45e4-48fe-855e-85596019fad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:24.618782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7e9b5-45e4-48fe-855e-85596019fad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.624391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7e9b5-45e4-48fe-855e-85596019fad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.624391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7e9b5-45e4-48fe-855e-85596019fad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.624391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7e9b5-45e4-48fe-855e-85596019fad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:24.625286 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6fc42-d7b9-460e-88c5-05d5f7a20463 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:24.625373 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7e9b5-45e4-48fe-855e-85596019fad7 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:24.637101 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1026/2042] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:24.638781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7e9b5-45e4-48fe-855e-85596019fad7 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:24.642688 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1017/2043] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:24.644254 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6fc42-d7b9-460e-88c5-05d5f7a20463 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:24.649916 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7e9b5-45e4-48fe-855e-85596019fad7 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:24.654860 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a08fd0-10f6-4fb1-bb9a-0095b3a92fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:24.655448 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a08fd0-10f6-4fb1-bb9a-0095b3a92fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.655722 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a08fd0-10f6-4fb1-bb9a-0095b3a92fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.655986 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a08fd0-10f6-4fb1-bb9a-0095b3a92fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.656235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6fc42-d7b9-460e-88c5-05d5f7a20463 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:24.656621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a08fd0-10f6-4fb1-bb9a-0095b3a92fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:24.658253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a08fd0-10f6-4fb1-bb9a-0095b3a92fb1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:24.661894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355b914-56b9-4323-8103-f0730a4c37ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:24.662556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355b914-56b9-4323-8103-f0730a4c37ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.662865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355b914-56b9-4323-8103-f0730a4c37ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.663159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355b914-56b9-4323-8103-f0730a4c37ad admin admin] PATH_INFO: `/v3/projects/5a7f44109a804c33b18ea7ffa910f2c0/users/3c7da21125f5435788f5385b2fff31d7/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.684711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355b914-56b9-4323-8103-f0730a4c37ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7f44109a804c33b18ea7ffa910f2c0, user_id=3c7da21125f5435788f5385b2fff31d7, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:24.688096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355b914-56b9-4323-8103-f0730a4c37ad admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:24.690090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1027/2044] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:24.695300 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a08fd0-10f6-4fb1-bb9a-0095b3a92fb1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:24.707176 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1018/2045] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:24 2022] PUT /identity/v3/projects/5a7f44109a804c33b18ea7ffa910f2c0/users/3c7da21125f5435788f5385b2fff31d7/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:24.708127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a08fd0-10f6-4fb1-bb9a-0095b3a92fb1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:24.718281 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b85cb-ecf9-4e38-9087-4f049053c2e3 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.718690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b85cb-ecf9-4e38-9087-4f049053c2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.719044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b85cb-ecf9-4e38-9087-4f049053c2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.756244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-308b85cb-ecf9-4e38-9087-4f049053c2e3 None None] MFA Rules not processed for user `3c7da21125f5435788f5385b2fff31d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:24.758111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-308b85cb-ecf9-4e38-9087-4f049053c2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:24.772030 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f757c46-8c9d-4935-b9ef-51874ea328d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:24.772684 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f757c46-8c9d-4935-b9ef-51874ea328d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.772961 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f757c46-8c9d-4935-b9ef-51874ea328d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.773231 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f757c46-8c9d-4935-b9ef-51874ea328d2 admin admin] PATH_INFO: `/v3/projects/4a287f9c94ca4644ac3bdddd73b056a7/users/bf76fae9d4ed45179ab8112aab2bfe7a/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.803551 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f757c46-8c9d-4935-b9ef-51874ea328d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a287f9c94ca4644ac3bdddd73b056a7, user_id=bf76fae9d4ed45179ab8112aab2bfe7a, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:24.806449 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f757c46-8c9d-4935-b9ef-51874ea328d2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:24.828857 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1028/2046] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:24 2022] PUT /identity/v3/projects/4a287f9c94ca4644ac3bdddd73b056a7/users/bf76fae9d4ed45179ab8112aab2bfe7a/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:24.842649 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a43a71-e714-450a-b2d4-aebc4b7981c3 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.843152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a43a71-e714-450a-b2d4-aebc4b7981c3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.843632 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a43a71-e714-450a-b2d4-aebc4b7981c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.870799 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1019/2047] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:24.871888 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b85cb-ecf9-4e38-9087-4f049053c2e3 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:24.883427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b85cb-ecf9-4e38-9087-4f049053c2e3 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:24.890809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-83a43a71-e714-450a-b2d4-aebc4b7981c3 None None] MFA Rules not processed for user `bf76fae9d4ed45179ab8112aab2bfe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:24.892033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-83a43a71-e714-450a-b2d4-aebc4b7981c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:24.957764 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:24.982386 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58dd44-d6e8-4351-b9a4-e6fb68126e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:24.983761 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58dd44-d6e8-4351-b9a4-e6fb68126e03 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:24.984335 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58dd44-d6e8-4351-b9a4-e6fb68126e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:24.984754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58dd44-d6e8-4351-b9a4-e6fb68126e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:24.985683 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58dd44-d6e8-4351-b9a4-e6fb68126e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:24.987920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58dd44-d6e8-4351-b9a4-e6fb68126e03 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:24.998705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1029/2048] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:25.005795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a43a71-e714-450a-b2d4-aebc4b7981c3 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:25.019202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1020/2049] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:24 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:25.020788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a43a71-e714-450a-b2d4-aebc4b7981c3 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:25.029343 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58dd44-d6e8-4351-b9a4-e6fb68126e03 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:25.069907 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:25.112192 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a5667-5b44-456a-9794-fa3537fbfd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:25.112802 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a5667-5b44-456a-9794-fa3537fbfd27 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:25.113069 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a5667-5b44-456a-9794-fa3537fbfd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:25.113339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a5667-5b44-456a-9794-fa3537fbfd27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:25.113988 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a5667-5b44-456a-9794-fa3537fbfd27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:25.117411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a5667-5b44-456a-9794-fa3537fbfd27 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:25.140410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58dd44-d6e8-4351-b9a4-e6fb68126e03 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:25.149088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b940a95-05be-48ed-b287-a7675193853f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:25.150901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b940a95-05be-48ed-b287-a7675193853f admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:25.152273 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b940a95-05be-48ed-b287-a7675193853f admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:25.152947 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b940a95-05be-48ed-b287-a7675193853f admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:25.153720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b940a95-05be-48ed-b287-a7675193853f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:25.156274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b940a95-05be-48ed-b287-a7675193853f admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:25.168809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1030/2050] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:25 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:25.173503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a5667-5b44-456a-9794-fa3537fbfd27 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:25.190534 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1021/2051] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:25 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:25.194214 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b940a95-05be-48ed-b287-a7675193853f admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:25.228071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b940a95-05be-48ed-b287-a7675193853f admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:25.283802 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a5667-5b44-456a-9794-fa3537fbfd27 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:25.291561 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d43e2-525d-4443-a9f8-c2a581d0e7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:25.292270 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d43e2-525d-4443-a9f8-c2a581d0e7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:25.293254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d43e2-525d-4443-a9f8-c2a581d0e7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:25.293616 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d43e2-525d-4443-a9f8-c2a581d0e7c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:25.294340 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d43e2-525d-4443-a9f8-c2a581d0e7c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:25.296443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d43e2-525d-4443-a9f8-c2a581d0e7c0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:25.337394 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1031/2052] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:25 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:25.341451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d43e2-525d-4443-a9f8-c2a581d0e7c0 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:25.355176 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78ef28-c442-414a-8712-28737f59818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:25.356020 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78ef28-c442-414a-8712-28737f59818d admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:25.356201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78ef28-c442-414a-8712-28737f59818d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:25.356542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78ef28-c442-414a-8712-28737f59818d admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:25.357151 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78ef28-c442-414a-8712-28737f59818d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:25.358792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78ef28-c442-414a-8712-28737f59818d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:25.362316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d43e2-525d-4443-a9f8-c2a581d0e7c0 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:25.367624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9517261-53d1-4af7-93ea-b77a1aef4b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:25.368675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9517261-53d1-4af7-93ea-b77a1aef4b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:25.369166 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9517261-53d1-4af7-93ea-b77a1aef4b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:25.370436 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9517261-53d1-4af7-93ea-b77a1aef4b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:25.371433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9517261-53d1-4af7-93ea-b77a1aef4b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:25.373250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9517261-53d1-4af7-93ea-b77a1aef4b86 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:25.373496 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1022/2053] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:25.374381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78ef28-c442-414a-8712-28737f59818d admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:25.387671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78ef28-c442-414a-8712-28737f59818d admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:25.387857 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1032/2054] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:25.391219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9517261-53d1-4af7-93ea-b77a1aef4b86 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:25.398738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be06cef-23a2-48cf-88c3-d14ef18182fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:25.399591 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be06cef-23a2-48cf-88c3-d14ef18182fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:25.399874 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be06cef-23a2-48cf-88c3-d14ef18182fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:25.400152 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be06cef-23a2-48cf-88c3-d14ef18182fd admin admin] PATH_INFO: `/v3/projects/45c9bed10c60485ebc2e045dd49ecd89/users/2ea2081b1d2a4e0d8f2e1fdc8844d890/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:25.412817 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9517261-53d1-4af7-93ea-b77a1aef4b86 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:25.421369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e7999-7e37-4cad-a396-0399aa07ffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:25.422043 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e7999-7e37-4cad-a396-0399aa07ffa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:25.422325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e7999-7e37-4cad-a396-0399aa07ffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:25.422597 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e7999-7e37-4cad-a396-0399aa07ffa1 admin admin] PATH_INFO: `/v3/projects/9e1c056aae21412d8221bb45386cf5fb/users/9570dbc191944cbe872b3d8c79f73914/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:25.435436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be06cef-23a2-48cf-88c3-d14ef18182fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c9bed10c60485ebc2e045dd49ecd89, user_id=2ea2081b1d2a4e0d8f2e1fdc8844d890, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:25.447729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e7999-7e37-4cad-a396-0399aa07ffa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e1c056aae21412d8221bb45386cf5fb, user_id=9570dbc191944cbe872b3d8c79f73914, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:25.450824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e7999-7e37-4cad-a396-0399aa07ffa1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:25.451290 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be06cef-23a2-48cf-88c3-d14ef18182fd admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:25.466985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1023/2055] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:25 2022] PUT /identity/v3/projects/45c9bed10c60485ebc2e045dd49ecd89/users/2ea2081b1d2a4e0d8f2e1fdc8844d890/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:25.471096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be06cef-23a2-48cf-88c3-d14ef18182fd admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:25.474819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1033/2056] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:25 2022] PUT /identity/v3/projects/9e1c056aae21412d8221bb45386cf5fb/users/9570dbc191944cbe872b3d8c79f73914/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:25.480099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e7999-7e37-4cad-a396-0399aa07ffa1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:25.530706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:25.579893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be06cef-23a2-48cf-88c3-d14ef18182fd admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:25.587347 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f7b9a-d12e-4a87-970e-71f47580ab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:25.588090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f7b9a-d12e-4a87-970e-71f47580ab87 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:25.588399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f7b9a-d12e-4a87-970e-71f47580ab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:25.588954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f7b9a-d12e-4a87-970e-71f47580ab87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:25.589490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f7b9a-d12e-4a87-970e-71f47580ab87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:25.591191 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e7999-7e37-4cad-a396-0399aa07ffa1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:25.592632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f7b9a-d12e-4a87-970e-71f47580ab87 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:25.607863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1024/2057] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:25.612339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f7b9a-d12e-4a87-970e-71f47580ab87 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:25.631776 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f7b9a-d12e-4a87-970e-71f47580ab87 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:25.631883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c290f-d8da-4608-8dd4-6dca5ef7b91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:25.632533 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f339e97-3efc-4bdc-8b05-1d5de4fb885a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:25.633323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f339e97-3efc-4bdc-8b05-1d5de4fb885a admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:25.634708 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c290f-d8da-4608-8dd4-6dca5ef7b91a admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:25.634811 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f339e97-3efc-4bdc-8b05-1d5de4fb885a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:25.634979 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f339e97-3efc-4bdc-8b05-1d5de4fb885a admin admin] PATH_INFO: `/v3/projects/45c9bed10c60485ebc2e045dd49ecd89/users/2ea2081b1d2a4e0d8f2e1fdc8844d890/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:25.635073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c290f-d8da-4608-8dd4-6dca5ef7b91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:25.635302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c290f-d8da-4608-8dd4-6dca5ef7b91a admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:25.636025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c290f-d8da-4608-8dd4-6dca5ef7b91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:25.638117 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f339e97-3efc-4bdc-8b05-1d5de4fb885a admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c9bed10c60485ebc2e045dd49ecd89, user_id=2ea2081b1d2a4e0d8f2e1fdc8844d890, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:25.642183 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f339e97-3efc-4bdc-8b05-1d5de4fb885a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:25.647899 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c290f-d8da-4608-8dd4-6dca5ef7b91a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:25.657164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1025/2058] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:25 2022] PUT /identity/v3/projects/45c9bed10c60485ebc2e045dd49ecd89/users/2ea2081b1d2a4e0d8f2e1fdc8844d890/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:25.668267 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ca866-3061-487e-a96b-3b8effea5c25 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:25.668549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ca866-3061-487e-a96b-3b8effea5c25 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:25.668826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ca866-3061-487e-a96b-3b8effea5c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:25.673861 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1034/2059] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:25.678042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c290f-d8da-4608-8dd4-6dca5ef7b91a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:25.703224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c290f-d8da-4608-8dd4-6dca5ef7b91a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:25.721779 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-2b9ca866-3061-487e-a96b-3b8effea5c25 None None] MFA Rules not processed for user `2ea2081b1d2a4e0d8f2e1fdc8844d890`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:25.724691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2b9ca866-3061-487e-a96b-3b8effea5c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:25.732165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:25.825032 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec286a-05b3-42c3-857e-07e5aed16e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:25.826019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec286a-05b3-42c3-857e-07e5aed16e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:25.826451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec286a-05b3-42c3-857e-07e5aed16e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:25.827039 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec286a-05b3-42c3-857e-07e5aed16e9c admin admin] PATH_INFO: `/v3/projects/9e1c056aae21412d8221bb45386cf5fb/users/9570dbc191944cbe872b3d8c79f73914/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:25.829212 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec286a-05b3-42c3-857e-07e5aed16e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e1c056aae21412d8221bb45386cf5fb, user_id=9570dbc191944cbe872b3d8c79f73914, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:25.832092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec286a-05b3-42c3-857e-07e5aed16e9c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:25.849216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1026/2060] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:25.853918 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1035/2061] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:25 2022] PUT /identity/v3/projects/9e1c056aae21412d8221bb45386cf5fb/users/9570dbc191944cbe872b3d8c79f73914/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:25.864018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ea3af-02bc-4cd3-8cf1-3ca481c45f66 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:25.864306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ea3af-02bc-4cd3-8cf1-3ca481c45f66 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:25.864587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ea3af-02bc-4cd3-8cf1-3ca481c45f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:25.866047 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec286a-05b3-42c3-857e-07e5aed16e9c admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:25.868519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1bec286a-05b3-42c3-857e-07e5aed16e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:25.897971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-e49ea3af-02bc-4cd3-8cf1-3ca481c45f66 None None] MFA Rules not processed for user `9570dbc191944cbe872b3d8c79f73914`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:25.899870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e49ea3af-02bc-4cd3-8cf1-3ca481c45f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:25.934087 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec286a-05b3-42c3-857e-07e5aed16e9c admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:25.938015 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca886b-e6e8-4179-8ccb-3a0802e6bc61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:25.938635 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca886b-e6e8-4179-8ccb-3a0802e6bc61 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:25.938937 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca886b-e6e8-4179-8ccb-3a0802e6bc61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:25.939211 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca886b-e6e8-4179-8ccb-3a0802e6bc61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:25.972961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1027/2062] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:25.984571 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ea3af-02bc-4cd3-8cf1-3ca481c45f66 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:25.986177 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e49ea3af-02bc-4cd3-8cf1-3ca481c45f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:25.997576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ea3af-02bc-4cd3-8cf1-3ca481c45f66 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:26.001142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131e368-501c-48ea-9261-06d79701e718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:26.001731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131e368-501c-48ea-9261-06d79701e718 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:26.002045 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131e368-501c-48ea-9261-06d79701e718 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:26.002279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131e368-501c-48ea-9261-06d79701e718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:26.004367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca886b-e6e8-4179-8ccb-3a0802e6bc61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:26.005797 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca886b-e6e8-4179-8ccb-3a0802e6bc61 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:26.013553 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131e368-501c-48ea-9261-06d79701e718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:26.015227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131e368-501c-48ea-9261-06d79701e718 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:26.015432 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1036/2063] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:33:26.026098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1028/2064] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:26.069020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca886b-e6e8-4179-8ccb-3a0802e6bc61 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:26.070893 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-65ca886b-e6e8-4179-8ccb-3a0802e6bc61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:26.191622 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca886b-e6e8-4179-8ccb-3a0802e6bc61 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:26.196960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37238469-a43e-4abc-a0dd-b96a9408e777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:26.197603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37238469-a43e-4abc-a0dd-b96a9408e777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:26.197882 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37238469-a43e-4abc-a0dd-b96a9408e777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:26.198293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37238469-a43e-4abc-a0dd-b96a9408e777 admin admin] PATH_INFO: `/v3/users/7181a4a541bb40c7867aa326d0734c0d` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:26.199879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37238469-a43e-4abc-a0dd-b96a9408e777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7181a4a541bb40c7867aa326d0734c0d)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:26.201924 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37238469-a43e-4abc-a0dd-b96a9408e777 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:26.215736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131e368-501c-48ea-9261-06d79701e718 service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:26.219932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:26.228652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131e368-501c-48ea-9261-06d79701e718 service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:26.233702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f279414-8a91-4827-8d3d-001e1cc61d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:26.235358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f279414-8a91-4827-8d3d-001e1cc61d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:26.235358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f279414-8a91-4827-8d3d-001e1cc61d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:26.235358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f279414-8a91-4827-8d3d-001e1cc61d4b admin admin] PATH_INFO: `/v3/users/bf76fae9d4ed45179ab8112aab2bfe7a` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:26.236246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f279414-8a91-4827-8d3d-001e1cc61d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf76fae9d4ed45179ab8112aab2bfe7a)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:26.238489 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f279414-8a91-4827-8d3d-001e1cc61d4b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:26.251144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:26.304027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-37238469-a43e-4abc-a0dd-b96a9408e777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7181a4a541bb40c7867aa326d0734c0d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:26.309377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-37238469-a43e-4abc-a0dd-b96a9408e777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7181a4a541bb40c7867aa326d0734c0d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:26.323676 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-37238469-a43e-4abc-a0dd-b96a9408e777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7181a4a541bb40c7867aa326d0734c0d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:26.327784 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5f279414-8a91-4827-8d3d-001e1cc61d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf76fae9d4ed45179ab8112aab2bfe7a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:26.328779 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5f279414-8a91-4827-8d3d-001e1cc61d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf76fae9d4ed45179ab8112aab2bfe7a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:26.362243 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5f279414-8a91-4827-8d3d-001e1cc61d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf76fae9d4ed45179ab8112aab2bfe7a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:26.376950 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5f279414-8a91-4827-8d3d-001e1cc61d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf76fae9d4ed45179ab8112aab2bfe7a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:26.381645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-37238469-a43e-4abc-a0dd-b96a9408e777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7181a4a541bb40c7867aa326d0734c0d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:26.393048 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5f279414-8a91-4827-8d3d-001e1cc61d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf76fae9d4ed45179ab8112aab2bfe7a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:26.404844 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-37238469-a43e-4abc-a0dd-b96a9408e777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7181a4a541bb40c7867aa326d0734c0d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:26.410272 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1029/2065] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:26 2022] DELETE /identity/v3/users/bf76fae9d4ed45179ab8112aab2bfe7a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:26.414512 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f730ae-1b7f-4603-a346-a08657994239 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:26.415422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f730ae-1b7f-4603-a346-a08657994239 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:26.415767 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f730ae-1b7f-4603-a346-a08657994239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:26.424452 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1037/2066] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:26 2022] DELETE /identity/v3/users/7181a4a541bb40c7867aa326d0734c0d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:26.429486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b12a10-f8e1-4ee7-aa90-1633b6a6cb86 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:26.429770 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b12a10-f8e1-4ee7-aa90-1633b6a6cb86 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:26.430050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b12a10-f8e1-4ee7-aa90-1633b6a6cb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:26.448616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-f0f730ae-1b7f-4603-a346-a08657994239 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:26.451522 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f0f730ae-1b7f-4603-a346-a08657994239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:26.476784 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-49b12a10-f8e1-4ee7-aa90-1633b6a6cb86 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:26.478555 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-49b12a10-f8e1-4ee7-aa90-1633b6a6cb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:26.556353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1030/2067] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:26.565996 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1038/2068] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:26.566183 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f730ae-1b7f-4603-a346-a08657994239 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:26.570090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f0f730ae-1b7f-4603-a346-a08657994239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:26.578797 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b12a10-f8e1-4ee7-aa90-1633b6a6cb86 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:26.580280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-49b12a10-f8e1-4ee7-aa90-1633b6a6cb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:26.635395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f730ae-1b7f-4603-a346-a08657994239 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:26.639560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505db8b9-dd51-4ec0-a2bf-0ccb25bb5c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:26.640168 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505db8b9-dd51-4ec0-a2bf-0ccb25bb5c26 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:26.640441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505db8b9-dd51-4ec0-a2bf-0ccb25bb5c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:26.640713 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505db8b9-dd51-4ec0-a2bf-0ccb25bb5c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:26.651289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b12a10-f8e1-4ee7-aa90-1633b6a6cb86 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:26.656121 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505db8b9-dd51-4ec0-a2bf-0ccb25bb5c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:26.656251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb5efa-d150-4da2-bf86-d887f82186a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:26.656978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb5efa-d150-4da2-bf86-d887f82186a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:26.657259 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb5efa-d150-4da2-bf86-d887f82186a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:26.657531 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb5efa-d150-4da2-bf86-d887f82186a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:26.658363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505db8b9-dd51-4ec0-a2bf-0ccb25bb5c26 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:26.673528 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb5efa-d150-4da2-bf86-d887f82186a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:26.675132 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb5efa-d150-4da2-bf86-d887f82186a7 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:26.675733 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1031/2069] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:33:26.693690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1039/2070] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:33:26.985100 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505db8b9-dd51-4ec0-a2bf-0ccb25bb5c26 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:26.988548 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-505db8b9-dd51-4ec0-a2bf-0ccb25bb5c26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:27.028083 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505db8b9-dd51-4ec0-a2bf-0ccb25bb5c26 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:27.042915 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7598f9-a937-4765-8064-065b841646a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:27.043646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7598f9-a937-4765-8064-065b841646a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:27.043926 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7598f9-a937-4765-8064-065b841646a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:27.044198 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7598f9-a937-4765-8064-065b841646a5 admin admin] PATH_INFO: `/v3/projects/4a287f9c94ca4644ac3bdddd73b056a7` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:27.045863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7598f9-a937-4765-8064-065b841646a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a287f9c94ca4644ac3bdddd73b056a7)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:27.048482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7598f9-a937-4765-8064-065b841646a5 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:27.087370 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:27.095035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb5efa-d150-4da2-bf86-d887f82186a7 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:27.096616 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d4eb5efa-d150-4da2-bf86-d887f82186a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:27.114358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1d7598f9-a937-4765-8064-065b841646a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a287f9c94ca4644ac3bdddd73b056a7', 'request_id': 'req-1d7598f9-a937-4765-8064-065b841646a5'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.126663 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb5efa-d150-4da2-bf86-d887f82186a7 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:27.128474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1d7598f9-a937-4765-8064-065b841646a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a287f9c94ca4644ac3bdddd73b056a7', 'request_id': 'req-1d7598f9-a937-4765-8064-065b841646a5'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.136012 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1d7598f9-a937-4765-8064-065b841646a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a287f9c94ca4644ac3bdddd73b056a7', 'request_id': 'req-1d7598f9-a937-4765-8064-065b841646a5'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.149272 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1d7598f9-a937-4765-8064-065b841646a5 admin admin] The token cache is being invalidate because project 4a287f9c94ca4644ac3bdddd73b056a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:27.150067 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1d7598f9-a937-4765-8064-065b841646a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.150758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1d7598f9-a937-4765-8064-065b841646a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.152531 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1032/2071] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:26 2022] DELETE /identity/v3/projects/4a287f9c94ca4644ac3bdddd73b056a7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:27.156644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7598f9-a937-4765-8064-065b841646a5 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:27.158191 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1d7598f9-a937-4765-8064-065b841646a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:27.172709 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:27.224749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492404c8-f409-4372-b25e-77aa877b1d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:27.227875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492404c8-f409-4372-b25e-77aa877b1d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:27.228160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492404c8-f409-4372-b25e-77aa877b1d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:27.228427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492404c8-f409-4372-b25e-77aa877b1d95 admin admin] PATH_INFO: `/v3/projects/a86f4bcc8a394935a108ee5251164a1a` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:27.231499 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492404c8-f409-4372-b25e-77aa877b1d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86f4bcc8a394935a108ee5251164a1a)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:27.235935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492404c8-f409-4372-b25e-77aa877b1d95 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:27.250769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7598f9-a937-4765-8064-065b841646a5 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:27.261058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a548950-c064-4d87-871d-0760a13fa3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:27.262409 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a548950-c064-4d87-871d-0760a13fa3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:27.262726 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a548950-c064-4d87-871d-0760a13fa3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:27.263004 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a548950-c064-4d87-871d-0760a13fa3ab admin admin] PATH_INFO: `/v3/users/9570dbc191944cbe872b3d8c79f73914` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:27.264362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a548950-c064-4d87-871d-0760a13fa3ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=9570dbc191944cbe872b3d8c79f73914)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:27.266498 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a548950-c064-4d87-871d-0760a13fa3ab admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:27.303744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-492404c8-f409-4372-b25e-77aa877b1d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86f4bcc8a394935a108ee5251164a1a', 'request_id': 'req-492404c8-f409-4372-b25e-77aa877b1d95'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.310988 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-492404c8-f409-4372-b25e-77aa877b1d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86f4bcc8a394935a108ee5251164a1a', 'request_id': 'req-492404c8-f409-4372-b25e-77aa877b1d95'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.318973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-492404c8-f409-4372-b25e-77aa877b1d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86f4bcc8a394935a108ee5251164a1a', 'request_id': 'req-492404c8-f409-4372-b25e-77aa877b1d95'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.331930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-492404c8-f409-4372-b25e-77aa877b1d95 admin admin] The token cache is being invalidate because project a86f4bcc8a394935a108ee5251164a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:27.332377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-492404c8-f409-4372-b25e-77aa877b1d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.333082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-492404c8-f409-4372-b25e-77aa877b1d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.336273 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1040/2072] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:27 2022] DELETE /identity/v3/projects/a86f4bcc8a394935a108ee5251164a1a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:27.342837 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492404c8-f409-4372-b25e-77aa877b1d95 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:27.347969 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-492404c8-f409-4372-b25e-77aa877b1d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:27.359118 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5a548950-c064-4d87-871d-0760a13fa3ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9570dbc191944cbe872b3d8c79f73914'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.360599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5a548950-c064-4d87-871d-0760a13fa3ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9570dbc191944cbe872b3d8c79f73914'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.378866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5a548950-c064-4d87-871d-0760a13fa3ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9570dbc191944cbe872b3d8c79f73914'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.391275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5a548950-c064-4d87-871d-0760a13fa3ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9570dbc191944cbe872b3d8c79f73914'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.399888 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5a548950-c064-4d87-871d-0760a13fa3ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9570dbc191944cbe872b3d8c79f73914'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.406079 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1033/2073] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:27 2022] DELETE /identity/v3/users/9570dbc191944cbe872b3d8c79f73914 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:27.446273 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492404c8-f409-4372-b25e-77aa877b1d95 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:27.537858 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47472f-dc94-46c1-a0af-441c76976579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:27.538441 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47472f-dc94-46c1-a0af-441c76976579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:27.538769 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47472f-dc94-46c1-a0af-441c76976579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:27.539042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47472f-dc94-46c1-a0af-441c76976579 admin admin] PATH_INFO: `/v3/users/65defba037434324a43f641d32a6b091` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:27.540975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47472f-dc94-46c1-a0af-441c76976579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65defba037434324a43f641d32a6b091)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:27.542831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47472f-dc94-46c1-a0af-441c76976579 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:27.551231 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:27.629559 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2b47472f-dc94-46c1-a0af-441c76976579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65defba037434324a43f641d32a6b091'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.631962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2b47472f-dc94-46c1-a0af-441c76976579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65defba037434324a43f641d32a6b091'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.646428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2b47472f-dc94-46c1-a0af-441c76976579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65defba037434324a43f641d32a6b091'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.665763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2b47472f-dc94-46c1-a0af-441c76976579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65defba037434324a43f641d32a6b091'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.675926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2b47472f-dc94-46c1-a0af-441c76976579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65defba037434324a43f641d32a6b091'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:27.684248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1041/2074] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:27 2022] DELETE /identity/v3/users/65defba037434324a43f641d32a6b091 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:27.826473 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a548950-c064-4d87-871d-0760a13fa3ab admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:27.828050 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5a548950-c064-4d87-871d-0760a13fa3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:27.907590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:27.957538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a548950-c064-4d87-871d-0760a13fa3ab admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:28.052108 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47472f-dc94-46c1-a0af-441c76976579 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:28.053727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2b47472f-dc94-46c1-a0af-441c76976579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:28.061794 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d3ab0-0000-4218-881c-f3d1591e0473 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:28.064555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d3ab0-0000-4218-881c-f3d1591e0473 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:28.064757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d3ab0-0000-4218-881c-f3d1591e0473 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:28.065205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d3ab0-0000-4218-881c-f3d1591e0473 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:28.069180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7a4d3ab0-0000-4218-881c-f3d1591e0473 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:28.203425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47472f-dc94-46c1-a0af-441c76976579 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:28.216465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40dd81-f606-48eb-b5f9-800aec4c74bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:28.218136 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40dd81-f606-48eb-b5f9-800aec4c74bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:28.219999 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40dd81-f606-48eb-b5f9-800aec4c74bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:28.220651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40dd81-f606-48eb-b5f9-800aec4c74bd admin admin] PATH_INFO: `/v3/projects/9e1c056aae21412d8221bb45386cf5fb` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:28.222228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d3ab0-0000-4218-881c-f3d1591e0473 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:28.224565 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d3ab0-0000-4218-881c-f3d1591e0473 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:28.225037 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40dd81-f606-48eb-b5f9-800aec4c74bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e1c056aae21412d8221bb45386cf5fb)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:28.232262 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40dd81-f606-48eb-b5f9-800aec4c74bd admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:28.237038 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1034/2075] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:28.293260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d3ab0-0000-4218-881c-f3d1591e0473 service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:28.294929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7a4d3ab0-0000-4218-881c-f3d1591e0473 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:28.312819 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d3ab0-0000-4218-881c-f3d1591e0473 service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:28.318688 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1a40dd81-f606-48eb-b5f9-800aec4c74bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e1c056aae21412d8221bb45386cf5fb', 'request_id': 'req-1a40dd81-f606-48eb-b5f9-800aec4c74bd'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:28.330421 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1a40dd81-f606-48eb-b5f9-800aec4c74bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e1c056aae21412d8221bb45386cf5fb', 'request_id': 'req-1a40dd81-f606-48eb-b5f9-800aec4c74bd'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:28.354171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1a40dd81-f606-48eb-b5f9-800aec4c74bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e1c056aae21412d8221bb45386cf5fb', 'request_id': 'req-1a40dd81-f606-48eb-b5f9-800aec4c74bd'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:28.372680 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1a40dd81-f606-48eb-b5f9-800aec4c74bd admin admin] The token cache is being invalidate because project 9e1c056aae21412d8221bb45386cf5fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:28.373239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1a40dd81-f606-48eb-b5f9-800aec4c74bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:28.374584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1a40dd81-f606-48eb-b5f9-800aec4c74bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:28.377221 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1042/2076] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:28 2022] DELETE /identity/v3/projects/9e1c056aae21412d8221bb45386cf5fb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:28.382887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4b2f5-a886-46b3-976e-08d87daa3274 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:28.383235 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4b2f5-a886-46b3-976e-08d87daa3274 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:28.384412 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4b2f5-a886-46b3-976e-08d87daa3274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:28.416116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8ca4b2f5-a886-46b3-976e-08d87daa3274 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:28.417836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8ca4b2f5-a886-46b3-976e-08d87daa3274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:28.446809 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957ac43-2fee-42f0-872c-8b6ec4ebebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:28.447465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957ac43-2fee-42f0-872c-8b6ec4ebebf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:28.448358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957ac43-2fee-42f0-872c-8b6ec4ebebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:28.448556 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:28.448681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957ac43-2fee-42f0-872c-8b6ec4ebebf0 admin admin] PATH_INFO: `/v3/projects/a80bd538a1a443389576b12e7c8e6a67` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:28.449806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957ac43-2fee-42f0-872c-8b6ec4ebebf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a80bd538a1a443389576b12e7c8e6a67)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:28.452143 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957ac43-2fee-42f0-872c-8b6ec4ebebf0 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:28.568565 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:28.575621 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2957ac43-2fee-42f0-872c-8b6ec4ebebf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a80bd538a1a443389576b12e7c8e6a67', 'request_id': 'req-2957ac43-2fee-42f0-872c-8b6ec4ebebf0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:28.583393 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1043/2077] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:28.593782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92c206-aaae-4b51-b146-fd6f1ee09c76 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:28.594726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92c206-aaae-4b51-b146-fd6f1ee09c76 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:28.595221 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92c206-aaae-4b51-b146-fd6f1ee09c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:28.604252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2957ac43-2fee-42f0-872c-8b6ec4ebebf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a80bd538a1a443389576b12e7c8e6a67', 'request_id': 'req-2957ac43-2fee-42f0-872c-8b6ec4ebebf0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:28.626208 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2957ac43-2fee-42f0-872c-8b6ec4ebebf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a80bd538a1a443389576b12e7c8e6a67', 'request_id': 'req-2957ac43-2fee-42f0-872c-8b6ec4ebebf0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:28.638411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8f92c206-aaae-4b51-b146-fd6f1ee09c76 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:28.640382 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8f92c206-aaae-4b51-b146-fd6f1ee09c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:28.657502 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2957ac43-2fee-42f0-872c-8b6ec4ebebf0 admin admin] The token cache is being invalidate because project a80bd538a1a443389576b12e7c8e6a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:28.657803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2957ac43-2fee-42f0-872c-8b6ec4ebebf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:28.659960 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2957ac43-2fee-42f0-872c-8b6ec4ebebf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:28.664467 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1035/2078] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:28 2022] DELETE /identity/v3/projects/a80bd538a1a443389576b12e7c8e6a67 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:28.669917 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026b837-579b-47d5-8185-f9390f8538b0 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:28.670269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026b837-579b-47d5-8185-f9390f8538b0 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:28.670633 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026b837-579b-47d5-8185-f9390f8538b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:28.710938 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-1026b837-579b-47d5-8185-f9390f8538b0 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:28.712434 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1026b837-579b-47d5-8185-f9390f8538b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:28.728470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1044/2079] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:28.732753 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92c206-aaae-4b51-b146-fd6f1ee09c76 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:28.742320 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92c206-aaae-4b51-b146-fd6f1ee09c76 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:28.748813 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac54c9e-8caa-4c8d-bffb-2b43b7fa698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:28.749795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac54c9e-8caa-4c8d-bffb-2b43b7fa698d admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:28.750077 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac54c9e-8caa-4c8d-bffb-2b43b7fa698d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:28.750348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac54c9e-8caa-4c8d-bffb-2b43b7fa698d admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:28.751055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac54c9e-8caa-4c8d-bffb-2b43b7fa698d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:28.751363 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac54c9e-8caa-4c8d-bffb-2b43b7fa698d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:28.753046 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac54c9e-8caa-4c8d-bffb-2b43b7fa698d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:28.770632 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1045/2080] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:33:28.771806 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac54c9e-8caa-4c8d-bffb-2b43b7fa698d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:28.783172 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac54c9e-8caa-4c8d-bffb-2b43b7fa698d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:28.787707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1036/2081] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:28.788662 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1dd5cd-3ad5-459f-ac52-d9a95eee32fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:28.789265 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dd5cd-3ad5-459f-ac52-d9a95eee32fd admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:28.789529 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dd5cd-3ad5-459f-ac52-d9a95eee32fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:28.789885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dd5cd-3ad5-459f-ac52-d9a95eee32fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:28.791018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1dd5cd-3ad5-459f-ac52-d9a95eee32fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:28.792895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1dd5cd-3ad5-459f-ac52-d9a95eee32fd admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:28.795985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb65e8f-41aa-4a74-a1dc-5b493559db7e None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:28.796270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb65e8f-41aa-4a74-a1dc-5b493559db7e None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:28.796542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb65e8f-41aa-4a74-a1dc-5b493559db7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:28.824763 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-cbb65e8f-41aa-4a74-a1dc-5b493559db7e None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:28.828849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1046/2082] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:28 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:28.828972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-cbb65e8f-41aa-4a74-a1dc-5b493559db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:28.829792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1dd5cd-3ad5-459f-ac52-d9a95eee32fd admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:28.916329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1037/2083] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:28.920256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb65e8f-41aa-4a74-a1dc-5b493559db7e None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:28.929912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1dd5cd-3ad5-459f-ac52-d9a95eee32fd admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:28.932127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb65e8f-41aa-4a74-a1dc-5b493559db7e None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:28.935272 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282a7ef-63f8-4e97-b003-dd7454b599e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:28.935876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282a7ef-63f8-4e97-b003-dd7454b599e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:28.936161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282a7ef-63f8-4e97-b003-dd7454b599e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:28.936437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282a7ef-63f8-4e97-b003-dd7454b599e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:28.937071 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282a7ef-63f8-4e97-b003-dd7454b599e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:28.937935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3eaa38-292f-440d-a1f4-4fc3da916f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:28.938805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eaa38-292f-440d-a1f4-4fc3da916f08 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:28.939167 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282a7ef-63f8-4e97-b003-dd7454b599e2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:28.939299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eaa38-292f-440d-a1f4-4fc3da916f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:28.939649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eaa38-292f-440d-a1f4-4fc3da916f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:28.940406 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3eaa38-292f-440d-a1f4-4fc3da916f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:28.940958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3eaa38-292f-440d-a1f4-4fc3da916f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:28.942649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3eaa38-292f-440d-a1f4-4fc3da916f08 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:28.962902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1047/2084] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:28 2022] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:33:28.967074 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282a7ef-63f8-4e97-b003-dd7454b599e2 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:28.967870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1038/2085] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:33:28.973582 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3eaa38-292f-440d-a1f4-4fc3da916f08 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:28.979259 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282a7ef-63f8-4e97-b003-dd7454b599e2 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:28.991551 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a42666-607d-4590-b57f-7253c6c1c4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:28.992719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a42666-607d-4590-b57f-7253c6c1c4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:28.993955 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a42666-607d-4590-b57f-7253c6c1c4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:28.994406 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a42666-607d-4590-b57f-7253c6c1c4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:28.995465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a42666-607d-4590-b57f-7253c6c1c4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:28.996596 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3eaa38-292f-440d-a1f4-4fc3da916f08 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:28.997736 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a42666-607d-4590-b57f-7253c6c1c4c2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:29.002575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b27c4-1a1b-4472-9f89-e0422a668714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:29.003444 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b27c4-1a1b-4472-9f89-e0422a668714 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:29.003909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b27c4-1a1b-4472-9f89-e0422a668714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:29.004290 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b27c4-1a1b-4472-9f89-e0422a668714 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:29.004997 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b27c4-1a1b-4472-9f89-e0422a668714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:29.007133 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:29.010844 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b27c4-1a1b-4472-9f89-e0422a668714 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:29.016572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1048/2086] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:29.017742 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a42666-607d-4590-b57f-7253c6c1c4c2 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:29.036148 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a42666-607d-4590-b57f-7253c6c1c4c2 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:29.044025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e13fe-1eda-42c7-aa31-e01e16b7097d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:29.045398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e13fe-1eda-42c7-aa31-e01e16b7097d admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:29.045866 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e13fe-1eda-42c7-aa31-e01e16b7097d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:29.046925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e13fe-1eda-42c7-aa31-e01e16b7097d admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:29.048294 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e13fe-1eda-42c7-aa31-e01e16b7097d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:29.051112 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e13fe-1eda-42c7-aa31-e01e16b7097d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:29.064778 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1039/2087] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:28 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:29.067742 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1049/2088] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:29.072561 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b27c4-1a1b-4472-9f89-e0422a668714 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:29.079569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e13fe-1eda-42c7-aa31-e01e16b7097d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:29.095754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e13fe-1eda-42c7-aa31-e01e16b7097d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:29.159058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:29.189865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b27c4-1a1b-4472-9f89-e0422a668714 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:29.205067 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821f367-de60-44c9-a968-aa432bfb709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:29.206057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821f367-de60-44c9-a968-aa432bfb709a admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:29.206494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821f367-de60-44c9-a968-aa432bfb709a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:29.207043 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821f367-de60-44c9-a968-aa432bfb709a admin admin] PATH_INFO: `/v3/projects/9a0a82a5538f47159d044a1a333986a8/users/c7e36dbdd47e4075b7f57b8232854c0c/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:29.211919 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0de1d-49a5-4772-8a4c-7d8d393d9b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:29.212638 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0de1d-49a5-4772-8a4c-7d8d393d9b22 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:29.213014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0de1d-49a5-4772-8a4c-7d8d393d9b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:29.213352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0de1d-49a5-4772-8a4c-7d8d393d9b22 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:29.214058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0de1d-49a5-4772-8a4c-7d8d393d9b22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:29.216292 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0de1d-49a5-4772-8a4c-7d8d393d9b22 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:29.224954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821f367-de60-44c9-a968-aa432bfb709a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0a82a5538f47159d044a1a333986a8, user_id=c7e36dbdd47e4075b7f57b8232854c0c, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:29.228465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821f367-de60-44c9-a968-aa432bfb709a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:29.247957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1040/2089] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:29 2022] PUT /identity/v3/projects/9a0a82a5538f47159d044a1a333986a8/users/c7e36dbdd47e4075b7f57b8232854c0c/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:29.249373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821f367-de60-44c9-a968-aa432bfb709a admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:29.258938 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1821f367-de60-44c9-a968-aa432bfb709a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:29.264035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1050/2090] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:29 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:29.265442 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb9741-c873-4bbc-b0fa-59d0f59441de None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:29.265781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb9741-c873-4bbc-b0fa-59d0f59441de None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:29.266076 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb9741-c873-4bbc-b0fa-59d0f59441de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:29.300004 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f3cb9741-c873-4bbc-b0fa-59d0f59441de None None] MFA Rules not processed for user `c7e36dbdd47e4075b7f57b8232854c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:29.301240 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f3cb9741-c873-4bbc-b0fa-59d0f59441de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:29.344952 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821f367-de60-44c9-a968-aa432bfb709a admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:29.349483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b1b6e-d03a-4fe8-8828-4b25046d609b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:29.350136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b1b6e-d03a-4fe8-8828-4b25046d609b service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:29.350558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b1b6e-d03a-4fe8-8828-4b25046d609b service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:29.350880 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b1b6e-d03a-4fe8-8828-4b25046d609b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:29.353534 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-cd2b1b6e-d03a-4fe8-8828-4b25046d609b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:29.403660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1051/2091] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:29.405120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb9741-c873-4bbc-b0fa-59d0f59441de None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:29.427795 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b1b6e-d03a-4fe8-8828-4b25046d609b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:29.429326 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b1b6e-d03a-4fe8-8828-4b25046d609b service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:29.470752 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1041/2092] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:29.471638 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b1b6e-d03a-4fe8-8828-4b25046d609b service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:29.561572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb9741-c873-4bbc-b0fa-59d0f59441de None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:29.572365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42eb515-2db8-43fa-b74b-3efd5a90b1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:29.573802 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42eb515-2db8-43fa-b74b-3efd5a90b1cf admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:29.574907 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42eb515-2db8-43fa-b74b-3efd5a90b1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:29.574907 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42eb515-2db8-43fa-b74b-3efd5a90b1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:29.575814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42eb515-2db8-43fa-b74b-3efd5a90b1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:29.579354 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42eb515-2db8-43fa-b74b-3efd5a90b1cf admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:29.610254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1052/2093] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:29.613780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42eb515-2db8-43fa-b74b-3efd5a90b1cf admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:29.621510 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b1b6e-d03a-4fe8-8828-4b25046d609b service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:29.628202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d5753-4c88-447b-be97-a80353b3ad28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:29.628593 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:29.629004 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d5753-4c88-447b-be97-a80353b3ad28 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:29.629920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d5753-4c88-447b-be97-a80353b3ad28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:29.630031 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d5753-4c88-447b-be97-a80353b3ad28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:29.630999 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d5753-4c88-447b-be97-a80353b3ad28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:29.634744 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d5753-4c88-447b-be97-a80353b3ad28 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:29.642958 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42eb515-2db8-43fa-b74b-3efd5a90b1cf admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:29.660692 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:29.674702 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05aae5-22bc-4488-8fa1-74161bc52172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:29.675459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05aae5-22bc-4488-8fa1-74161bc52172 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:29.675749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05aae5-22bc-4488-8fa1-74161bc52172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:29.676030 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05aae5-22bc-4488-8fa1-74161bc52172 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:29.677978 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1042/2094] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:29 2022] POST /identity/v3/projects => generated 381 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:29.679796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d5753-4c88-447b-be97-a80353b3ad28 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:29.679967 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05aae5-22bc-4488-8fa1-74161bc52172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:29.685265 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05aae5-22bc-4488-8fa1-74161bc52172 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:29.721065 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1053/2095] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:29.729738 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05aae5-22bc-4488-8fa1-74161bc52172 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:29.752872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05aae5-22bc-4488-8fa1-74161bc52172 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:29.797780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d5753-4c88-447b-be97-a80353b3ad28 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:29.813826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b42da6-a498-42c8-8ebe-29d4ec69a09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:29.814571 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b42da6-a498-42c8-8ebe-29d4ec69a09a admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:29.814961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b42da6-a498-42c8-8ebe-29d4ec69a09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:29.815421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b42da6-a498-42c8-8ebe-29d4ec69a09a admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:29.816072 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b42da6-a498-42c8-8ebe-29d4ec69a09a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:29.822646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b42da6-a498-42c8-8ebe-29d4ec69a09a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:29.866928 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1043/2096] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:29 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:29.870341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b42da6-a498-42c8-8ebe-29d4ec69a09a admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:29.889924 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b42da6-a498-42c8-8ebe-29d4ec69a09a admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:29.905977 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571aa7c-825a-4909-b8e0-628a3682b908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:29.906922 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571aa7c-825a-4909-b8e0-628a3682b908 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:29.909973 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571aa7c-825a-4909-b8e0-628a3682b908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:29.910971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571aa7c-825a-4909-b8e0-628a3682b908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:29.914029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571aa7c-825a-4909-b8e0-628a3682b908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:29.919177 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571aa7c-825a-4909-b8e0-628a3682b908 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:29.938558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1044/2097] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:29.944091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571aa7c-825a-4909-b8e0-628a3682b908 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:29.973169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571aa7c-825a-4909-b8e0-628a3682b908 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:29.990925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dad6a-a5e4-4d88-952e-c642124ef745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:29.992739 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dad6a-a5e4-4d88-952e-c642124ef745 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:29.994583 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd108e-88b9-4741-9621-921c576aac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:29.994800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dad6a-a5e4-4d88-952e-c642124ef745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:29.995045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dad6a-a5e4-4d88-952e-c642124ef745 admin admin] PATH_INFO: `/v3/projects/0202be007aba4557972d975509216bc1/users/2795b294fed84c8cac4d3f481a3eb24d/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:29.995289 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd108e-88b9-4741-9621-921c576aac26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:29.995571 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd108e-88b9-4741-9621-921c576aac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:30.003304 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd108e-88b9-4741-9621-921c576aac26 admin admin] PATH_INFO: `/v3/projects/2eedee5d9ce2470eb3102b3795b8cab9/users/0a4b555f17f04241bfb44fe18856d6d0/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:30.021637 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4dad6a-a5e4-4d88-952e-c642124ef745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0202be007aba4557972d975509216bc1, user_id=2795b294fed84c8cac4d3f481a3eb24d, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:30.025092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4dad6a-a5e4-4d88-952e-c642124ef745 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:30.052173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd108e-88b9-4741-9621-921c576aac26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eedee5d9ce2470eb3102b3795b8cab9, user_id=0a4b555f17f04241bfb44fe18856d6d0, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:30.060145 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd108e-88b9-4741-9621-921c576aac26 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:30.061372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1054/2098] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:29 2022] PUT /identity/v3/projects/0202be007aba4557972d975509216bc1/users/2795b294fed84c8cac4d3f481a3eb24d/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:30.063001 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377a818-15bd-428b-869f-6ef73e035faf None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:30.063841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377a818-15bd-428b-869f-6ef73e035faf None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:30.064044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377a818-15bd-428b-869f-6ef73e035faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:30.100353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1045/2099] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:29 2022] PUT /identity/v3/projects/2eedee5d9ce2470eb3102b3795b8cab9/users/0a4b555f17f04241bfb44fe18856d6d0/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:30.105929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd108e-88b9-4741-9621-921c576aac26 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:30.108093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f377a818-15bd-428b-869f-6ef73e035faf None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:30.114315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f377a818-15bd-428b-869f-6ef73e035faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:30.293884 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1055/2100] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:30.309460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377a818-15bd-428b-869f-6ef73e035faf None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:30.310990 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f377a818-15bd-428b-869f-6ef73e035faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:30.324852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd108e-88b9-4741-9621-921c576aac26 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:30.335030 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38345a-8109-4c69-9e42-e8086e1f0e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:30.337173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38345a-8109-4c69-9e42-e8086e1f0e8f admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:30.337535 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38345a-8109-4c69-9e42-e8086e1f0e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:30.337985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38345a-8109-4c69-9e42-e8086e1f0e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:30.339362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38345a-8109-4c69-9e42-e8086e1f0e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:30.341290 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38345a-8109-4c69-9e42-e8086e1f0e8f admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:30.363773 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1046/2101] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:30.364709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38345a-8109-4c69-9e42-e8086e1f0e8f admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:30.366552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2c38345a-8109-4c69-9e42-e8086e1f0e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:30.390876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38345a-8109-4c69-9e42-e8086e1f0e8f admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:30.393665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377a818-15bd-428b-869f-6ef73e035faf None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:30.398204 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf292e-d7ab-46fd-9d0e-22d8ff601ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:30.398867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf292e-d7ab-46fd-9d0e-22d8ff601ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:30.399495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a089b6-f194-4496-9ab4-1897cc6c8e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:30.399696 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf292e-d7ab-46fd-9d0e-22d8ff601ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:30.399970 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf292e-d7ab-46fd-9d0e-22d8ff601ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:30.400401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a089b6-f194-4496-9ab4-1897cc6c8e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:30.401366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a089b6-f194-4496-9ab4-1897cc6c8e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:30.401711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a089b6-f194-4496-9ab4-1897cc6c8e49 admin admin] PATH_INFO: `/v3/users/da35c95972654ee8a620e12162116db6` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:30.403399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a089b6-f194-4496-9ab4-1897cc6c8e49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da35c95972654ee8a620e12162116db6)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:30.405515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a089b6-f194-4496-9ab4-1897cc6c8e49 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:30.428550 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf292e-d7ab-46fd-9d0e-22d8ff601ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:30.431901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf292e-d7ab-46fd-9d0e-22d8ff601ec0 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:30.473498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1056/2102] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:30.474854 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:30.480393 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-17a089b6-f194-4496-9ab4-1897cc6c8e49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da35c95972654ee8a620e12162116db6'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:30.480757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf292e-d7ab-46fd-9d0e-22d8ff601ec0 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:30.481949 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-17a089b6-f194-4496-9ab4-1897cc6c8e49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da35c95972654ee8a620e12162116db6'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:30.503280 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-17a089b6-f194-4496-9ab4-1897cc6c8e49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da35c95972654ee8a620e12162116db6'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:30.507073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf292e-d7ab-46fd-9d0e-22d8ff601ec0 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:30.514058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4335f2e-9168-4025-8902-2eaf1518e877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:30.515941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4335f2e-9168-4025-8902-2eaf1518e877 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:30.516445 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4335f2e-9168-4025-8902-2eaf1518e877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:30.517819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4335f2e-9168-4025-8902-2eaf1518e877 admin admin] PATH_INFO: `/v3/projects/2eedee5d9ce2470eb3102b3795b8cab9/users/0a4b555f17f04241bfb44fe18856d6d0/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:30.518868 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-17a089b6-f194-4496-9ab4-1897cc6c8e49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da35c95972654ee8a620e12162116db6'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:30.523254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4335f2e-9168-4025-8902-2eaf1518e877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eedee5d9ce2470eb3102b3795b8cab9, user_id=0a4b555f17f04241bfb44fe18856d6d0, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:30.529324 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4335f2e-9168-4025-8902-2eaf1518e877 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:30.534532 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-17a089b6-f194-4496-9ab4-1897cc6c8e49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da35c95972654ee8a620e12162116db6'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:30.546858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1047/2103] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:30 2022] DELETE /identity/v3/users/da35c95972654ee8a620e12162116db6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:30.549873 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1057/2104] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:30 2022] PUT /identity/v3/projects/2eedee5d9ce2470eb3102b3795b8cab9/users/0a4b555f17f04241bfb44fe18856d6d0/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:30.561114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1c7bb-058f-40e7-a7fb-5e448e2f8d45 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:30.561391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1c7bb-058f-40e7-a7fb-5e448e2f8d45 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:30.561730 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c424c-c25f-4d61-8cec-a84f573e8bec None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:30.561866 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1c7bb-058f-40e7-a7fb-5e448e2f8d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:30.562021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c424c-c25f-4d61-8cec-a84f573e8bec None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:30.562654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c424c-c25f-4d61-8cec-a84f573e8bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:30.581133 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:30.608299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-b34c424c-c25f-4d61-8cec-a84f573e8bec None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:30.609550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b34c424c-c25f-4d61-8cec-a84f573e8bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:30.613381 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-04c1c7bb-058f-40e7-a7fb-5e448e2f8d45 None None] MFA Rules not processed for user `0a4b555f17f04241bfb44fe18856d6d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:30.616467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-04c1c7bb-058f-40e7-a7fb-5e448e2f8d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:30.742682 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1048/2105] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:30.743766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1058/2106] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:30.754438 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c424c-c25f-4d61-8cec-a84f573e8bec None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:30.756053 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b34c424c-c25f-4d61-8cec-a84f573e8bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:30.759806 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1c7bb-058f-40e7-a7fb-5e448e2f8d45 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:30.761454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-04c1c7bb-058f-40e7-a7fb-5e448e2f8d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:30.851687 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1c7bb-058f-40e7-a7fb-5e448e2f8d45 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:30.856492 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350608d2-d931-4ab3-8fa6-5361866d9455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:30.857198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350608d2-d931-4ab3-8fa6-5361866d9455 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:30.857401 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350608d2-d931-4ab3-8fa6-5361866d9455 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:30.857692 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350608d2-d931-4ab3-8fa6-5361866d9455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:30.861585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c424c-c25f-4d61-8cec-a84f573e8bec None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:30.867745 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e8715-3ec3-4ec7-bae9-c7588c972933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:30.868290 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e8715-3ec3-4ec7-bae9-c7588c972933 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:30.868575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e8715-3ec3-4ec7-bae9-c7588c972933 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:30.868676 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350608d2-d931-4ab3-8fa6-5361866d9455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:30.868838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e8715-3ec3-4ec7-bae9-c7588c972933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:30.870275 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350608d2-d931-4ab3-8fa6-5361866d9455 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:30.880263 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e8715-3ec3-4ec7-bae9-c7588c972933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:30.881491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1059/2107] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:30.882711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e8715-3ec3-4ec7-bae9-c7588c972933 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:30.896312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1049/2108] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:31.319711 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350608d2-d931-4ab3-8fa6-5361866d9455 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:31.321694 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-350608d2-d931-4ab3-8fa6-5361866d9455 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:31.372755 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350608d2-d931-4ab3-8fa6-5361866d9455 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:31.392420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e8715-3ec3-4ec7-bae9-c7588c972933 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:31.392976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57f18a-f62f-4099-a039-630711993ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:31.393843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-3e2e8715-3ec3-4ec7-bae9-c7588c972933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:31.395593 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57f18a-f62f-4099-a039-630711993ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:31.396065 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57f18a-f62f-4099-a039-630711993ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:31.396407 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57f18a-f62f-4099-a039-630711993ce2 admin admin] PATH_INFO: `/v3/projects/f193a5765c09455fb97c8b7ef6ca7ead` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:31.401965 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57f18a-f62f-4099-a039-630711993ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f193a5765c09455fb97c8b7ef6ca7ead)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:31.404084 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57f18a-f62f-4099-a039-630711993ce2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:31.412286 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e8715-3ec3-4ec7-bae9-c7588c972933 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:31.450057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712e56a-68fb-47c0-ae9e-879f535638ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:31.451837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712e56a-68fb-47c0-ae9e-879f535638ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:31.452120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712e56a-68fb-47c0-ae9e-879f535638ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:31.454156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712e56a-68fb-47c0-ae9e-879f535638ca admin admin] PATH_INFO: `/v3/users/c7e36dbdd47e4075b7f57b8232854c0c` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:31.458198 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712e56a-68fb-47c0-ae9e-879f535638ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e36dbdd47e4075b7f57b8232854c0c)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:31.465623 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712e56a-68fb-47c0-ae9e-879f535638ca admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:31.479842 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1e57f18a-f62f-4099-a039-630711993ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f193a5765c09455fb97c8b7ef6ca7ead', 'request_id': 'req-1e57f18a-f62f-4099-a039-630711993ce2'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:31.488836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1e57f18a-f62f-4099-a039-630711993ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f193a5765c09455fb97c8b7ef6ca7ead', 'request_id': 'req-1e57f18a-f62f-4099-a039-630711993ce2'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:31.495607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1e57f18a-f62f-4099-a039-630711993ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f193a5765c09455fb97c8b7ef6ca7ead', 'request_id': 'req-1e57f18a-f62f-4099-a039-630711993ce2'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:31.513348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1e57f18a-f62f-4099-a039-630711993ce2 admin admin] The token cache is being invalidate because project f193a5765c09455fb97c8b7ef6ca7ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:31.514199 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1e57f18a-f62f-4099-a039-630711993ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:31.515100 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1e57f18a-f62f-4099-a039-630711993ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:31.517011 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1060/2109] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:31 2022] DELETE /identity/v3/projects/f193a5765c09455fb97c8b7ef6ca7ead => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:31.518564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe4cac-e9ba-4e9e-b55c-cf7d6160b687 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:31.519133 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe4cac-e9ba-4e9e-b55c-cf7d6160b687 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:31.519873 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe4cac-e9ba-4e9e-b55c-cf7d6160b687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:31.563475 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-cbbe4cac-e9ba-4e9e-b55c-cf7d6160b687 None None] MFA Rules not processed for user `2795b294fed84c8cac4d3f481a3eb24d`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:31.565013 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cbbe4cac-e9ba-4e9e-b55c-cf7d6160b687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:31.578956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:31.598991 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c712e56a-68fb-47c0-ae9e-879f535638ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e36dbdd47e4075b7f57b8232854c0c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:31.600208 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c712e56a-68fb-47c0-ae9e-879f535638ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e36dbdd47e4075b7f57b8232854c0c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:31.631143 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:31.645402 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c712e56a-68fb-47c0-ae9e-879f535638ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e36dbdd47e4075b7f57b8232854c0c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:31.669234 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c712e56a-68fb-47c0-ae9e-879f535638ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e36dbdd47e4075b7f57b8232854c0c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:31.684034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c712e56a-68fb-47c0-ae9e-879f535638ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e36dbdd47e4075b7f57b8232854c0c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:31.691218 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1050/2110] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:31 2022] DELETE /identity/v3/users/c7e36dbdd47e4075b7f57b8232854c0c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:31.692050 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712e56a-68fb-47c0-ae9e-879f535638ca admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:31.694990 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c712e56a-68fb-47c0-ae9e-879f535638ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:31.722301 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1061/2111] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:31.723628 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaebc5-06ef-4799-b2d2-cef6bdaa1427 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:31.723978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaebc5-06ef-4799-b2d2-cef6bdaa1427 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:31.724177 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaebc5-06ef-4799-b2d2-cef6bdaa1427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:31.761850 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-fdfaebc5-06ef-4799-b2d2-cef6bdaa1427 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:31.763503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fdfaebc5-06ef-4799-b2d2-cef6bdaa1427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:31.861075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1062/2112] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:31.862181 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfaebc5-06ef-4799-b2d2-cef6bdaa1427 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:31.870394 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fdfaebc5-06ef-4799-b2d2-cef6bdaa1427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:31.887497 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712e56a-68fb-47c0-ae9e-879f535638ca admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:31.895341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50eb80-4dee-4a2d-87a4-4d75814ba8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:31.896372 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50eb80-4dee-4a2d-87a4-4d75814ba8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:31.896910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50eb80-4dee-4a2d-87a4-4d75814ba8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:31.897390 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50eb80-4dee-4a2d-87a4-4d75814ba8d7 admin admin] PATH_INFO: `/v3/users/e603a96d92574b5f87b0784d5718d95b` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:31.899354 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50eb80-4dee-4a2d-87a4-4d75814ba8d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e603a96d92574b5f87b0784d5718d95b)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:31.903098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50eb80-4dee-4a2d-87a4-4d75814ba8d7 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:32.010162 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1e50eb80-4dee-4a2d-87a4-4d75814ba8d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e603a96d92574b5f87b0784d5718d95b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:32.011785 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1e50eb80-4dee-4a2d-87a4-4d75814ba8d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e603a96d92574b5f87b0784d5718d95b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:32.036805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfaebc5-06ef-4799-b2d2-cef6bdaa1427 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:32.047263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32145457-8a1c-4ab1-ae0e-c78bca51b3e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:32.047421 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1e50eb80-4dee-4a2d-87a4-4d75814ba8d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e603a96d92574b5f87b0784d5718d95b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:32.048569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32145457-8a1c-4ab1-ae0e-c78bca51b3e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:32.050720 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32145457-8a1c-4ab1-ae0e-c78bca51b3e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:32.051041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32145457-8a1c-4ab1-ae0e-c78bca51b3e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:32.056245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-32145457-8a1c-4ab1-ae0e-c78bca51b3e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:32.059166 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1e50eb80-4dee-4a2d-87a4-4d75814ba8d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e603a96d92574b5f87b0784d5718d95b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:32.073521 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1e50eb80-4dee-4a2d-87a4-4d75814ba8d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e603a96d92574b5f87b0784d5718d95b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:32.081798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1051/2113] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:31 2022] DELETE /identity/v3/users/e603a96d92574b5f87b0784d5718d95b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:32.083776 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50eb80-4dee-4a2d-87a4-4d75814ba8d7 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:32.088286 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1e50eb80-4dee-4a2d-87a4-4d75814ba8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:32.197180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32145457-8a1c-4ab1-ae0e-c78bca51b3e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:32.202826 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32145457-8a1c-4ab1-ae0e-c78bca51b3e1 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:32.216856 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1063/2114] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:32.245345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50eb80-4dee-4a2d-87a4-4d75814ba8d7 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:32.266603 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecc248-d595-4af5-954e-58d376ba2737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:32.267271 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecc248-d595-4af5-954e-58d376ba2737 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:32.267535 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecc248-d595-4af5-954e-58d376ba2737 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:32.267807 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecc248-d595-4af5-954e-58d376ba2737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:32.272928 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-dfecc248-d595-4af5-954e-58d376ba2737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:32.288456 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:32.402764 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecc248-d595-4af5-954e-58d376ba2737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:32.405917 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecc248-d595-4af5-954e-58d376ba2737 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:32.423153 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1052/2115] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:32.623718 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32145457-8a1c-4ab1-ae0e-c78bca51b3e1 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:32.625270 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-32145457-8a1c-4ab1-ae0e-c78bca51b3e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:32.636104 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:32.650918 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32145457-8a1c-4ab1-ae0e-c78bca51b3e1 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:32.673632 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a956512-3fed-4a7a-a6fb-5226939e51d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:32.674636 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956512-3fed-4a7a-a6fb-5226939e51d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:32.674950 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956512-3fed-4a7a-a6fb-5226939e51d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:32.675224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956512-3fed-4a7a-a6fb-5226939e51d6 admin admin] PATH_INFO: `/v3/projects/a85416e5fa2c4ad49488c7e8f6eda8da` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:32.677355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a956512-3fed-4a7a-a6fb-5226939e51d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a85416e5fa2c4ad49488c7e8f6eda8da)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:32.679385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a956512-3fed-4a7a-a6fb-5226939e51d6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:32.764302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9a956512-3fed-4a7a-a6fb-5226939e51d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85416e5fa2c4ad49488c7e8f6eda8da', 'request_id': 'req-9a956512-3fed-4a7a-a6fb-5226939e51d6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:32.772987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9a956512-3fed-4a7a-a6fb-5226939e51d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85416e5fa2c4ad49488c7e8f6eda8da', 'request_id': 'req-9a956512-3fed-4a7a-a6fb-5226939e51d6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:32.783883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9a956512-3fed-4a7a-a6fb-5226939e51d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85416e5fa2c4ad49488c7e8f6eda8da', 'request_id': 'req-9a956512-3fed-4a7a-a6fb-5226939e51d6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:32.797321 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9a956512-3fed-4a7a-a6fb-5226939e51d6 admin admin] The token cache is being invalidate because project a85416e5fa2c4ad49488c7e8f6eda8da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:32.797611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9a956512-3fed-4a7a-a6fb-5226939e51d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:32.798274 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9a956512-3fed-4a7a-a6fb-5226939e51d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:32.800103 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1064/2116] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:32 2022] DELETE /identity/v3/projects/a85416e5fa2c4ad49488c7e8f6eda8da => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:32.804910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d41bc-daa8-43de-9aa8-99075e9536ca None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:32.805277 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d41bc-daa8-43de-9aa8-99075e9536ca None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:32.805555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d41bc-daa8-43de-9aa8-99075e9536ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:32.825740 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-0f2d41bc-daa8-43de-9aa8-99075e9536ca None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:32.826969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0f2d41bc-daa8-43de-9aa8-99075e9536ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:32.892675 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1053/2117] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:32.900871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafdda1-559d-4e84-9fed-81db88bcf69f None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:32.901206 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafdda1-559d-4e84-9fed-81db88bcf69f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:32.901417 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafdda1-559d-4e84-9fed-81db88bcf69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:32.922833 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-bcafdda1-559d-4e84-9fed-81db88bcf69f None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:32.924059 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bcafdda1-559d-4e84-9fed-81db88bcf69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:32.933258 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1065/2118] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:32.937433 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d41bc-daa8-43de-9aa8-99075e9536ca None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:32.948257 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafdda1-559d-4e84-9fed-81db88bcf69f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:32.950769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d41bc-daa8-43de-9aa8-99075e9536ca None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:32.951771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bcafdda1-559d-4e84-9fed-81db88bcf69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:32.955727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74e2d1-8a86-4950-8a02-394892cc7916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:32.956336 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74e2d1-8a86-4950-8a02-394892cc7916 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:32.956643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74e2d1-8a86-4950-8a02-394892cc7916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:32.956913 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74e2d1-8a86-4950-8a02-394892cc7916 admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:32.957570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74e2d1-8a86-4950-8a02-394892cc7916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:32.957872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74e2d1-8a86-4950-8a02-394892cc7916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:32.959481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74e2d1-8a86-4950-8a02-394892cc7916 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:32.966591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafdda1-559d-4e84-9fed-81db88bcf69f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:32.972117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37639895-3cdf-4f0f-a47b-b10a7d1f832f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:32.972830 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37639895-3cdf-4f0f-a47b-b10a7d1f832f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:32.973176 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37639895-3cdf-4f0f-a47b-b10a7d1f832f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:32.973517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37639895-3cdf-4f0f-a47b-b10a7d1f832f admin admin] PATH_INFO: `/v3/projects/9a0a82a5538f47159d044a1a333986a8` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:32.974088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1054/2119] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:33:32.974846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37639895-3cdf-4f0f-a47b-b10a7d1f832f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0a82a5538f47159d044a1a333986a8)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:32.976759 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37639895-3cdf-4f0f-a47b-b10a7d1f832f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:32.978649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74e2d1-8a86-4950-8a02-394892cc7916 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:32.990182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74e2d1-8a86-4950-8a02-394892cc7916 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:32.995810 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab8e88-141b-4fc6-b920-d7f0ae628592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:32.996428 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab8e88-141b-4fc6-b920-d7f0ae628592 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:32.996685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab8e88-141b-4fc6-b920-d7f0ae628592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:32.996959 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab8e88-141b-4fc6-b920-d7f0ae628592 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:32.997581 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab8e88-141b-4fc6-b920-d7f0ae628592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:32.999507 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab8e88-141b-4fc6-b920-d7f0ae628592 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:33.032969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1055/2120] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:32 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:33:33.033172 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-37639895-3cdf-4f0f-a47b-b10a7d1f832f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0a82a5538f47159d044a1a333986a8', 'request_id': 'req-37639895-3cdf-4f0f-a47b-b10a7d1f832f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.034840 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab8e88-141b-4fc6-b920-d7f0ae628592 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:33.038692 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-37639895-3cdf-4f0f-a47b-b10a7d1f832f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0a82a5538f47159d044a1a333986a8', 'request_id': 'req-37639895-3cdf-4f0f-a47b-b10a7d1f832f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.045002 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-37639895-3cdf-4f0f-a47b-b10a7d1f832f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0a82a5538f47159d044a1a333986a8', 'request_id': 'req-37639895-3cdf-4f0f-a47b-b10a7d1f832f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.058156 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-37639895-3cdf-4f0f-a47b-b10a7d1f832f admin admin] The token cache is being invalidate because project 9a0a82a5538f47159d044a1a333986a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:33.058583 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-37639895-3cdf-4f0f-a47b-b10a7d1f832f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.059296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-37639895-3cdf-4f0f-a47b-b10a7d1f832f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.060796 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1066/2121] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:32 2022] DELETE /identity/v3/projects/9a0a82a5538f47159d044a1a333986a8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:33.064603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37639895-3cdf-4f0f-a47b-b10a7d1f832f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:33.065900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-37639895-3cdf-4f0f-a47b-b10a7d1f832f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:33.108220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab8e88-141b-4fc6-b920-d7f0ae628592 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:33.112863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daab516-bf4f-4ee4-a1e0-e230298d033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:33.113470 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daab516-bf4f-4ee4-a1e0-e230298d033c admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:33.113813 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daab516-bf4f-4ee4-a1e0-e230298d033c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:33.114091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daab516-bf4f-4ee4-a1e0-e230298d033c admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:33.114965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daab516-bf4f-4ee4-a1e0-e230298d033c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:33.116887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daab516-bf4f-4ee4-a1e0-e230298d033c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:33.134268 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:33.135186 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37639895-3cdf-4f0f-a47b-b10a7d1f832f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:33.140532 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1056/2122] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:33 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:33:33.144093 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daab516-bf4f-4ee4-a1e0-e230298d033c admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:33.144865 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7f9bd-634d-4206-b542-7838292b3c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:33.145627 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7f9bd-634d-4206-b542-7838292b3c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:33.145912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7f9bd-634d-4206-b542-7838292b3c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:33.146186 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7f9bd-634d-4206-b542-7838292b3c5f admin admin] PATH_INFO: `/v3/users/0a4b555f17f04241bfb44fe18856d6d0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:33.146388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7daab516-bf4f-4ee4-a1e0-e230298d033c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:33.148016 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7f9bd-634d-4206-b542-7838292b3c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4b555f17f04241bfb44fe18856d6d0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:33.149971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7f9bd-634d-4206-b542-7838292b3c5f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:33.153522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:33.163277 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daab516-bf4f-4ee4-a1e0-e230298d033c admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:33.169368 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1baef-acea-49d6-b433-7ef059adcf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:33.169968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1baef-acea-49d6-b433-7ef059adcf59 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:33.170244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1baef-acea-49d6-b433-7ef059adcf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:33.170517 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1baef-acea-49d6-b433-7ef059adcf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:33.171305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1baef-acea-49d6-b433-7ef059adcf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:33.172949 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1baef-acea-49d6-b433-7ef059adcf59 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:33.188481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1057/2123] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:33.189986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1baef-acea-49d6-b433-7ef059adcf59 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:33.200724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1baef-acea-49d6-b433-7ef059adcf59 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:33.205903 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a3c28-220d-444f-9b26-f210b360be16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:33.206507 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a3c28-220d-444f-9b26-f210b360be16 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:33.206870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a3c28-220d-444f-9b26-f210b360be16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:33.207097 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a3c28-220d-444f-9b26-f210b360be16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:33.208610 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a3c28-220d-444f-9b26-f210b360be16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:33.209453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a3c28-220d-444f-9b26-f210b360be16 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:33.211583 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-44e7f9bd-634d-4206-b542-7838292b3c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4b555f17f04241bfb44fe18856d6d0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.212579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-44e7f9bd-634d-4206-b542-7838292b3c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4b555f17f04241bfb44fe18856d6d0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.221067 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1058/2124] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:33.221681 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-44e7f9bd-634d-4206-b542-7838292b3c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4b555f17f04241bfb44fe18856d6d0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.225150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a3c28-220d-444f-9b26-f210b360be16 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:33.227524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c41a3c28-220d-444f-9b26-f210b360be16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:33.236454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-44e7f9bd-634d-4206-b542-7838292b3c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4b555f17f04241bfb44fe18856d6d0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.240971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a3c28-220d-444f-9b26-f210b360be16 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:33.245343 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-44e7f9bd-634d-4206-b542-7838292b3c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4b555f17f04241bfb44fe18856d6d0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.246846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad73d7-c73a-4bb4-89ab-79fc5b73c87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:33.247499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad73d7-c73a-4bb4-89ab-79fc5b73c87c admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:33.247777 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad73d7-c73a-4bb4-89ab-79fc5b73c87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:33.248051 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad73d7-c73a-4bb4-89ab-79fc5b73c87c admin admin] PATH_INFO: `/v3/projects/5063d960997d43d9a86ac7de73d675c3/users/2f6768107d9d4d58b9c89eb7e8df65bd/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:33.252649 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1067/2125] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:33 2022] DELETE /identity/v3/users/0a4b555f17f04241bfb44fe18856d6d0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:33.275235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad73d7-c73a-4bb4-89ab-79fc5b73c87c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5063d960997d43d9a86ac7de73d675c3, user_id=2f6768107d9d4d58b9c89eb7e8df65bd, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:33.279104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad73d7-c73a-4bb4-89ab-79fc5b73c87c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:33.297885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1059/2126] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:33 2022] PUT /identity/v3/projects/5063d960997d43d9a86ac7de73d675c3/users/2f6768107d9d4d58b9c89eb7e8df65bd/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:33.311403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af7dc6-8ead-49d1-a04f-c86c5a06d395 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:33.311403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af7dc6-8ead-49d1-a04f-c86c5a06d395 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:33.311403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af7dc6-8ead-49d1-a04f-c86c5a06d395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:33.337501 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad73d7-c73a-4bb4-89ab-79fc5b73c87c admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:33.340214 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d0ad73d7-c73a-4bb4-89ab-79fc5b73c87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:33.347588 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-66af7dc6-8ead-49d1-a04f-c86c5a06d395 None None] MFA Rules not processed for user `2f6768107d9d4d58b9c89eb7e8df65bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:33.348995 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-66af7dc6-8ead-49d1-a04f-c86c5a06d395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:33.426039 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1068/2127] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:33.426911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad73d7-c73a-4bb4-89ab-79fc5b73c87c admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:33.433734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9556047-c2ee-4fff-9ef9-de159e603718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:33.434750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9556047-c2ee-4fff-9ef9-de159e603718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:33.435036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9556047-c2ee-4fff-9ef9-de159e603718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:33.435322 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9556047-c2ee-4fff-9ef9-de159e603718 admin admin] PATH_INFO: `/v3/users/e08f8e3c1b594042918b67562deb6240` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:33.437267 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9556047-c2ee-4fff-9ef9-de159e603718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e08f8e3c1b594042918b67562deb6240)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:33.437677 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af7dc6-8ead-49d1-a04f-c86c5a06d395 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:33.439158 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9556047-c2ee-4fff-9ef9-de159e603718 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:33.439564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-66af7dc6-8ead-49d1-a04f-c86c5a06d395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:33.496625 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a9556047-c2ee-4fff-9ef9-de159e603718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e08f8e3c1b594042918b67562deb6240'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.497685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a9556047-c2ee-4fff-9ef9-de159e603718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e08f8e3c1b594042918b67562deb6240'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.514414 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a9556047-c2ee-4fff-9ef9-de159e603718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e08f8e3c1b594042918b67562deb6240'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.526873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a9556047-c2ee-4fff-9ef9-de159e603718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e08f8e3c1b594042918b67562deb6240'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.538121 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a9556047-c2ee-4fff-9ef9-de159e603718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e08f8e3c1b594042918b67562deb6240'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.542316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af7dc6-8ead-49d1-a04f-c86c5a06d395 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:33.549905 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1060/2128] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:33 2022] DELETE /identity/v3/users/e08f8e3c1b594042918b67562deb6240 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:33.555474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de58e6-1382-4656-9de1-ba0c2953981d None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:33.555697 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de58e6-1382-4656-9de1-ba0c2953981d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:33.555969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de58e6-1382-4656-9de1-ba0c2953981d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:33.556313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a0869-67b1-409d-83a2-bc223c6e32da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:33.557537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a0869-67b1-409d-83a2-bc223c6e32da service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:33.558331 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a0869-67b1-409d-83a2-bc223c6e32da service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:33.558950 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a0869-67b1-409d-83a2-bc223c6e32da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:33.561837 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4b8a0869-67b1-409d-83a2-bc223c6e32da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:33.575980 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a0869-67b1-409d-83a2-bc223c6e32da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:33.577563 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a0869-67b1-409d-83a2-bc223c6e32da service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:33.578088 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-f0de58e6-1382-4656-9de1-ba0c2953981d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:33.579321 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f0de58e6-1382-4656-9de1-ba0c2953981d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:33.588436 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1069/2129] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:33:33.609886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a0869-67b1-409d-83a2-bc223c6e32da service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:33.619085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4b8a0869-67b1-409d-83a2-bc223c6e32da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:33.621630 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:33.640107 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a0869-67b1-409d-83a2-bc223c6e32da service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:33.658780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:33.665483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1061/2130] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:33.666483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de58e6-1382-4656-9de1-ba0c2953981d None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:33.667806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f0de58e6-1382-4656-9de1-ba0c2953981d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:33.686054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de58e6-1382-4656-9de1-ba0c2953981d None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:33.691525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:33.692279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:33.692659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:33.693043 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f admin admin] PATH_INFO: `/v3/projects/2eedee5d9ce2470eb3102b3795b8cab9` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:33.694570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eedee5d9ce2470eb3102b3795b8cab9)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:33.697727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:33.740439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50142585-59bc-40ca-ae2d-3dd3595064a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:33.741073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50142585-59bc-40ca-ae2d-3dd3595064a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:33.741398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50142585-59bc-40ca-ae2d-3dd3595064a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:33.741671 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50142585-59bc-40ca-ae2d-3dd3595064a2 admin admin] PATH_INFO: `/v3/users/2f6768107d9d4d58b9c89eb7e8df65bd` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:33.743454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50142585-59bc-40ca-ae2d-3dd3595064a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6768107d9d4d58b9c89eb7e8df65bd)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:33.745433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50142585-59bc-40ca-ae2d-3dd3595064a2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:33.772656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eedee5d9ce2470eb3102b3795b8cab9', 'request_id': 'req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.783424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eedee5d9ce2470eb3102b3795b8cab9', 'request_id': 'req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.791724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eedee5d9ce2470eb3102b3795b8cab9', 'request_id': 'req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.798464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-50142585-59bc-40ca-ae2d-3dd3595064a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6768107d9d4d58b9c89eb7e8df65bd'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.799576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-50142585-59bc-40ca-ae2d-3dd3595064a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6768107d9d4d58b9c89eb7e8df65bd'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.803023 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f admin admin] The token cache is being invalidate because project 2eedee5d9ce2470eb3102b3795b8cab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:33.803275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.804233 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.805874 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1062/2131] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:33 2022] DELETE /identity/v3/projects/2eedee5d9ce2470eb3102b3795b8cab9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:33.806954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:33.808821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:33.811994 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-50142585-59bc-40ca-ae2d-3dd3595064a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6768107d9d4d58b9c89eb7e8df65bd'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.826305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-50142585-59bc-40ca-ae2d-3dd3595064a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6768107d9d4d58b9c89eb7e8df65bd'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.835961 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-50142585-59bc-40ca-ae2d-3dd3595064a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6768107d9d4d58b9c89eb7e8df65bd'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:33.843478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1070/2132] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:33 2022] DELETE /identity/v3/users/2f6768107d9d4d58b9c89eb7e8df65bd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:33.844775 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c60222-3f62-4210-96a3-e3c4f083b96b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:33.845111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c60222-3f62-4210-96a3-e3c4f083b96b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:33.845445 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c60222-3f62-4210-96a3-e3c4f083b96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:33.867161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-70c60222-3f62-4210-96a3-e3c4f083b96b None None] MFA Rules not processed for user `2795b294fed84c8cac4d3f481a3eb24d`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:33.871209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-70c60222-3f62-4210-96a3-e3c4f083b96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:33.889708 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553b1c6-cec8-47d7-b23f-96c0a72bb98f admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:33.934952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1071/2133] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:33.936421 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f758aab-4703-4045-a6b9-c962fe318070 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:33.936698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f758aab-4703-4045-a6b9-c962fe318070 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:33.936971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f758aab-4703-4045-a6b9-c962fe318070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:33.939359 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1187141-f2de-4d79-8f04-80ac164b6cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:33.940162 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1187141-f2de-4d79-8f04-80ac164b6cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:33.940491 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1187141-f2de-4d79-8f04-80ac164b6cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:33.940766 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1187141-f2de-4d79-8f04-80ac164b6cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:33.942633 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a1187141-f2de-4d79-8f04-80ac164b6cf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:33.957167 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-0f758aab-4703-4045-a6b9-c962fe318070 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:33.958359 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0f758aab-4703-4045-a6b9-c962fe318070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:33.972737 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:33.994604 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:34.020672 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1187141-f2de-4d79-8f04-80ac164b6cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:34.022274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1187141-f2de-4d79-8f04-80ac164b6cf9 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:34.029696 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1072/2134] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:34.031436 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a3e44-02d9-4b45-8ab0-875057a80ebe None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:34.031902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a3e44-02d9-4b45-8ab0-875057a80ebe None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:34.032337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a3e44-02d9-4b45-8ab0-875057a80ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:34.040796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1063/2135] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:34.041700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a7383-38d9-4836-b725-8107bb9a6e70 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:34.041992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a7383-38d9-4836-b725-8107bb9a6e70 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:34.042266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a7383-38d9-4836-b725-8107bb9a6e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:34.054579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-c23a3e44-02d9-4b45-8ab0-875057a80ebe None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:34.056611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c23a3e44-02d9-4b45-8ab0-875057a80ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:34.063377 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-d04a7383-38d9-4836-b725-8107bb9a6e70 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:34.064543 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1073/2136] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:34.064657 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d04a7383-38d9-4836-b725-8107bb9a6e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:34.074822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1064/2137] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:34.074978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a3e44-02d9-4b45-8ab0-875057a80ebe None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:34.076186 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c23a3e44-02d9-4b45-8ab0-875057a80ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:34.078662 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a7383-38d9-4836-b725-8107bb9a6e70 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:34.089172 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a7383-38d9-4836-b725-8107bb9a6e70 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:34.089937 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a3e44-02d9-4b45-8ab0-875057a80ebe None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:34.094536 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c1498-5f0f-45bf-b87c-9de9280516ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:34.095023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca3423-4c60-4756-8420-2da2cd689569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:34.095299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c1498-5f0f-45bf-b87c-9de9280516ac admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:34.095570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c1498-5f0f-45bf-b87c-9de9280516ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:34.095845 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c1498-5f0f-45bf-b87c-9de9280516ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:34.095954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca3423-4c60-4756-8420-2da2cd689569 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:34.096237 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca3423-4c60-4756-8420-2da2cd689569 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:34.096494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c1498-5f0f-45bf-b87c-9de9280516ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:34.096607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca3423-4c60-4756-8420-2da2cd689569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:34.096796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c1498-5f0f-45bf-b87c-9de9280516ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:34.098447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c1498-5f0f-45bf-b87c-9de9280516ac admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:34.108617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca3423-4c60-4756-8420-2da2cd689569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:34.110565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca3423-4c60-4756-8420-2da2cd689569 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:34.114780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1065/2138] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:33:34.118883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c1498-5f0f-45bf-b87c-9de9280516ac admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:34.123016 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1074/2139] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:33:34.134514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c1498-5f0f-45bf-b87c-9de9280516ac admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:34.141419 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd6622-647e-40dd-be5e-b509fd3042b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:34.141693 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd6622-647e-40dd-be5e-b509fd3042b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:34.141992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd6622-647e-40dd-be5e-b509fd3042b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:34.142265 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd6622-647e-40dd-be5e-b509fd3042b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:34.142880 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd6622-647e-40dd-be5e-b509fd3042b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:34.144836 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd6622-647e-40dd-be5e-b509fd3042b6 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:34.185246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1066/2140] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:34 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:34.187403 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca3423-4c60-4756-8420-2da2cd689569 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:34.202714 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca3423-4c60-4756-8420-2da2cd689569 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:34.319774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe34d38-cb94-460e-9131-a2641b31708b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:34.320399 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe34d38-cb94-460e-9131-a2641b31708b admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:34.320681 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe34d38-cb94-460e-9131-a2641b31708b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:34.321521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe34d38-cb94-460e-9131-a2641b31708b admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:34.322168 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe34d38-cb94-460e-9131-a2641b31708b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:34.324164 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe34d38-cb94-460e-9131-a2641b31708b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:34.365175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1075/2141] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:34 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:34.371540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd6622-647e-40dd-be5e-b509fd3042b6 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:34.385968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd6622-647e-40dd-be5e-b509fd3042b6 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:34.392415 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7859d27-7158-4925-b645-002bed859aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:34.393558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7859d27-7158-4925-b645-002bed859aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:34.393844 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7859d27-7158-4925-b645-002bed859aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:34.394121 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7859d27-7158-4925-b645-002bed859aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:34.395395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7859d27-7158-4925-b645-002bed859aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:34.397343 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7859d27-7158-4925-b645-002bed859aa7 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:34.417831 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1067/2142] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:34.419168 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe34d38-cb94-460e-9131-a2641b31708b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:34.430041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe34d38-cb94-460e-9131-a2641b31708b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:34.435500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b91b3-685e-47dd-b141-0d1042c354c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:34.436041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b91b3-685e-47dd-b141-0d1042c354c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:34.436320 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b91b3-685e-47dd-b141-0d1042c354c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:34.436591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b91b3-685e-47dd-b141-0d1042c354c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:34.437242 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b91b3-685e-47dd-b141-0d1042c354c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:34.438895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b91b3-685e-47dd-b141-0d1042c354c6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:34.454666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1076/2143] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:34.457261 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7859d27-7158-4925-b645-002bed859aa7 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:34.469507 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7859d27-7158-4925-b645-002bed859aa7 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:34.478465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e0674-3269-4bb0-ba96-e03f4a3225b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:34.479854 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e0674-3269-4bb0-ba96-e03f4a3225b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:34.480402 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e0674-3269-4bb0-ba96-e03f4a3225b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:34.480913 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e0674-3269-4bb0-ba96-e03f4a3225b0 admin admin] PATH_INFO: `/v3/projects/1973b9e7c32243808c4070c190479d86/users/5ab30642585e472db7a87e067b39da8f/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:34.500436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e0674-3269-4bb0-ba96-e03f4a3225b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1973b9e7c32243808c4070c190479d86, user_id=5ab30642585e472db7a87e067b39da8f, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:34.503094 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e0674-3269-4bb0-ba96-e03f4a3225b0 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:34.503956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b91b3-685e-47dd-b141-0d1042c354c6 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:34.506150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2c2b91b3-685e-47dd-b141-0d1042c354c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:34.521532 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b91b3-685e-47dd-b141-0d1042c354c6 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:34.523689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1068/2144] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:34 2022] PUT /identity/v3/projects/1973b9e7c32243808c4070c190479d86/users/5ab30642585e472db7a87e067b39da8f/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:34.535261 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488acb75-9d70-4d70-b32a-38fafd337e31 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:34.535642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488acb75-9d70-4d70-b32a-38fafd337e31 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:34.536009 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488acb75-9d70-4d70-b32a-38fafd337e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:34.572036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-488acb75-9d70-4d70-b32a-38fafd337e31 None None] MFA Rules not processed for user `5ab30642585e472db7a87e067b39da8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:34.573578 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-488acb75-9d70-4d70-b32a-38fafd337e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:34.646046 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e6487-5c77-491f-90d3-e3e0ae623e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:34.646817 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e6487-5c77-491f-90d3-e3e0ae623e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:34.646975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e6487-5c77-491f-90d3-e3e0ae623e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:34.647253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e6487-5c77-491f-90d3-e3e0ae623e0b admin admin] PATH_INFO: `/v3/projects/5063d960997d43d9a86ac7de73d675c3` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:34.648409 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e6487-5c77-491f-90d3-e3e0ae623e0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5063d960997d43d9a86ac7de73d675c3)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:34.650462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e6487-5c77-491f-90d3-e3e0ae623e0b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:34.669590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1069/2145] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:34.670771 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488acb75-9d70-4d70-b32a-38fafd337e31 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:34.673348 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-488acb75-9d70-4d70-b32a-38fafd337e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:34.691389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488acb75-9d70-4d70-b32a-38fafd337e31 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:34.700435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:34.709856 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-786e6487-5c77-491f-90d3-e3e0ae623e0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5063d960997d43d9a86ac7de73d675c3', 'request_id': 'req-786e6487-5c77-491f-90d3-e3e0ae623e0b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:34.718844 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-786e6487-5c77-491f-90d3-e3e0ae623e0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5063d960997d43d9a86ac7de73d675c3', 'request_id': 'req-786e6487-5c77-491f-90d3-e3e0ae623e0b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:34.726151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-786e6487-5c77-491f-90d3-e3e0ae623e0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5063d960997d43d9a86ac7de73d675c3', 'request_id': 'req-786e6487-5c77-491f-90d3-e3e0ae623e0b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:34.732017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:34.740732 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-786e6487-5c77-491f-90d3-e3e0ae623e0b admin admin] The token cache is being invalidate because project 5063d960997d43d9a86ac7de73d675c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:34.741024 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-786e6487-5c77-491f-90d3-e3e0ae623e0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:34.741704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-786e6487-5c77-491f-90d3-e3e0ae623e0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:34.744122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1077/2146] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:34 2022] DELETE /identity/v3/projects/5063d960997d43d9a86ac7de73d675c3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:34.744905 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e6487-5c77-491f-90d3-e3e0ae623e0b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:34.746216 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-786e6487-5c77-491f-90d3-e3e0ae623e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:34.784961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433764a-c956-4bf8-989e-998788ed0b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:34.786655 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433764a-c956-4bf8-989e-998788ed0b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:34.786655 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433764a-c956-4bf8-989e-998788ed0b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:34.786854 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433764a-c956-4bf8-989e-998788ed0b36 admin admin] PATH_INFO: `/v3/projects/2871dd46268e4481b0c99bc8cc010285` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:34.806025 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433764a-c956-4bf8-989e-998788ed0b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2871dd46268e4481b0c99bc8cc010285)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:34.808253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433764a-c956-4bf8-989e-998788ed0b36 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:34.831084 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e6487-5c77-491f-90d3-e3e0ae623e0b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:34.835994 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54e3d0-312e-4578-86e7-c25d9b26bd18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:34.837005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54e3d0-312e-4578-86e7-c25d9b26bd18 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:34.837338 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54e3d0-312e-4578-86e7-c25d9b26bd18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:34.837607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54e3d0-312e-4578-86e7-c25d9b26bd18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:34.839675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cc54e3d0-312e-4578-86e7-c25d9b26bd18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:34.880107 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-9433764a-c956-4bf8-989e-998788ed0b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2871dd46268e4481b0c99bc8cc010285', 'request_id': 'req-9433764a-c956-4bf8-989e-998788ed0b36'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:34.893370 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-9433764a-c956-4bf8-989e-998788ed0b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2871dd46268e4481b0c99bc8cc010285', 'request_id': 'req-9433764a-c956-4bf8-989e-998788ed0b36'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:34.908220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-9433764a-c956-4bf8-989e-998788ed0b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2871dd46268e4481b0c99bc8cc010285', 'request_id': 'req-9433764a-c956-4bf8-989e-998788ed0b36'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:34.924862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-9433764a-c956-4bf8-989e-998788ed0b36 admin admin] The token cache is being invalidate because project 2871dd46268e4481b0c99bc8cc010285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:34.925358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-9433764a-c956-4bf8-989e-998788ed0b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:34.926041 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-9433764a-c956-4bf8-989e-998788ed0b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:34.928487 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1070/2147] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:34 2022] DELETE /identity/v3/projects/2871dd46268e4481b0c99bc8cc010285 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:34.929966 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787adbf-f091-410c-9854-e8a01491c194 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:34.930117 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787adbf-f091-410c-9854-e8a01491c194 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:34.930867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787adbf-f091-410c-9854-e8a01491c194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:34.945595 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54e3d0-312e-4578-86e7-c25d9b26bd18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:34.948966 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54e3d0-312e-4578-86e7-c25d9b26bd18 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:34.955149 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-9787adbf-f091-410c-9854-e8a01491c194 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:34.956534 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-9787adbf-f091-410c-9854-e8a01491c194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:34.973195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1078/2148] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:34.974276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54e3d0-312e-4578-86e7-c25d9b26bd18 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:34.979139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cc54e3d0-312e-4578-86e7-c25d9b26bd18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:35.002009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54e3d0-312e-4578-86e7-c25d9b26bd18 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:35.044232 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1071/2149] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:35.046265 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207896b-c5fa-442c-984b-b5c2a82e4fc9 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:35.046597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207896b-c5fa-442c-984b-b5c2a82e4fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:35.046914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207896b-c5fa-442c-984b-b5c2a82e4fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:35.082055 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-0207896b-c5fa-442c-984b-b5c2a82e4fc9 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:35.084227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0207896b-c5fa-442c-984b-b5c2a82e4fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:35.115468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1072/2150] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:35.120004 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8910a1-b016-451a-b1b5-1fb1f228f992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:35.120349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207896b-c5fa-442c-984b-b5c2a82e4fc9 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:35.121302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8910a1-b016-451a-b1b5-1fb1f228f992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:35.121863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8910a1-b016-451a-b1b5-1fb1f228f992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:35.122411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8910a1-b016-451a-b1b5-1fb1f228f992 admin admin] PATH_INFO: `/v3/users/3c7da21125f5435788f5385b2fff31d7` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:35.124173 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8910a1-b016-451a-b1b5-1fb1f228f992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7da21125f5435788f5385b2fff31d7)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:35.126552 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8910a1-b016-451a-b1b5-1fb1f228f992 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:35.141350 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207896b-c5fa-442c-984b-b5c2a82e4fc9 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:35.156445 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8cd18-10c7-4012-a13c-a7c6eb97266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:35.157161 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8cd18-10c7-4012-a13c-a7c6eb97266f admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:35.158842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8cd18-10c7-4012-a13c-a7c6eb97266f admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:35.159606 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8cd18-10c7-4012-a13c-a7c6eb97266f admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:35.160773 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8cd18-10c7-4012-a13c-a7c6eb97266f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:35.161979 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8cd18-10c7-4012-a13c-a7c6eb97266f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:35.164003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8cd18-10c7-4012-a13c-a7c6eb97266f admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:35.173886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:35.191727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1073/2151] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:33:35.200703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8cd18-10c7-4012-a13c-a7c6eb97266f admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:35.231059 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8cd18-10c7-4012-a13c-a7c6eb97266f admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:35.238072 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340c682-c438-4bc2-9d72-6a4aed194ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:35.239086 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340c682-c438-4bc2-9d72-6a4aed194ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:35.239722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340c682-c438-4bc2-9d72-6a4aed194ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:35.240182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340c682-c438-4bc2-9d72-6a4aed194ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:35.241461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340c682-c438-4bc2-9d72-6a4aed194ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:35.245043 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340c682-c438-4bc2-9d72-6a4aed194ec8 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:35.252665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cb8910a1-b016-451a-b1b5-1fb1f228f992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7da21125f5435788f5385b2fff31d7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:35.253938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cb8910a1-b016-451a-b1b5-1fb1f228f992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7da21125f5435788f5385b2fff31d7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:35.267611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cb8910a1-b016-451a-b1b5-1fb1f228f992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7da21125f5435788f5385b2fff31d7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:35.282017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1074/2152] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:35 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:35.285635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340c682-c438-4bc2-9d72-6a4aed194ec8 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:35.290887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b340c682-c438-4bc2-9d72-6a4aed194ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:35.293084 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cb8910a1-b016-451a-b1b5-1fb1f228f992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7da21125f5435788f5385b2fff31d7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:35.316571 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cb8910a1-b016-451a-b1b5-1fb1f228f992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7da21125f5435788f5385b2fff31d7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:35.329408 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1079/2153] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:34 2022] DELETE /identity/v3/users/3c7da21125f5435788f5385b2fff31d7 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:35.369540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:35.427927 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340c682-c438-4bc2-9d72-6a4aed194ec8 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:35.512387 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69635d8f-f923-4ef8-919e-c2b5b8686473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:35.513803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69635d8f-f923-4ef8-919e-c2b5b8686473 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:35.514377 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69635d8f-f923-4ef8-919e-c2b5b8686473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:35.514676 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69635d8f-f923-4ef8-919e-c2b5b8686473 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:35.516753 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69635d8f-f923-4ef8-919e-c2b5b8686473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:35.520476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69635d8f-f923-4ef8-919e-c2b5b8686473 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:35.565523 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1075/2154] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:35 2022] POST /identity/v3/users => generated 292 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:35.572164 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8910a1-b016-451a-b1b5-1fb1f228f992 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:35.598744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8910a1-b016-451a-b1b5-1fb1f228f992 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:35.604883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c9d76-4212-4695-9d16-80f0e61a1483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:35.605470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c9d76-4212-4695-9d16-80f0e61a1483 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:35.605680 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c9d76-4212-4695-9d16-80f0e61a1483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:35.605953 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c9d76-4212-4695-9d16-80f0e61a1483 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:35.606632 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c9d76-4212-4695-9d16-80f0e61a1483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:35.608605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c9d76-4212-4695-9d16-80f0e61a1483 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:35.628355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1080/2155] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:35.629142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69635d8f-f923-4ef8-919e-c2b5b8686473 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:35.652011 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69635d8f-f923-4ef8-919e-c2b5b8686473 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:35.659281 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e6585-6c2f-4d4a-8957-7cb68637462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:35.659901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e6585-6c2f-4d4a-8957-7cb68637462c admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:35.660349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e6585-6c2f-4d4a-8957-7cb68637462c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:35.660641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e6585-6c2f-4d4a-8957-7cb68637462c admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:35.661287 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e6585-6c2f-4d4a-8957-7cb68637462c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:35.663835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e6585-6c2f-4d4a-8957-7cb68637462c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:35.679615 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1076/2156] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:35.683460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c9d76-4212-4695-9d16-80f0e61a1483 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:35.700413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c9d76-4212-4695-9d16-80f0e61a1483 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:35.716266 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede0db6-769f-42d3-a13a-02710e81c48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:35.719862 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede0db6-769f-42d3-a13a-02710e81c48f admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:35.720216 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede0db6-769f-42d3-a13a-02710e81c48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:35.720500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede0db6-769f-42d3-a13a-02710e81c48f admin admin] PATH_INFO: `/v3/projects/bb3e8e830484448cac65e7629e8c25d9/users/f8d30ea9f0374b28bdfb50c567d96d6a/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:35.791160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede0db6-769f-42d3-a13a-02710e81c48f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3e8e830484448cac65e7629e8c25d9, user_id=f8d30ea9f0374b28bdfb50c567d96d6a, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:35.795822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede0db6-769f-42d3-a13a-02710e81c48f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:35.861951 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1081/2157] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:35 2022] PUT /identity/v3/projects/bb3e8e830484448cac65e7629e8c25d9/users/f8d30ea9f0374b28bdfb50c567d96d6a/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:35.867089 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c9aa-376b-438e-b9d8-3fb0e1d8ef48 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:35.867426 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c9aa-376b-438e-b9d8-3fb0e1d8ef48 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:35.868274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c9aa-376b-438e-b9d8-3fb0e1d8ef48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:35.903210 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-5bc2c9aa-376b-438e-b9d8-3fb0e1d8ef48 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:35.904457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5bc2c9aa-376b-438e-b9d8-3fb0e1d8ef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:36.042109 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1077/2158] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:36.056156 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede0db6-769f-42d3-a13a-02710e81c48f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:36.060553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fede0db6-769f-42d3-a13a-02710e81c48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:36.160871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede0db6-769f-42d3-a13a-02710e81c48f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:36.165415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f6ce5-7c51-4cb0-a216-b5242096e82f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:36.166890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f6ce5-7c51-4cb0-a216-b5242096e82f service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:36.167627 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f6ce5-7c51-4cb0-a216-b5242096e82f service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:36.167814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f6ce5-7c51-4cb0-a216-b5242096e82f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:36.175271 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c9aa-376b-438e-b9d8-3fb0e1d8ef48 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:36.177880 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5bc2c9aa-376b-438e-b9d8-3fb0e1d8ef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:36.191071 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f6ce5-7c51-4cb0-a216-b5242096e82f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:36.191735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c9aa-376b-438e-b9d8-3fb0e1d8ef48 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:36.197390 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f6ce5-7c51-4cb0-a216-b5242096e82f service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:36.204673 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:36.205261 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:36.205693 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:36.205969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984 admin admin] PATH_INFO: `/v3/projects/5a7f44109a804c33b18ea7ffa910f2c0` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:36.208384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a7f44109a804c33b18ea7ffa910f2c0)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:36.210749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:36.221140 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1082/2159] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:36.309097 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:36.315541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a7f44109a804c33b18ea7ffa910f2c0', 'request_id': 'req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:36.331194 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a7f44109a804c33b18ea7ffa910f2c0', 'request_id': 'req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:36.340257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a7f44109a804c33b18ea7ffa910f2c0', 'request_id': 'req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:36.356806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984 admin admin] The token cache is being invalidate because project 5a7f44109a804c33b18ea7ffa910f2c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:36.357203 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:36.358249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:36.365672 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f6ce5-7c51-4cb0-a216-b5242096e82f service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:36.372853 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1078/2160] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:36 2022] DELETE /identity/v3/projects/5a7f44109a804c33b18ea7ffa910f2c0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:36.381526 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f6ce5-7c51-4cb0-a216-b5242096e82f service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:36.504352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef20c52-7479-464c-91f9-7e3514e368a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:36.505067 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef20c52-7479-464c-91f9-7e3514e368a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:36.505273 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef20c52-7479-464c-91f9-7e3514e368a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:36.505550 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef20c52-7479-464c-91f9-7e3514e368a5 admin admin] PATH_INFO: `/v3/users/2ea2081b1d2a4e0d8f2e1fdc8844d890` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:36.509510 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef20c52-7479-464c-91f9-7e3514e368a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea2081b1d2a4e0d8f2e1fdc8844d890)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:36.512656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef20c52-7479-464c-91f9-7e3514e368a5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:36.541274 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:36.604220 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eef20c52-7479-464c-91f9-7e3514e368a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea2081b1d2a4e0d8f2e1fdc8844d890'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:36.605425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eef20c52-7479-464c-91f9-7e3514e368a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea2081b1d2a4e0d8f2e1fdc8844d890'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:36.617957 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eef20c52-7479-464c-91f9-7e3514e368a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea2081b1d2a4e0d8f2e1fdc8844d890'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:36.637440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eef20c52-7479-464c-91f9-7e3514e368a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea2081b1d2a4e0d8f2e1fdc8844d890'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:36.647671 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eef20c52-7479-464c-91f9-7e3514e368a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea2081b1d2a4e0d8f2e1fdc8844d890'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:36.662057 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1083/2161] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:36 2022] DELETE /identity/v3/users/2ea2081b1d2a4e0d8f2e1fdc8844d890 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:37.304595 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:37.307501 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:37.331116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef6022-f0d6-4bc8-ac2e-57e2f2e6f984 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:37.405342 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a6dff-2e93-466d-8b27-36aef96bf000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:37.406054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a6dff-2e93-466d-8b27-36aef96bf000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:37.406562 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a6dff-2e93-466d-8b27-36aef96bf000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:37.406912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a6dff-2e93-466d-8b27-36aef96bf000 admin admin] PATH_INFO: `/v3/projects/45c9bed10c60485ebc2e045dd49ecd89` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:37.408183 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a6dff-2e93-466d-8b27-36aef96bf000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45c9bed10c60485ebc2e045dd49ecd89)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:37.410113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a6dff-2e93-466d-8b27-36aef96bf000 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:37.465019 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ee4a6dff-2e93-466d-8b27-36aef96bf000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c9bed10c60485ebc2e045dd49ecd89', 'request_id': 'req-ee4a6dff-2e93-466d-8b27-36aef96bf000'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:37.473395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ee4a6dff-2e93-466d-8b27-36aef96bf000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c9bed10c60485ebc2e045dd49ecd89', 'request_id': 'req-ee4a6dff-2e93-466d-8b27-36aef96bf000'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:37.481396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ee4a6dff-2e93-466d-8b27-36aef96bf000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c9bed10c60485ebc2e045dd49ecd89', 'request_id': 'req-ee4a6dff-2e93-466d-8b27-36aef96bf000'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:37.493567 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ee4a6dff-2e93-466d-8b27-36aef96bf000 admin admin] The token cache is being invalidate because project 45c9bed10c60485ebc2e045dd49ecd89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:37.493859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ee4a6dff-2e93-466d-8b27-36aef96bf000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:37.495392 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ee4a6dff-2e93-466d-8b27-36aef96bf000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:37.497965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1079/2162] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:37 2022] DELETE /identity/v3/projects/45c9bed10c60485ebc2e045dd49ecd89 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:37.504560 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993665c-b3ee-429d-8a5b-1f44957a149a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:37.505092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993665c-b3ee-429d-8a5b-1f44957a149a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:37.505205 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993665c-b3ee-429d-8a5b-1f44957a149a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:37.527082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d993665c-b3ee-429d-8a5b-1f44957a149a None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:37.528296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d993665c-b3ee-429d-8a5b-1f44957a149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:37.590023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1084/2163] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:37.598879 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc9f26-abbd-4466-b21a-d7a2310be4a7 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:37.599170 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc9f26-abbd-4466-b21a-d7a2310be4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:37.599454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc9f26-abbd-4466-b21a-d7a2310be4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:37.628510 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-ebfc9f26-abbd-4466-b21a-d7a2310be4a7 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:37.629784 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ebfc9f26-abbd-4466-b21a-d7a2310be4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:37.638374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1080/2164] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:37.642650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993665c-b3ee-429d-8a5b-1f44957a149a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:37.655697 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993665c-b3ee-429d-8a5b-1f44957a149a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:37.661703 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d6089-c0a6-49b6-ba24-80f56be3f191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:37.662429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d6089-c0a6-49b6-ba24-80f56be3f191 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:37.662811 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d6089-c0a6-49b6-ba24-80f56be3f191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:37.663142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d6089-c0a6-49b6-ba24-80f56be3f191 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:37.664004 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d6089-c0a6-49b6-ba24-80f56be3f191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:37.664373 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d6089-c0a6-49b6-ba24-80f56be3f191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:37.667413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d6089-c0a6-49b6-ba24-80f56be3f191 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:37.690195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1085/2165] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:33:37.691512 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc9f26-abbd-4466-b21a-d7a2310be4a7 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:37.701610 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc9f26-abbd-4466-b21a-d7a2310be4a7 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:37.707906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092c956-4088-4c95-865b-700ca3960050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:37.708627 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092c956-4088-4c95-865b-700ca3960050 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:37.708796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092c956-4088-4c95-865b-700ca3960050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:37.709058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092c956-4088-4c95-865b-700ca3960050 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:37.709701 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092c956-4088-4c95-865b-700ca3960050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:37.712543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092c956-4088-4c95-865b-700ca3960050 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:37.775080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1081/2166] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:37 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:37.779485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d6089-c0a6-49b6-ba24-80f56be3f191 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:37.798442 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d6089-c0a6-49b6-ba24-80f56be3f191 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:37.839836 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263e61f-857d-4a48-9e95-0d7c5bc60aef None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:37.840133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263e61f-857d-4a48-9e95-0d7c5bc60aef None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:37.840387 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263e61f-857d-4a48-9e95-0d7c5bc60aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:37.914238 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-7263e61f-857d-4a48-9e95-0d7c5bc60aef None None] MFA Rules not processed for user `f8d30ea9f0374b28bdfb50c567d96d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:37.916468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7263e61f-857d-4a48-9e95-0d7c5bc60aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:37.935101 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b903038-9384-4678-a632-2efec88f9387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:37.935726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b903038-9384-4678-a632-2efec88f9387 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:37.936010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b903038-9384-4678-a632-2efec88f9387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:37.938912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b903038-9384-4678-a632-2efec88f9387 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:37.944597 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b903038-9384-4678-a632-2efec88f9387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:37.948033 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:37.949837 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b903038-9384-4678-a632-2efec88f9387 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:37.996285 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1086/2167] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:37 2022] POST /identity/v3/users => generated 283 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:38.005199 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b903038-9384-4678-a632-2efec88f9387 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:38.014753 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9b903038-9384-4678-a632-2efec88f9387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:38.024084 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:38.034203 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b903038-9384-4678-a632-2efec88f9387 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:38.054781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660255aa-f127-4303-b7ce-25cd1d41c42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:38.054781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660255aa-f127-4303-b7ce-25cd1d41c42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:38.054781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660255aa-f127-4303-b7ce-25cd1d41c42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:38.054781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660255aa-f127-4303-b7ce-25cd1d41c42d admin admin] PATH_INFO: `/v3/users/5ab30642585e472db7a87e067b39da8f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:38.056566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660255aa-f127-4303-b7ce-25cd1d41c42d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab30642585e472db7a87e067b39da8f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:38.058685 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660255aa-f127-4303-b7ce-25cd1d41c42d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:38.065213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1082/2168] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:38.069537 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263e61f-857d-4a48-9e95-0d7c5bc60aef None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:38.104232 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263e61f-857d-4a48-9e95-0d7c5bc60aef None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:38.122989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a39bb-d7c7-447c-9b6b-b08e55a309dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:38.123668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a39bb-d7c7-447c-9b6b-b08e55a309dd admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:38.124059 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a39bb-d7c7-447c-9b6b-b08e55a309dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:38.124452 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a39bb-d7c7-447c-9b6b-b08e55a309dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:38.125186 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a39bb-d7c7-447c-9b6b-b08e55a309dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:38.128113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a39bb-d7c7-447c-9b6b-b08e55a309dd admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:38.145917 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1083/2169] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:38.146752 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a39bb-d7c7-447c-9b6b-b08e55a309dd admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:38.149448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6b5a39bb-d7c7-447c-9b6b-b08e55a309dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:38.158883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-660255aa-f127-4303-b7ce-25cd1d41c42d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab30642585e472db7a87e067b39da8f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:38.159568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-660255aa-f127-4303-b7ce-25cd1d41c42d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab30642585e472db7a87e067b39da8f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:38.171013 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-660255aa-f127-4303-b7ce-25cd1d41c42d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab30642585e472db7a87e067b39da8f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:38.190067 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-660255aa-f127-4303-b7ce-25cd1d41c42d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab30642585e472db7a87e067b39da8f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:38.199413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-660255aa-f127-4303-b7ce-25cd1d41c42d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab30642585e472db7a87e067b39da8f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:38.207229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1087/2170] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:37 2022] DELETE /identity/v3/users/5ab30642585e472db7a87e067b39da8f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:38.208292 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660255aa-f127-4303-b7ce-25cd1d41c42d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:38.209613 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-660255aa-f127-4303-b7ce-25cd1d41c42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:38.232012 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a39bb-d7c7-447c-9b6b-b08e55a309dd admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:38.289824 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944d0eb-7d75-41f2-8ae6-bd959a44f29b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:38.290833 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944d0eb-7d75-41f2-8ae6-bd959a44f29b service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:38.291267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660255aa-f127-4303-b7ce-25cd1d41c42d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:38.291390 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944d0eb-7d75-41f2-8ae6-bd959a44f29b service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:38.291783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944d0eb-7d75-41f2-8ae6-bd959a44f29b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:38.293844 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a944d0eb-7d75-41f2-8ae6-bd959a44f29b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:38.296070 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed973bc-2fa2-489b-a31f-daffc9c1ef4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:38.296754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed973bc-2fa2-489b-a31f-daffc9c1ef4d admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:38.297102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed973bc-2fa2-489b-a31f-daffc9c1ef4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:38.297437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed973bc-2fa2-489b-a31f-daffc9c1ef4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:38.298146 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed973bc-2fa2-489b-a31f-daffc9c1ef4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:38.299829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed973bc-2fa2-489b-a31f-daffc9c1ef4d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:38.312238 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1088/2171] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:38.313555 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bd278-22ba-4491-b90f-f6c785f31ade None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:38.313839 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bd278-22ba-4491-b90f-f6c785f31ade None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:38.314108 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bd278-22ba-4491-b90f-f6c785f31ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:38.335056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-624bd278-22ba-4491-b90f-f6c785f31ade None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:38.337132 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-624bd278-22ba-4491-b90f-f6c785f31ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:38.345392 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1089/2172] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:38.345956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bd278-22ba-4491-b90f-f6c785f31ade None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:38.356033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bd278-22ba-4491-b90f-f6c785f31ade None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:38.361857 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc03f6-2c0e-4257-9f50-29d1cf018cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:38.363437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc03f6-2c0e-4257-9f50-29d1cf018cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:38.363437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc03f6-2c0e-4257-9f50-29d1cf018cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:38.363735 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc03f6-2c0e-4257-9f50-29d1cf018cbe admin admin] PATH_INFO: `/v3/projects/4ef0af9e578b4d119f577b17355e6911/users/bf06ba58861749da9ca3c4ed5743b5c5/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:38.364976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944d0eb-7d75-41f2-8ae6-bd959a44f29b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:38.366484 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944d0eb-7d75-41f2-8ae6-bd959a44f29b service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:38.377031 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1084/2173] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:38.378074 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944d0eb-7d75-41f2-8ae6-bd959a44f29b service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:38.379863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a944d0eb-7d75-41f2-8ae6-bd959a44f29b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:38.380309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc03f6-2c0e-4257-9f50-29d1cf018cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef0af9e578b4d119f577b17355e6911, user_id=bf06ba58861749da9ca3c4ed5743b5c5, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:38.383935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc03f6-2c0e-4257-9f50-29d1cf018cbe admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:38.407887 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1090/2174] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:38 2022] PUT /identity/v3/projects/4ef0af9e578b4d119f577b17355e6911/users/bf06ba58861749da9ca3c4ed5743b5c5/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:38.416558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:38.418687 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71444b0-4eb1-4389-b999-405997e2f579 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:38.419035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71444b0-4eb1-4389-b999-405997e2f579 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:38.419313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71444b0-4eb1-4389-b999-405997e2f579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:38.450595 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d71444b0-4eb1-4389-b999-405997e2f579 None None] MFA Rules not processed for user `bf06ba58861749da9ca3c4ed5743b5c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:38.451852 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d71444b0-4eb1-4389-b999-405997e2f579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:38.462018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944d0eb-7d75-41f2-8ae6-bd959a44f29b service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:38.488762 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:38.551160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1091/2175] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:38.559802 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871732b-655a-4dd2-aec5-3deac5063464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:38.560791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871732b-655a-4dd2-aec5-3deac5063464 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:38.561212 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871732b-655a-4dd2-aec5-3deac5063464 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:38.561582 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871732b-655a-4dd2-aec5-3deac5063464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:38.562813 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71444b0-4eb1-4389-b999-405997e2f579 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:38.564797 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d71444b0-4eb1-4389-b999-405997e2f579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:38.655058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71444b0-4eb1-4389-b999-405997e2f579 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:38.659526 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889387c3-7a42-4b64-9e4d-d125111fab9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:38.660414 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889387c3-7a42-4b64-9e4d-d125111fab9c service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:38.660848 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889387c3-7a42-4b64-9e4d-d125111fab9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:38.661114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889387c3-7a42-4b64-9e4d-d125111fab9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:38.671874 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889387c3-7a42-4b64-9e4d-d125111fab9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:38.674144 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889387c3-7a42-4b64-9e4d-d125111fab9c service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:38.687958 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1092/2176] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:38.708765 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871732b-655a-4dd2-aec5-3deac5063464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:38.713341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871732b-655a-4dd2-aec5-3deac5063464 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:38.740754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1085/2177] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:39.299615 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889387c3-7a42-4b64-9e4d-d125111fab9c service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:39.301929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-889387c3-7a42-4b64-9e4d-d125111fab9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:39.322925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889387c3-7a42-4b64-9e4d-d125111fab9c service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:39.329491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b05a39-5894-4331-86a2-bf76cb5d3de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:39.330183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b05a39-5894-4331-86a2-bf76cb5d3de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:39.330457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b05a39-5894-4331-86a2-bf76cb5d3de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:39.330773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b05a39-5894-4331-86a2-bf76cb5d3de4 admin admin] PATH_INFO: `/v3/projects/1973b9e7c32243808c4070c190479d86` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:39.331969 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b05a39-5894-4331-86a2-bf76cb5d3de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1973b9e7c32243808c4070c190479d86)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:39.333934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b05a39-5894-4331-86a2-bf76cb5d3de4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:39.401308 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-84b05a39-5894-4331-86a2-bf76cb5d3de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1973b9e7c32243808c4070c190479d86', 'request_id': 'req-84b05a39-5894-4331-86a2-bf76cb5d3de4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:39.408501 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-84b05a39-5894-4331-86a2-bf76cb5d3de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1973b9e7c32243808c4070c190479d86', 'request_id': 'req-84b05a39-5894-4331-86a2-bf76cb5d3de4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:39.414358 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-84b05a39-5894-4331-86a2-bf76cb5d3de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1973b9e7c32243808c4070c190479d86', 'request_id': 'req-84b05a39-5894-4331-86a2-bf76cb5d3de4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:39.425835 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-84b05a39-5894-4331-86a2-bf76cb5d3de4 admin admin] The token cache is being invalidate because project 1973b9e7c32243808c4070c190479d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:39.426116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-84b05a39-5894-4331-86a2-bf76cb5d3de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:39.426771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-84b05a39-5894-4331-86a2-bf76cb5d3de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:39.428286 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1093/2178] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:39 2022] DELETE /identity/v3/projects/1973b9e7c32243808c4070c190479d86 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:39.433850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62775c94-7a64-4dc6-a2d2-b367bf64c431 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:39.434407 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62775c94-7a64-4dc6-a2d2-b367bf64c431 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:39.434505 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62775c94-7a64-4dc6-a2d2-b367bf64c431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:39.455027 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-62775c94-7a64-4dc6-a2d2-b367bf64c431 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:39.456222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-62775c94-7a64-4dc6-a2d2-b367bf64c431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:39.530655 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1086/2179] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:39.538095 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c00c7-4bde-4ce7-b3df-dab5446f4f94 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:39.538480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c00c7-4bde-4ce7-b3df-dab5446f4f94 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:39.538871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c00c7-4bde-4ce7-b3df-dab5446f4f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:39.580824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-360c00c7-4bde-4ce7-b3df-dab5446f4f94 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:39.584927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-360c00c7-4bde-4ce7-b3df-dab5446f4f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:39.596147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1094/2180] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:39.600982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62775c94-7a64-4dc6-a2d2-b367bf64c431 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:39.615216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62775c94-7a64-4dc6-a2d2-b367bf64c431 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:39.626826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0107ea-7b6e-4ef2-a694-d40fad0ef45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:39.627655 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0107ea-7b6e-4ef2-a694-d40fad0ef45d admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:39.628005 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0107ea-7b6e-4ef2-a694-d40fad0ef45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:39.628356 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0107ea-7b6e-4ef2-a694-d40fad0ef45d admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:39.629153 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0107ea-7b6e-4ef2-a694-d40fad0ef45d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:39.629389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0107ea-7b6e-4ef2-a694-d40fad0ef45d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:39.631051 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0107ea-7b6e-4ef2-a694-d40fad0ef45d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:39.655979 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1087/2181] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:33:39.660454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c00c7-4bde-4ce7-b3df-dab5446f4f94 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:39.670737 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c00c7-4bde-4ce7-b3df-dab5446f4f94 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:39.676669 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480f414-f37b-4e55-99e4-75e3f60e07dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:39.677451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480f414-f37b-4e55-99e4-75e3f60e07dd admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:39.677736 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480f414-f37b-4e55-99e4-75e3f60e07dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:39.678009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480f414-f37b-4e55-99e4-75e3f60e07dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:39.678720 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480f414-f37b-4e55-99e4-75e3f60e07dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:39.680719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480f414-f37b-4e55-99e4-75e3f60e07dd admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:39.718671 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1095/2182] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:39 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:33:39.720127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0107ea-7b6e-4ef2-a694-d40fad0ef45d admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:39.732788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0107ea-7b6e-4ef2-a694-d40fad0ef45d admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:39.751000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:39.811730 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094abd8-d0c6-4544-a7ee-a66295bf6e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:39.812330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094abd8-d0c6-4544-a7ee-a66295bf6e3b admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:39.812613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094abd8-d0c6-4544-a7ee-a66295bf6e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:39.812885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094abd8-d0c6-4544-a7ee-a66295bf6e3b admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:39.813528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094abd8-d0c6-4544-a7ee-a66295bf6e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:39.815456 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094abd8-d0c6-4544-a7ee-a66295bf6e3b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:39.838237 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1088/2183] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:39 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:39.842484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480f414-f37b-4e55-99e4-75e3f60e07dd admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:39.863624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480f414-f37b-4e55-99e4-75e3f60e07dd admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:39.868302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56966f07-1113-4194-b59a-317071004f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:39.868896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56966f07-1113-4194-b59a-317071004f2c admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:39.869168 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56966f07-1113-4194-b59a-317071004f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:39.869435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56966f07-1113-4194-b59a-317071004f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:39.870222 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56966f07-1113-4194-b59a-317071004f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:39.871828 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56966f07-1113-4194-b59a-317071004f2c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:39.887836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1096/2184] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:39.888609 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094abd8-d0c6-4544-a7ee-a66295bf6e3b admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:39.899664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094abd8-d0c6-4544-a7ee-a66295bf6e3b admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:39.904608 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568ff2d-25f5-4140-9ed6-d8df1ba67134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:39.905213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568ff2d-25f5-4140-9ed6-d8df1ba67134 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:39.905644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568ff2d-25f5-4140-9ed6-d8df1ba67134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:39.905924 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568ff2d-25f5-4140-9ed6-d8df1ba67134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:39.906576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568ff2d-25f5-4140-9ed6-d8df1ba67134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:39.908325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568ff2d-25f5-4140-9ed6-d8df1ba67134 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:39.923461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1089/2185] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:33:39.931880 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56966f07-1113-4194-b59a-317071004f2c admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:39.942777 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56966f07-1113-4194-b59a-317071004f2c admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:39.949092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a5847-f769-4dce-a395-97a1b67ad5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:39.949849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a5847-f769-4dce-a395-97a1b67ad5d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:39.950199 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a5847-f769-4dce-a395-97a1b67ad5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:39.950789 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a5847-f769-4dce-a395-97a1b67ad5d4 admin admin] PATH_INFO: `/v3/projects/635fc0ed62b04e4fbffb9d766c2e1d74/users/cb41ddb096a549e486c8484bc0420736/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:39.973804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a5847-f769-4dce-a395-97a1b67ad5d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=635fc0ed62b04e4fbffb9d766c2e1d74, user_id=cb41ddb096a549e486c8484bc0420736, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:39.976481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a5847-f769-4dce-a395-97a1b67ad5d4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:39.980235 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:39.994105 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1097/2186] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:39 2022] PUT /identity/v3/projects/635fc0ed62b04e4fbffb9d766c2e1d74/users/cb41ddb096a549e486c8484bc0420736/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:39.999168 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a5c23-ac58-47f9-80c6-38baef46aadb None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:39.999511 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a5c23-ac58-47f9-80c6-38baef46aadb None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:39.999850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a5c23-ac58-47f9-80c6-38baef46aadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:40.020967 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-860a5c23-ac58-47f9-80c6-38baef46aadb None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:40.022181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-860a5c23-ac58-47f9-80c6-38baef46aadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:40.085025 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1090/2187] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:40.094957 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a5847-f769-4dce-a395-97a1b67ad5d4 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:40.096638 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d55a5847-f769-4dce-a395-97a1b67ad5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:40.153501 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a5847-f769-4dce-a395-97a1b67ad5d4 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:40.157955 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba864ccd-1a7a-49f1-80ae-dde0628a43bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:40.158561 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba864ccd-1a7a-49f1-80ae-dde0628a43bc service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:40.158875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba864ccd-1a7a-49f1-80ae-dde0628a43bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:40.159142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba864ccd-1a7a-49f1-80ae-dde0628a43bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:40.168576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba864ccd-1a7a-49f1-80ae-dde0628a43bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:40.170002 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba864ccd-1a7a-49f1-80ae-dde0628a43bc service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:40.179491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1098/2188] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:41.006544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5012759-8956-4d03-a7ed-dcae3649a508 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:41.007076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5012759-8956-4d03-a7ed-dcae3649a508 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:41.007163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5012759-8956-4d03-a7ed-dcae3649a508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:41.035503 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-f5012759-8956-4d03-a7ed-dcae3649a508 None None] MFA Rules not processed for user `f8d30ea9f0374b28bdfb50c567d96d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:41.037599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f5012759-8956-4d03-a7ed-dcae3649a508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:41.114863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1091/2189] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:49.400368 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527814ab-a117-4248-a74f-8e99df91af3d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:49.400978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527814ab-a117-4248-a74f-8e99df91af3d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:49.401080 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527814ab-a117-4248-a74f-8e99df91af3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:49.441034 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-527814ab-a117-4248-a74f-8e99df91af3d None None] MFA Rules not processed for user `cb41ddb096a549e486c8484bc0420736`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:49.442334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-527814ab-a117-4248-a74f-8e99df91af3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:49.556876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1099/2190] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:49.563830 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5012759-8956-4d03-a7ed-dcae3649a508 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:49.581238 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5012759-8956-4d03-a7ed-dcae3649a508 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:49.593820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ff4c8-b54a-45dd-b37b-2ac56a636e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:49.594465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ff4c8-b54a-45dd-b37b-2ac56a636e62 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:49.594789 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ff4c8-b54a-45dd-b37b-2ac56a636e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:49.595057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ff4c8-b54a-45dd-b37b-2ac56a636e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:49.595904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ff4c8-b54a-45dd-b37b-2ac56a636e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:49.597805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ff4c8-b54a-45dd-b37b-2ac56a636e62 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:49.633058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1092/2191] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:49 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:49.634326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527814ab-a117-4248-a74f-8e99df91af3d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:49.651275 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527814ab-a117-4248-a74f-8e99df91af3d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:49.724757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836dcca-db62-460d-a259-06565916464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:49.725685 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836dcca-db62-460d-a259-06565916464e admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:49.726302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836dcca-db62-460d-a259-06565916464e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:49.726835 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836dcca-db62-460d-a259-06565916464e admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:49.728975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836dcca-db62-460d-a259-06565916464e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:49.729809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836dcca-db62-460d-a259-06565916464e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:49.762061 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1100/2192] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:49 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:49.766269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ff4c8-b54a-45dd-b37b-2ac56a636e62 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:49.776895 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ff4c8-b54a-45dd-b37b-2ac56a636e62 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:49.781729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8e897-c30a-4d53-82bc-92d91cd43081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:49.782340 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8e897-c30a-4d53-82bc-92d91cd43081 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:49.782650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8e897-c30a-4d53-82bc-92d91cd43081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:49.782929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8e897-c30a-4d53-82bc-92d91cd43081 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:49.783580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8e897-c30a-4d53-82bc-92d91cd43081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:49.785180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8e897-c30a-4d53-82bc-92d91cd43081 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:49.796712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1093/2193] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:49.805666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836dcca-db62-460d-a259-06565916464e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:49.817965 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836dcca-db62-460d-a259-06565916464e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:49.830766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33c9f6-282c-463d-bac7-df810019702c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:49.831461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33c9f6-282c-463d-bac7-df810019702c admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:49.831744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33c9f6-282c-463d-bac7-df810019702c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:49.832023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33c9f6-282c-463d-bac7-df810019702c admin admin] PATH_INFO: `/v3/projects/dab8ce9b60034ddf87f7119a34597d01/users/e179fdedb9944725a73c71b6af995832/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:49.846446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:49.850046 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33c9f6-282c-463d-bac7-df810019702c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab8ce9b60034ddf87f7119a34597d01, user_id=e179fdedb9944725a73c71b6af995832, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:49.854034 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33c9f6-282c-463d-bac7-df810019702c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:49.870996 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1101/2194] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:49 2022] PUT /identity/v3/projects/dab8ce9b60034ddf87f7119a34597d01/users/e179fdedb9944725a73c71b6af995832/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:49.875025 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8e897-c30a-4d53-82bc-92d91cd43081 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:49.886591 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8e897-c30a-4d53-82bc-92d91cd43081 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:49.898690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:50.001743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3952c-2578-4f90-af81-48d63b1ce7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:50.003798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3952c-2578-4f90-af81-48d63b1ce7db admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:50.004078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3952c-2578-4f90-af81-48d63b1ce7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:50.006022 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3952c-2578-4f90-af81-48d63b1ce7db admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:50.006661 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3952c-2578-4f90-af81-48d63b1ce7db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:50.010163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3952c-2578-4f90-af81-48d63b1ce7db admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:50.030664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1094/2195] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:50.031948 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33c9f6-282c-463d-bac7-df810019702c admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:50.047158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33c9f6-282c-463d-bac7-df810019702c admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:50.052724 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c261a70-e903-4c19-b0fa-6bd52b7a647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:50.052989 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c261a70-e903-4c19-b0fa-6bd52b7a647c admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:50.053331 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c261a70-e903-4c19-b0fa-6bd52b7a647c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:50.057746 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c261a70-e903-4c19-b0fa-6bd52b7a647c admin admin] PATH_INFO: `/v3/projects/dab8ce9b60034ddf87f7119a34597d01/users/e179fdedb9944725a73c71b6af995832/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:50.058186 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c261a70-e903-4c19-b0fa-6bd52b7a647c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab8ce9b60034ddf87f7119a34597d01, user_id=e179fdedb9944725a73c71b6af995832, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:50.061355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c261a70-e903-4c19-b0fa-6bd52b7a647c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:50.075826 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1102/2196] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:50 2022] PUT /identity/v3/projects/dab8ce9b60034ddf87f7119a34597d01/users/e179fdedb9944725a73c71b6af995832/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:58.187641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3952c-2578-4f90-af81-48d63b1ce7db admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:58.190490 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-15a3952c-2578-4f90-af81-48d63b1ce7db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:58.209356 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3952c-2578-4f90-af81-48d63b1ce7db admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:58.294830 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821b812-3142-4d57-a606-42964648df81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:58.295737 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821b812-3142-4d57-a606-42964648df81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:58.296684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821b812-3142-4d57-a606-42964648df81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:58.297363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821b812-3142-4d57-a606-42964648df81 admin admin] PATH_INFO: `/v3/users/6d98ba47977f4440bf28614a67efebd9` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:58.300174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821b812-3142-4d57-a606-42964648df81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d98ba47977f4440bf28614a67efebd9)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:58.313910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821b812-3142-4d57-a606-42964648df81 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:58.370580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b11f-1ba4-456a-b410-1f775dc81e70 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:58.372623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b11f-1ba4-456a-b410-1f775dc81e70 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:58.373085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b11f-1ba4-456a-b410-1f775dc81e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:58.410361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b438b11f-1ba4-456a-b410-1f775dc81e70 None None] MFA Rules not processed for user `e179fdedb9944725a73c71b6af995832`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:58.411833 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b438b11f-1ba4-456a-b410-1f775dc81e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:58.451497 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e821b812-3142-4d57-a606-42964648df81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d98ba47977f4440bf28614a67efebd9'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:58.452672 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e821b812-3142-4d57-a606-42964648df81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d98ba47977f4440bf28614a67efebd9'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:58.475580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e821b812-3142-4d57-a606-42964648df81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d98ba47977f4440bf28614a67efebd9'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:58.492773 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e821b812-3142-4d57-a606-42964648df81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d98ba47977f4440bf28614a67efebd9'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:58.503615 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e821b812-3142-4d57-a606-42964648df81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d98ba47977f4440bf28614a67efebd9'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:58.512000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1095/2197] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:33:58 2022] DELETE /identity/v3/users/6d98ba47977f4440bf28614a67efebd9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:58.527217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1103/2198] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:58.539923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821b812-3142-4d57-a606-42964648df81 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:58.541391 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e821b812-3142-4d57-a606-42964648df81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:58.596100 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:58.689900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821b812-3142-4d57-a606-42964648df81 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:58.693536 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89905037-e281-4aa6-9019-f7a27a5fa56d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11356a5e3d041729f71515482033dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:58.694215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89905037-e281-4aa6-9019-f7a27a5fa56d service glance] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:58.694844 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89905037-e281-4aa6-9019-f7a27a5fa56d service glance] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:58.695195 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89905037-e281-4aa6-9019-f7a27a5fa56d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:58.700223 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-89905037-e281-4aa6-9019-f7a27a5fa56d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:58.747159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438b11f-1ba4-456a-b410-1f775dc81e70 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:58.749250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b438b11f-1ba4-456a-b410-1f775dc81e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:58.778060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438b11f-1ba4-456a-b410-1f775dc81e70 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:58.794219 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89905037-e281-4aa6-9019-f7a27a5fa56d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:58.795720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89905037-e281-4aa6-9019-f7a27a5fa56d service glance] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:58.806812 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1096/2199] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:58.852766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359be57c-b0c7-44d1-9254-41721b8fc0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:58.853536 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359be57c-b0c7-44d1-9254-41721b8fc0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:58.853914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359be57c-b0c7-44d1-9254-41721b8fc0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:58.854288 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359be57c-b0c7-44d1-9254-41721b8fc0e0 admin admin] PATH_INFO: `/v3/projects/c5c583a13aa046d397dfa79538a93222` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:58.855722 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359be57c-b0c7-44d1-9254-41721b8fc0e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c583a13aa046d397dfa79538a93222)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:58.857812 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359be57c-b0c7-44d1-9254-41721b8fc0e0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:58.932521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-359be57c-b0c7-44d1-9254-41721b8fc0e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c583a13aa046d397dfa79538a93222', 'request_id': 'req-359be57c-b0c7-44d1-9254-41721b8fc0e0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:58.940499 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-359be57c-b0c7-44d1-9254-41721b8fc0e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c583a13aa046d397dfa79538a93222', 'request_id': 'req-359be57c-b0c7-44d1-9254-41721b8fc0e0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:58.950660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-359be57c-b0c7-44d1-9254-41721b8fc0e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c583a13aa046d397dfa79538a93222', 'request_id': 'req-359be57c-b0c7-44d1-9254-41721b8fc0e0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:58.957054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:58.970098 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-359be57c-b0c7-44d1-9254-41721b8fc0e0 admin admin] The token cache is being invalidate because project c5c583a13aa046d397dfa79538a93222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:33:58.970385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-359be57c-b0c7-44d1-9254-41721b8fc0e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:58.972710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-359be57c-b0c7-44d1-9254-41721b8fc0e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:33:58.974589 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1104/2200] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:33:58 2022] DELETE /identity/v3/projects/c5c583a13aa046d397dfa79538a93222 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:33:58.979435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed3d84-9f51-4aee-97c3-5386c6156bb3 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:58.979800 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed3d84-9f51-4aee-97c3-5386c6156bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:58.980078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed3d84-9f51-4aee-97c3-5386c6156bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:59.003497 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e028b-80cb-4c99-87e5-c1fcdf5af909 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:59.003784 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e028b-80cb-4c99-87e5-c1fcdf5af909 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:59.004060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e028b-80cb-4c99-87e5-c1fcdf5af909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:59.026626 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-eb9e028b-80cb-4c99-87e5-c1fcdf5af909 None None] MFA Rules not processed for user `cd0dbb2c140946f69c3f508b4184e998`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:59.029006 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-eb9e028b-80cb-4c99-87e5-c1fcdf5af909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:59.029305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-9aed3d84-9f51-4aee-97c3-5386c6156bb3 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:59.032803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-9aed3d84-9f51-4aee-97c3-5386c6156bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:59.132682 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1105/2201] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Sep 1 16:33:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:59.147456 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1097/2202] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:59.156351 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57da49-71e3-48b4-ad25-d32d421d7080 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:59.156876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57da49-71e3-48b4-ad25-d32d421d7080 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:59.157378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57da49-71e3-48b4-ad25-d32d421d7080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:59.183934 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed3d84-9f51-4aee-97c3-5386c6156bb3 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:59.185856 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-9aed3d84-9f51-4aee-97c3-5386c6156bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:59.188328 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-de57da49-71e3-48b4-ad25-d32d421d7080 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:59.189755 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-de57da49-71e3-48b4-ad25-d32d421d7080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:59.201348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1106/2203] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:59.205594 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57da49-71e3-48b4-ad25-d32d421d7080 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:59.225187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57da49-71e3-48b4-ad25-d32d421d7080 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:59.234505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6e18e-7838-495d-bc18-293fbe108f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:59.235377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6e18e-7838-495d-bc18-293fbe108f13 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:59.235666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6e18e-7838-495d-bc18-293fbe108f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:59.236616 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6e18e-7838-495d-bc18-293fbe108f13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:59.237472 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6e18e-7838-495d-bc18-293fbe108f13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:33:59.237779 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6e18e-7838-495d-bc18-293fbe108f13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:59.239675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6e18e-7838-495d-bc18-293fbe108f13 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:59.254239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1107/2204] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:33:59.258765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6e18e-7838-495d-bc18-293fbe108f13 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:59.276297 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6e18e-7838-495d-bc18-293fbe108f13 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:59.281354 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922e688-7c53-4845-a726-a4ae980a8761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:59.281972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e688-7c53-4845-a726-a4ae980a8761 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:59.282254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e688-7c53-4845-a726-a4ae980a8761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:59.282652 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e688-7c53-4845-a726-a4ae980a8761 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:59.283111 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:59.283590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922e688-7c53-4845-a726-a4ae980a8761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:59.285097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922e688-7c53-4845-a726-a4ae980a8761 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:59.292098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed3d84-9f51-4aee-97c3-5386c6156bb3 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:59.297917 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9856cee-3417-44e1-ad50-db83172fc0c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f7afa63815643f580c91df4e4c3bafc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:59.298826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9856cee-3417-44e1-ad50-db83172fc0c7 service swift] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:59.299284 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9856cee-3417-44e1-ad50-db83172fc0c7 service swift] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:59.299816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9856cee-3417-44e1-ad50-db83172fc0c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:59.325120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9856cee-3417-44e1-ad50-db83172fc0c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:59.326951 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9856cee-3417-44e1-ad50-db83172fc0c7 service swift] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:59.343760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1108/2205] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:33:59 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:33:59.348044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922e688-7c53-4845-a726-a4ae980a8761 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:59.357057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1098/2206] 10.222.0.71 () {60 vars in 1384 bytes} [Thu Sep 1 16:33:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:33:59.456618 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922e688-7c53-4845-a726-a4ae980a8761 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:59.468243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a64867-a8c5-4e52-8271-0f680ba32a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:59.469010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a64867-a8c5-4e52-8271-0f680ba32a76 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:59.469395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a64867-a8c5-4e52-8271-0f680ba32a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:59.469772 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a64867-a8c5-4e52-8271-0f680ba32a76 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:59.470836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a64867-a8c5-4e52-8271-0f680ba32a76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:59.473213 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a64867-a8c5-4e52-8271-0f680ba32a76 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:59.510020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1109/2207] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:33:59 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:33:59.518527 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9856cee-3417-44e1-ad50-db83172fc0c7 service swift] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:59.536274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9856cee-3417-44e1-ad50-db83172fc0c7 service swift] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:59.562267 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131464aa-2433-4350-9d56-3a89fcaff706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:59.563025 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131464aa-2433-4350-9d56-3a89fcaff706 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:59.563308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131464aa-2433-4350-9d56-3a89fcaff706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:59.563584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131464aa-2433-4350-9d56-3a89fcaff706 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:59.564479 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131464aa-2433-4350-9d56-3a89fcaff706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:59.566695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131464aa-2433-4350-9d56-3a89fcaff706 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:59.599212 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1099/2208] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:59.599383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a64867-a8c5-4e52-8271-0f680ba32a76 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:59.618580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a64867-a8c5-4e52-8271-0f680ba32a76 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:59.629833 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df66a56-0a54-4383-9fa6-4af92530a2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:59.630550 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df66a56-0a54-4383-9fa6-4af92530a2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:59.630959 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df66a56-0a54-4383-9fa6-4af92530a2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:59.631330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df66a56-0a54-4383-9fa6-4af92530a2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:59.632155 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df66a56-0a54-4383-9fa6-4af92530a2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:59.634369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df66a56-0a54-4383-9fa6-4af92530a2a5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:59.645697 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1110/2209] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:33:59.654940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131464aa-2433-4350-9d56-3a89fcaff706 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:59.677774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131464aa-2433-4350-9d56-3a89fcaff706 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:59.689769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e08aee-88f4-4fa3-a1c6-1e7a42c09c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:59.690453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e08aee-88f4-4fa3-a1c6-1e7a42c09c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:59.691160 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e08aee-88f4-4fa3-a1c6-1e7a42c09c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:59.691447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e08aee-88f4-4fa3-a1c6-1e7a42c09c8e admin admin] PATH_INFO: `/v3/projects/e5d67ccbfa4042f69510e8b58d68bda0/users/91286f39f3714eaeb7b4dfada3945c59/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:59.718253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e08aee-88f4-4fa3-a1c6-1e7a42c09c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d67ccbfa4042f69510e8b58d68bda0, user_id=91286f39f3714eaeb7b4dfada3945c59, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:59.723872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e08aee-88f4-4fa3-a1c6-1e7a42c09c8e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:59.774640 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1100/2210] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:33:59 2022] PUT /identity/v3/projects/e5d67ccbfa4042f69510e8b58d68bda0/users/91286f39f3714eaeb7b4dfada3945c59/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:33:59.775850 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82e0be-96b1-4408-8deb-6cba03ffdafc None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:59.776207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82e0be-96b1-4408-8deb-6cba03ffdafc None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:59.776550 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82e0be-96b1-4408-8deb-6cba03ffdafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:59.834559 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ef82e0be-96b1-4408-8deb-6cba03ffdafc None None] MFA Rules not processed for user `91286f39f3714eaeb7b4dfada3945c59`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:59.837306 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ef82e0be-96b1-4408-8deb-6cba03ffdafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:59.903042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:59.982318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1111/2211] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:33:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:00.113787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e08aee-88f4-4fa3-a1c6-1e7a42c09c8e admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:00.126763 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-18e08aee-88f4-4fa3-a1c6-1e7a42c09c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:00.336940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e08aee-88f4-4fa3-a1c6-1e7a42c09c8e admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:00.348253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04efacb-2411-491b-82f6-4481fd89f1c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:00.348889 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04efacb-2411-491b-82f6-4481fd89f1c8 service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:00.349181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04efacb-2411-491b-82f6-4481fd89f1c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:00.349453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04efacb-2411-491b-82f6-4481fd89f1c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:00.360529 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04efacb-2411-491b-82f6-4481fd89f1c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:00.363118 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04efacb-2411-491b-82f6-4481fd89f1c8 service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:00.374391 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1101/2212] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:02.862018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82e0be-96b1-4408-8deb-6cba03ffdafc None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:03.022308 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82e0be-96b1-4408-8deb-6cba03ffdafc None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:03.028777 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed1bfc-e5c0-4669-9d80-ba7cddfdf496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:03.032644 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed1bfc-e5c0-4669-9d80-ba7cddfdf496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:03.032644 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed1bfc-e5c0-4669-9d80-ba7cddfdf496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:03.032644 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed1bfc-e5c0-4669-9d80-ba7cddfdf496 admin admin] PATH_INFO: `/v3/users/91286f39f3714eaeb7b4dfada3945c59` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:03.034034 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed1bfc-e5c0-4669-9d80-ba7cddfdf496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91286f39f3714eaeb7b4dfada3945c59)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:03.039241 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed1bfc-e5c0-4669-9d80-ba7cddfdf496 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:03.162139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-82ed1bfc-e5c0-4669-9d80-ba7cddfdf496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91286f39f3714eaeb7b4dfada3945c59'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:03.163032 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-82ed1bfc-e5c0-4669-9d80-ba7cddfdf496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91286f39f3714eaeb7b4dfada3945c59'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:03.181089 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-82ed1bfc-e5c0-4669-9d80-ba7cddfdf496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91286f39f3714eaeb7b4dfada3945c59'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:03.207516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-82ed1bfc-e5c0-4669-9d80-ba7cddfdf496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91286f39f3714eaeb7b4dfada3945c59'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:03.221049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-82ed1bfc-e5c0-4669-9d80-ba7cddfdf496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91286f39f3714eaeb7b4dfada3945c59'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:03.230702 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1112/2213] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:34:02 2022] DELETE /identity/v3/users/91286f39f3714eaeb7b4dfada3945c59 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:03.234344 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d892b50-eea2-4f39-a56b-0c7d6a4c0ca4 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:03.234926 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d892b50-eea2-4f39-a56b-0c7d6a4c0ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:03.234926 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d892b50-eea2-4f39-a56b-0c7d6a4c0ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:03.279408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-0d892b50-eea2-4f39-a56b-0c7d6a4c0ca4 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:03.292198 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0d892b50-eea2-4f39-a56b-0c7d6a4c0ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:03.423810 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1102/2214] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:03.434198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed1bfc-e5c0-4669-9d80-ba7cddfdf496 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:03.436762 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-82ed1bfc-e5c0-4669-9d80-ba7cddfdf496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:03.511569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:03.527763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed1bfc-e5c0-4669-9d80-ba7cddfdf496 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:03.532250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c02b2-3d73-4326-95c4-ffa1ac161012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:03.533153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c02b2-3d73-4326-95c4-ffa1ac161012 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:03.533848 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c02b2-3d73-4326-95c4-ffa1ac161012 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:03.534289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c02b2-3d73-4326-95c4-ffa1ac161012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:03.561621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c02b2-3d73-4326-95c4-ffa1ac161012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:03.563161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c02b2-3d73-4326-95c4-ffa1ac161012 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:03.575821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1113/2215] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:04.251572 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d892b50-eea2-4f39-a56b-0c7d6a4c0ca4 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:04.253157 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0d892b50-eea2-4f39-a56b-0c7d6a4c0ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:04.292379 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d892b50-eea2-4f39-a56b-0c7d6a4c0ca4 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:04.320281 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e5c31-a644-47a6-853f-f9a9cda00584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:04.320939 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e5c31-a644-47a6-853f-f9a9cda00584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:04.321403 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e5c31-a644-47a6-853f-f9a9cda00584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:04.321856 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e5c31-a644-47a6-853f-f9a9cda00584 admin admin] PATH_INFO: `/v3/projects/e5d67ccbfa4042f69510e8b58d68bda0` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:04.323121 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e5c31-a644-47a6-853f-f9a9cda00584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d67ccbfa4042f69510e8b58d68bda0)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:04.325070 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e5c31-a644-47a6-853f-f9a9cda00584 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:04.388685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:04.417037 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-878e5c31-a644-47a6-853f-f9a9cda00584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d67ccbfa4042f69510e8b58d68bda0', 'request_id': 'req-878e5c31-a644-47a6-853f-f9a9cda00584'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:04.436859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-878e5c31-a644-47a6-853f-f9a9cda00584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d67ccbfa4042f69510e8b58d68bda0', 'request_id': 'req-878e5c31-a644-47a6-853f-f9a9cda00584'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:04.446244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-878e5c31-a644-47a6-853f-f9a9cda00584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d67ccbfa4042f69510e8b58d68bda0', 'request_id': 'req-878e5c31-a644-47a6-853f-f9a9cda00584'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:04.469131 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-878e5c31-a644-47a6-853f-f9a9cda00584 admin admin] The token cache is being invalidate because project e5d67ccbfa4042f69510e8b58d68bda0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:34:04.469690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-878e5c31-a644-47a6-853f-f9a9cda00584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:04.470546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-878e5c31-a644-47a6-853f-f9a9cda00584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:04.475850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1103/2216] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:34:04 2022] DELETE /identity/v3/projects/e5d67ccbfa4042f69510e8b58d68bda0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:04.477547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a4be3-2b9d-430a-b873-ca3611587226 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:04.478036 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a4be3-2b9d-430a-b873-ca3611587226 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:04.478138 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a4be3-2b9d-430a-b873-ca3611587226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:04.503456 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-538a4be3-2b9d-430a-b873-ca3611587226 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:04.505076 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-538a4be3-2b9d-430a-b873-ca3611587226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:04.576115 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1114/2217] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:34:04.586018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f561a4-06aa-448f-bead-8bfdea1c2edd None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:04.586301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f561a4-06aa-448f-bead-8bfdea1c2edd None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:04.586581 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f561a4-06aa-448f-bead-8bfdea1c2edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:04.607890 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-47f561a4-06aa-448f-bead-8bfdea1c2edd None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:04.609406 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-47f561a4-06aa-448f-bead-8bfdea1c2edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:04.632947 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1104/2218] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:04.637432 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a4be3-2b9d-430a-b873-ca3611587226 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:04.647660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a4be3-2b9d-430a-b873-ca3611587226 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:04.652580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f7f10-5841-40f6-b6ae-ffe63bbf38a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:04.653276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f7f10-5841-40f6-b6ae-ffe63bbf38a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:04.653552 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f7f10-5841-40f6-b6ae-ffe63bbf38a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:04.653821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f7f10-5841-40f6-b6ae-ffe63bbf38a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:04.654497 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f7f10-5841-40f6-b6ae-ffe63bbf38a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:34:04.654837 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f7f10-5841-40f6-b6ae-ffe63bbf38a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:04.656465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f7f10-5841-40f6-b6ae-ffe63bbf38a4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:04.670029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1115/2219] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:34:04.674473 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f561a4-06aa-448f-bead-8bfdea1c2edd None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:04.685170 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f561a4-06aa-448f-bead-8bfdea1c2edd None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:04.690157 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eac9b1-8547-4906-8385-254e0115852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:04.690885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eac9b1-8547-4906-8385-254e0115852b admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:04.691231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eac9b1-8547-4906-8385-254e0115852b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:04.691561 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eac9b1-8547-4906-8385-254e0115852b admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:04.692387 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eac9b1-8547-4906-8385-254e0115852b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:04.694375 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eac9b1-8547-4906-8385-254e0115852b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:04.727171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1105/2220] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:04 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:04.727975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f7f10-5841-40f6-b6ae-ffe63bbf38a4 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:04.738303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f7f10-5841-40f6-b6ae-ffe63bbf38a4 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:04.821390 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ba289-5475-4782-84b5-5b79e6eef6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:04.821390 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ba289-5475-4782-84b5-5b79e6eef6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:04.821390 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ba289-5475-4782-84b5-5b79e6eef6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:04.821390 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ba289-5475-4782-84b5-5b79e6eef6d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:04.821868 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ba289-5475-4782-84b5-5b79e6eef6d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:04.823418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ba289-5475-4782-84b5-5b79e6eef6d8 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:04.854081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1116/2221] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:04 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:34:04.855491 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eac9b1-8547-4906-8385-254e0115852b admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:04.888904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eac9b1-8547-4906-8385-254e0115852b admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:04.898644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086371f6-003c-4963-8f64-8b843a17bc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:04.899472 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086371f6-003c-4963-8f64-8b843a17bc6e admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:04.899584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086371f6-003c-4963-8f64-8b843a17bc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:04.899844 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086371f6-003c-4963-8f64-8b843a17bc6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:04.900555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086371f6-003c-4963-8f64-8b843a17bc6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:04.902528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086371f6-003c-4963-8f64-8b843a17bc6e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:04.924925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ba289-5475-4782-84b5-5b79e6eef6d8 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:04.925335 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1106/2222] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:04.970509 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ba289-5475-4782-84b5-5b79e6eef6d8 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:04.977748 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85915c5d-cb2b-4a41-bff8-fa59a27d22b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:04.978414 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85915c5d-cb2b-4a41-bff8-fa59a27d22b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:04.978730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85915c5d-cb2b-4a41-bff8-fa59a27d22b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:04.979068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85915c5d-cb2b-4a41-bff8-fa59a27d22b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:04.979735 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85915c5d-cb2b-4a41-bff8-fa59a27d22b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:04.982023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85915c5d-cb2b-4a41-bff8-fa59a27d22b5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:05.017236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1117/2223] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:05.022091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086371f6-003c-4963-8f64-8b843a17bc6e admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:05.042639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086371f6-003c-4963-8f64-8b843a17bc6e admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:05.051566 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3834c5-4f98-46ea-96c5-f3900d2b7b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:05.052318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3834c5-4f98-46ea-96c5-f3900d2b7b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:05.052602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3834c5-4f98-46ea-96c5-f3900d2b7b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:05.052875 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3834c5-4f98-46ea-96c5-f3900d2b7b02 admin admin] PATH_INFO: `/v3/projects/e8f8d07fd9d3449b9ac382c9f53bad87/users/ceebe6aff1cc4eea84e0f1eae6e154c5/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:05.091343 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3834c5-4f98-46ea-96c5-f3900d2b7b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f8d07fd9d3449b9ac382c9f53bad87, user_id=ceebe6aff1cc4eea84e0f1eae6e154c5, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:05.094305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3834c5-4f98-46ea-96c5-f3900d2b7b02 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:05.156238 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1107/2224] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:05 2022] PUT /identity/v3/projects/e8f8d07fd9d3449b9ac382c9f53bad87/users/ceebe6aff1cc4eea84e0f1eae6e154c5/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:05.156762 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bd47d-c62c-4b46-b336-891894a546a0 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:05.157221 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bd47d-c62c-4b46-b336-891894a546a0 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:05.157686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bd47d-c62c-4b46-b336-891894a546a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:05.239370 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-0d4bd47d-c62c-4b46-b336-891894a546a0 None None] MFA Rules not processed for user `ceebe6aff1cc4eea84e0f1eae6e154c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:05.241974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0d4bd47d-c62c-4b46-b336-891894a546a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:05.378222 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:05.442664 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1118/2225] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:34:05.447335 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3834c5-4f98-46ea-96c5-f3900d2b7b02 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:05.560084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3834c5-4f98-46ea-96c5-f3900d2b7b02 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:05.571341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9592b-bc09-4181-8a74-a8d9c4175d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:05.574299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9592b-bc09-4181-8a74-a8d9c4175d10 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:05.575211 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9592b-bc09-4181-8a74-a8d9c4175d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:05.575772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9592b-bc09-4181-8a74-a8d9c4175d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:05.577033 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9592b-bc09-4181-8a74-a8d9c4175d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:05.580320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9592b-bc09-4181-8a74-a8d9c4175d10 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:05.618747 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1108/2226] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:05 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:05.623730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bd47d-c62c-4b46-b336-891894a546a0 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:05.637950 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bd47d-c62c-4b46-b336-891894a546a0 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:05.720748 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce09e72-b73b-4529-bc46-a75732b9c63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:05.721376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce09e72-b73b-4529-bc46-a75732b9c63e admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:05.722562 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce09e72-b73b-4529-bc46-a75732b9c63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:05.722562 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce09e72-b73b-4529-bc46-a75732b9c63e admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:05.723173 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce09e72-b73b-4529-bc46-a75732b9c63e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:05.725287 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce09e72-b73b-4529-bc46-a75732b9c63e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:05.752141 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1119/2227] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:05 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:05.753718 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9592b-bc09-4181-8a74-a8d9c4175d10 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:05.765635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9592b-bc09-4181-8a74-a8d9c4175d10 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:05.771083 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be7c04-2d0d-4d70-85d7-383b28516fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:05.771749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be7c04-2d0d-4d70-85d7-383b28516fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:05.772084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be7c04-2d0d-4d70-85d7-383b28516fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:05.772444 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be7c04-2d0d-4d70-85d7-383b28516fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:05.773141 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be7c04-2d0d-4d70-85d7-383b28516fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:05.775565 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be7c04-2d0d-4d70-85d7-383b28516fa9 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:05.792410 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce09e72-b73b-4529-bc46-a75732b9c63e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:05.801247 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1109/2228] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:05.805792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce09e72-b73b-4529-bc46-a75732b9c63e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:05.812456 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58942d34-bb3e-4fb4-8569-35c0b6802007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:05.813324 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58942d34-bb3e-4fb4-8569-35c0b6802007 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:05.813454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58942d34-bb3e-4fb4-8569-35c0b6802007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:05.813719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58942d34-bb3e-4fb4-8569-35c0b6802007 admin admin] PATH_INFO: `/v3/projects/468bec19f7444d7385fc1de6b15f54e2/users/55b7ddcc753c40248ea3cb1d537650f6/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:05.836239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58942d34-bb3e-4fb4-8569-35c0b6802007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=468bec19f7444d7385fc1de6b15f54e2, user_id=55b7ddcc753c40248ea3cb1d537650f6, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:05.839272 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58942d34-bb3e-4fb4-8569-35c0b6802007 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:05.858131 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1120/2229] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:05 2022] PUT /identity/v3/projects/468bec19f7444d7385fc1de6b15f54e2/users/55b7ddcc753c40248ea3cb1d537650f6/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:05.859471 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be7c04-2d0d-4d70-85d7-383b28516fa9 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:05.870639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be7c04-2d0d-4d70-85d7-383b28516fa9 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:05.904947 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:05.939486 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ccc3b-b30f-4879-8504-943c8f08f98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:05.940098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ccc3b-b30f-4879-8504-943c8f08f98d admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:05.940384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ccc3b-b30f-4879-8504-943c8f08f98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:05.940658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ccc3b-b30f-4879-8504-943c8f08f98d admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:05.941429 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ccc3b-b30f-4879-8504-943c8f08f98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:05.943843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ccc3b-b30f-4879-8504-943c8f08f98d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:05.954798 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1110/2230] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:05.958724 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58942d34-bb3e-4fb4-8569-35c0b6802007 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:05.983188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58942d34-bb3e-4fb4-8569-35c0b6802007 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:05.990780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad82ccb-53f0-4c1d-8871-6ce643a52469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:05.992518 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad82ccb-53f0-4c1d-8871-6ce643a52469 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:05.992898 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad82ccb-53f0-4c1d-8871-6ce643a52469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:05.993327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad82ccb-53f0-4c1d-8871-6ce643a52469 admin admin] PATH_INFO: `/v3/projects/468bec19f7444d7385fc1de6b15f54e2/users/55b7ddcc753c40248ea3cb1d537650f6/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:05.997713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad82ccb-53f0-4c1d-8871-6ce643a52469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=468bec19f7444d7385fc1de6b15f54e2, user_id=55b7ddcc753c40248ea3cb1d537650f6, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:06.000502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad82ccb-53f0-4c1d-8871-6ce643a52469 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:06.022165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1121/2231] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:05 2022] PUT /identity/v3/projects/468bec19f7444d7385fc1de6b15f54e2/users/55b7ddcc753c40248ea3cb1d537650f6/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:06.024084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3726a-b3cc-4d1b-bfa5-27c53b6feaab None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:06.024380 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3726a-b3cc-4d1b-bfa5-27c53b6feaab None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:06.024662 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3726a-b3cc-4d1b-bfa5-27c53b6feaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:06.059549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-2ad3726a-b3cc-4d1b-bfa5-27c53b6feaab None None] MFA Rules not processed for user `55b7ddcc753c40248ea3cb1d537650f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:06.060925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2ad3726a-b3cc-4d1b-bfa5-27c53b6feaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:06.153444 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1111/2232] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:06.160757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad82ccb-53f0-4c1d-8871-6ce643a52469 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:06.164431 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5ad82ccb-53f0-4c1d-8871-6ce643a52469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:06.233170 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad82ccb-53f0-4c1d-8871-6ce643a52469 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:06.237150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38c58f-25b5-4ab3-86b2-deb687bbeb83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:06.237989 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38c58f-25b5-4ab3-86b2-deb687bbeb83 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:06.238263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38c58f-25b5-4ab3-86b2-deb687bbeb83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:06.238533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38c58f-25b5-4ab3-86b2-deb687bbeb83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:06.293903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:06.307294 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38c58f-25b5-4ab3-86b2-deb687bbeb83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:06.308935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38c58f-25b5-4ab3-86b2-deb687bbeb83 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:06.320792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1122/2233] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:06.473678 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bac9c3-c133-4b97-aa27-d517b55e3fcc None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:06.474220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bac9c3-c133-4b97-aa27-d517b55e3fcc None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:06.476728 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bac9c3-c133-4b97-aa27-d517b55e3fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:06.503784 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-c9bac9c3-c133-4b97-aa27-d517b55e3fcc None None] MFA Rules not processed for user `2795b294fed84c8cac4d3f481a3eb24d`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:06.505621 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c9bac9c3-c133-4b97-aa27-d517b55e3fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:06.624952 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1112/2234] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:07.812839 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38c58f-25b5-4ab3-86b2-deb687bbeb83 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:07.825841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38c58f-25b5-4ab3-86b2-deb687bbeb83 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:07.833399 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462f24d-0a99-4d30-9718-75a9c598ed5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:07.834465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462f24d-0a99-4d30-9718-75a9c598ed5b service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:07.835834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462f24d-0a99-4d30-9718-75a9c598ed5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:07.836289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462f24d-0a99-4d30-9718-75a9c598ed5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:07.849542 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462f24d-0a99-4d30-9718-75a9c598ed5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:07.852211 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462f24d-0a99-4d30-9718-75a9c598ed5b service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:07.875910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1123/2235] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:11.517162 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25257f-4dff-423f-88d4-22fa0b16a360 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:11.517821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25257f-4dff-423f-88d4-22fa0b16a360 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:11.517821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25257f-4dff-423f-88d4-22fa0b16a360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:11.538498 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-4e25257f-4dff-423f-88d4-22fa0b16a360 None None] MFA Rules not processed for user `cb41ddb096a549e486c8484bc0420736`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:11.539735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4e25257f-4dff-423f-88d4-22fa0b16a360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:11.606832 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1113/2236] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:12.075081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462f24d-0a99-4d30-9718-75a9c598ed5b service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:12.151519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462f24d-0a99-4d30-9718-75a9c598ed5b service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:12.157699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff4748-f6c7-48c1-9ab2-dbb41e5700e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:12.158681 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff4748-f6c7-48c1-9ab2-dbb41e5700e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:12.159163 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff4748-f6c7-48c1-9ab2-dbb41e5700e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:12.159620 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff4748-f6c7-48c1-9ab2-dbb41e5700e7 admin admin] PATH_INFO: `/v3/users/ceebe6aff1cc4eea84e0f1eae6e154c5` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:12.160983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff4748-f6c7-48c1-9ab2-dbb41e5700e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceebe6aff1cc4eea84e0f1eae6e154c5)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:12.165325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff4748-f6c7-48c1-9ab2-dbb41e5700e7 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:12.232230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c3ff4748-f6c7-48c1-9ab2-dbb41e5700e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceebe6aff1cc4eea84e0f1eae6e154c5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:12.233280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c3ff4748-f6c7-48c1-9ab2-dbb41e5700e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceebe6aff1cc4eea84e0f1eae6e154c5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:12.255193 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c3ff4748-f6c7-48c1-9ab2-dbb41e5700e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceebe6aff1cc4eea84e0f1eae6e154c5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:12.278787 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c3ff4748-f6c7-48c1-9ab2-dbb41e5700e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceebe6aff1cc4eea84e0f1eae6e154c5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:12.287023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c3ff4748-f6c7-48c1-9ab2-dbb41e5700e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceebe6aff1cc4eea84e0f1eae6e154c5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:12.295398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1124/2237] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:34:12 2022] DELETE /identity/v3/users/ceebe6aff1cc4eea84e0f1eae6e154c5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:12.300066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76005889-f0f0-4c51-b78a-d068e33034a5 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:12.300448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76005889-f0f0-4c51-b78a-d068e33034a5 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:12.300781 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76005889-f0f0-4c51-b78a-d068e33034a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:12.309914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:12.321171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-76005889-f0f0-4c51-b78a-d068e33034a5 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:12.322454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-76005889-f0f0-4c51-b78a-d068e33034a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:12.393853 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1114/2238] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:12.404009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff4748-f6c7-48c1-9ab2-dbb41e5700e7 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:12.405431 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c3ff4748-f6c7-48c1-9ab2-dbb41e5700e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:12.465774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff4748-f6c7-48c1-9ab2-dbb41e5700e7 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:12.469932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82e0ef-4b3c-4c2f-adcd-9951d0910faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:12.470668 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82e0ef-4b3c-4c2f-adcd-9951d0910faa service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:12.471015 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82e0ef-4b3c-4c2f-adcd-9951d0910faa service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:12.471358 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82e0ef-4b3c-4c2f-adcd-9951d0910faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:12.482093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82e0ef-4b3c-4c2f-adcd-9951d0910faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:12.483848 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82e0ef-4b3c-4c2f-adcd-9951d0910faa service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:12.488503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:12.498272 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1125/2239] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:12.840565 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76005889-f0f0-4c51-b78a-d068e33034a5 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:12.849357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-76005889-f0f0-4c51-b78a-d068e33034a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:12.862200 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76005889-f0f0-4c51-b78a-d068e33034a5 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:12.868618 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec77483-2466-4a45-ba37-c1537d0b534c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:12.869292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec77483-2466-4a45-ba37-c1537d0b534c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:12.869576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec77483-2466-4a45-ba37-c1537d0b534c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:12.869853 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec77483-2466-4a45-ba37-c1537d0b534c admin admin] PATH_INFO: `/v3/projects/e8f8d07fd9d3449b9ac382c9f53bad87` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:12.871095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec77483-2466-4a45-ba37-c1537d0b534c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f8d07fd9d3449b9ac382c9f53bad87)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:12.873909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec77483-2466-4a45-ba37-c1537d0b534c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:12.927130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3ec77483-2466-4a45-ba37-c1537d0b534c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f8d07fd9d3449b9ac382c9f53bad87', 'request_id': 'req-3ec77483-2466-4a45-ba37-c1537d0b534c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:12.934997 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3ec77483-2466-4a45-ba37-c1537d0b534c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f8d07fd9d3449b9ac382c9f53bad87', 'request_id': 'req-3ec77483-2466-4a45-ba37-c1537d0b534c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:12.941360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3ec77483-2466-4a45-ba37-c1537d0b534c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f8d07fd9d3449b9ac382c9f53bad87', 'request_id': 'req-3ec77483-2466-4a45-ba37-c1537d0b534c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:12.952397 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3ec77483-2466-4a45-ba37-c1537d0b534c admin admin] The token cache is being invalidate because project e8f8d07fd9d3449b9ac382c9f53bad87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:34:12.952678 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3ec77483-2466-4a45-ba37-c1537d0b534c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:12.953319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3ec77483-2466-4a45-ba37-c1537d0b534c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:12.956491 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1115/2240] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:34:12 2022] DELETE /identity/v3/projects/e8f8d07fd9d3449b9ac382c9f53bad87 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:12.959847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82e0ef-4b3c-4c2f-adcd-9951d0910faa service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:12.971257 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82e0ef-4b3c-4c2f-adcd-9951d0910faa service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:13.042496 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdfe8a-de59-44ea-888c-67d68bf80965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:13.043324 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdfe8a-de59-44ea-888c-67d68bf80965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:13.043598 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdfe8a-de59-44ea-888c-67d68bf80965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:13.044009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdfe8a-de59-44ea-888c-67d68bf80965 admin admin] PATH_INFO: `/v3/users/55b7ddcc753c40248ea3cb1d537650f6` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:13.045341 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdfe8a-de59-44ea-888c-67d68bf80965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b7ddcc753c40248ea3cb1d537650f6)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:13.047228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdfe8a-de59-44ea-888c-67d68bf80965 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:13.093698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9ccdfe8a-de59-44ea-888c-67d68bf80965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b7ddcc753c40248ea3cb1d537650f6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:13.094443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9ccdfe8a-de59-44ea-888c-67d68bf80965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b7ddcc753c40248ea3cb1d537650f6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:13.101678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9ccdfe8a-de59-44ea-888c-67d68bf80965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b7ddcc753c40248ea3cb1d537650f6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:13.113322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9ccdfe8a-de59-44ea-888c-67d68bf80965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b7ddcc753c40248ea3cb1d537650f6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:13.121161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9ccdfe8a-de59-44ea-888c-67d68bf80965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b7ddcc753c40248ea3cb1d537650f6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:13.126945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1126/2241] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:34:12 2022] DELETE /identity/v3/users/55b7ddcc753c40248ea3cb1d537650f6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:13.403953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec77483-2466-4a45-ba37-c1537d0b534c admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:13.405727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-3ec77483-2466-4a45-ba37-c1537d0b534c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:13.419911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec77483-2466-4a45-ba37-c1537d0b534c admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:13.481056 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ed672-101b-479d-bf5b-2e2d67b1ba14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:13.481857 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ed672-101b-479d-bf5b-2e2d67b1ba14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:13.482151 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ed672-101b-479d-bf5b-2e2d67b1ba14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:13.482429 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ed672-101b-479d-bf5b-2e2d67b1ba14 admin admin] PATH_INFO: `/v3/projects/468bec19f7444d7385fc1de6b15f54e2` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:13.483604 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ed672-101b-479d-bf5b-2e2d67b1ba14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=468bec19f7444d7385fc1de6b15f54e2)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:13.485596 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ed672-101b-479d-bf5b-2e2d67b1ba14 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:13.522644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:13.537440 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-865ed672-101b-479d-bf5b-2e2d67b1ba14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '468bec19f7444d7385fc1de6b15f54e2', 'request_id': 'req-865ed672-101b-479d-bf5b-2e2d67b1ba14'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:13.549122 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-865ed672-101b-479d-bf5b-2e2d67b1ba14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '468bec19f7444d7385fc1de6b15f54e2', 'request_id': 'req-865ed672-101b-479d-bf5b-2e2d67b1ba14'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:13.556790 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-865ed672-101b-479d-bf5b-2e2d67b1ba14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '468bec19f7444d7385fc1de6b15f54e2', 'request_id': 'req-865ed672-101b-479d-bf5b-2e2d67b1ba14'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:13.567925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-865ed672-101b-479d-bf5b-2e2d67b1ba14 admin admin] The token cache is being invalidate because project 468bec19f7444d7385fc1de6b15f54e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:34:13.568306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-865ed672-101b-479d-bf5b-2e2d67b1ba14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:13.569024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-865ed672-101b-479d-bf5b-2e2d67b1ba14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:13.570444 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1116/2242] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:34:13 2022] DELETE /identity/v3/projects/468bec19f7444d7385fc1de6b15f54e2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:13.575395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a702f02-efcc-45ac-85ce-7f2e05e64e94 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:13.575879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a702f02-efcc-45ac-85ce-7f2e05e64e94 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:13.576157 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a702f02-efcc-45ac-85ce-7f2e05e64e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:13.595936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1a702f02-efcc-45ac-85ce-7f2e05e64e94 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:13.597160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1a702f02-efcc-45ac-85ce-7f2e05e64e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:13.680069 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1127/2243] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:13.695469 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5aa59-7af7-4926-bf99-d64f07b400c0 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:13.695788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5aa59-7af7-4926-bf99-d64f07b400c0 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:13.696147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5aa59-7af7-4926-bf99-d64f07b400c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:13.719688 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-67b5aa59-7af7-4926-bf99-d64f07b400c0 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:13.721034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-67b5aa59-7af7-4926-bf99-d64f07b400c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:13.731399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1117/2244] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:13.735976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a702f02-efcc-45ac-85ce-7f2e05e64e94 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:13.746598 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a702f02-efcc-45ac-85ce-7f2e05e64e94 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:13.751247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef4371-5595-4f39-96a2-e0ba8965ee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:13.751840 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef4371-5595-4f39-96a2-e0ba8965ee97 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:13.752116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef4371-5595-4f39-96a2-e0ba8965ee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:13.752414 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef4371-5595-4f39-96a2-e0ba8965ee97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:13.753063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef4371-5595-4f39-96a2-e0ba8965ee97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:34:13.753361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef4371-5595-4f39-96a2-e0ba8965ee97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:13.754980 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef4371-5595-4f39-96a2-e0ba8965ee97 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:13.769945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1128/2245] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:34:13.775081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5aa59-7af7-4926-bf99-d64f07b400c0 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:13.786016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5aa59-7af7-4926-bf99-d64f07b400c0 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:13.791327 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b20e24-7d6f-4fd8-8a4e-a59e4e96c3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:13.791923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b20e24-7d6f-4fd8-8a4e-a59e4e96c3fe admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:13.792202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b20e24-7d6f-4fd8-8a4e-a59e4e96c3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:13.792471 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b20e24-7d6f-4fd8-8a4e-a59e4e96c3fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:13.793100 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b20e24-7d6f-4fd8-8a4e-a59e4e96c3fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:13.795018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b20e24-7d6f-4fd8-8a4e-a59e4e96c3fe admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:13.824611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1118/2246] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:13 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:13.825852 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef4371-5595-4f39-96a2-e0ba8965ee97 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:13.832139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:13.836499 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef4371-5595-4f39-96a2-e0ba8965ee97 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:13.894327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc6333-b867-4ce8-8c25-28dc980095e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:13.894983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc6333-b867-4ce8-8c25-28dc980095e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:13.895241 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc6333-b867-4ce8-8c25-28dc980095e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:13.895519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc6333-b867-4ce8-8c25-28dc980095e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:13.896171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc6333-b867-4ce8-8c25-28dc980095e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:13.898672 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc6333-b867-4ce8-8c25-28dc980095e6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:13.919615 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1129/2247] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:13 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:34:13.924014 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b20e24-7d6f-4fd8-8a4e-a59e4e96c3fe admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:13.934486 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b20e24-7d6f-4fd8-8a4e-a59e4e96c3fe admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:13.939143 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc8b47-ac16-4b35-a2ed-1cd80c06211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:13.939738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc8b47-ac16-4b35-a2ed-1cd80c06211d admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:13.940016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc8b47-ac16-4b35-a2ed-1cd80c06211d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:13.940287 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc8b47-ac16-4b35-a2ed-1cd80c06211d admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:13.940924 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc8b47-ac16-4b35-a2ed-1cd80c06211d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:13.942524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc8b47-ac16-4b35-a2ed-1cd80c06211d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:13.953497 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1119/2248] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:13.957401 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc6333-b867-4ce8-8c25-28dc980095e6 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:13.969585 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc6333-b867-4ce8-8c25-28dc980095e6 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:13.976224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f8acb-371b-4a08-8cd5-393764218453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:13.977042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f8acb-371b-4a08-8cd5-393764218453 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:13.977321 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f8acb-371b-4a08-8cd5-393764218453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:13.977595 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f8acb-371b-4a08-8cd5-393764218453 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:13.978241 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f8acb-371b-4a08-8cd5-393764218453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:13.979970 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f8acb-371b-4a08-8cd5-393764218453 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:13.991829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1130/2249] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:13.996263 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc8b47-ac16-4b35-a2ed-1cd80c06211d admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:14.006290 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc8b47-ac16-4b35-a2ed-1cd80c06211d admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:14.011391 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd229c5-1085-431b-8037-600f6d718a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:14.012174 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd229c5-1085-431b-8037-600f6d718a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:14.012457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd229c5-1085-431b-8037-600f6d718a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:14.013720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd229c5-1085-431b-8037-600f6d718a4f admin admin] PATH_INFO: `/v3/projects/22670872a54340878962ff46f4a87624/users/38d7b32afb8940fa94f3077dcbb2a5d2/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:14.030768 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd229c5-1085-431b-8037-600f6d718a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=22670872a54340878962ff46f4a87624, user_id=38d7b32afb8940fa94f3077dcbb2a5d2, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:14.033803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd229c5-1085-431b-8037-600f6d718a4f admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:14.056820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1120/2250] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:13 2022] PUT /identity/v3/projects/22670872a54340878962ff46f4a87624/users/38d7b32afb8940fa94f3077dcbb2a5d2/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:14.067532 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dd6c6-6861-4f19-a1c7-47ada2d5fa1c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:14.067811 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dd6c6-6861-4f19-a1c7-47ada2d5fa1c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:14.068082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dd6c6-6861-4f19-a1c7-47ada2d5fa1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:14.099612 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-cc3dd6c6-6861-4f19-a1c7-47ada2d5fa1c None None] MFA Rules not processed for user `38d7b32afb8940fa94f3077dcbb2a5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:14.101318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cc3dd6c6-6861-4f19-a1c7-47ada2d5fa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:14.165308 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1131/2251] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:14.169783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd229c5-1085-431b-8037-600f6d718a4f admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:14.231957 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd229c5-1085-431b-8037-600f6d718a4f admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:14.236903 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb33d3-fc7d-4bfc-8c85-b2462b9d0502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:14.237502 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb33d3-fc7d-4bfc-8c85-b2462b9d0502 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:14.237779 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb33d3-fc7d-4bfc-8c85-b2462b9d0502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:14.238049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb33d3-fc7d-4bfc-8c85-b2462b9d0502 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:14.238719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb33d3-fc7d-4bfc-8c85-b2462b9d0502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:14.240612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb33d3-fc7d-4bfc-8c85-b2462b9d0502 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:14.270554 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1121/2252] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:14 2022] POST /identity/v3/projects => generated 399 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:14.275101 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dd6c6-6861-4f19-a1c7-47ada2d5fa1c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:14.288123 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dd6c6-6861-4f19-a1c7-47ada2d5fa1c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:14.353017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4f56e-d9fd-4b85-abfc-939972430c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:14.354020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4f56e-d9fd-4b85-abfc-939972430c0d admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:14.354453 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4f56e-d9fd-4b85-abfc-939972430c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:14.354926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4f56e-d9fd-4b85-abfc-939972430c0d admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:14.355732 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4f56e-d9fd-4b85-abfc-939972430c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:14.357927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4f56e-d9fd-4b85-abfc-939972430c0d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:14.392171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1132/2253] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:14 2022] POST /identity/v3/users => generated 306 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:34:14.408015 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb33d3-fc7d-4bfc-8c85-b2462b9d0502 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:14.424381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb33d3-fc7d-4bfc-8c85-b2462b9d0502 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:14.438367 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc09761-1166-45b4-a045-402e5db75bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:14.439104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc09761-1166-45b4-a045-402e5db75bee admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:14.439455 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc09761-1166-45b4-a045-402e5db75bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:14.439794 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc09761-1166-45b4-a045-402e5db75bee admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:14.440512 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc09761-1166-45b4-a045-402e5db75bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:14.442190 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc09761-1166-45b4-a045-402e5db75bee admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:14.458320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1122/2254] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:14.460454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4f56e-d9fd-4b85-abfc-939972430c0d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:14.465774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:14.472692 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4f56e-d9fd-4b85-abfc-939972430c0d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:14.478372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129516e1-195e-40b5-9a9e-5a99948c2361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:14.479237 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129516e1-195e-40b5-9a9e-5a99948c2361 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:14.479671 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129516e1-195e-40b5-9a9e-5a99948c2361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:14.479941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129516e1-195e-40b5-9a9e-5a99948c2361 admin admin] PATH_INFO: `/v3/projects/dac6e5b74146479aab8f37da16475417/users/e5f7c954f81f4287a18105017d557eb4/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:14.496935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129516e1-195e-40b5-9a9e-5a99948c2361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac6e5b74146479aab8f37da16475417, user_id=e5f7c954f81f4287a18105017d557eb4, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:14.499611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129516e1-195e-40b5-9a9e-5a99948c2361 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:14.526655 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1133/2255] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:14 2022] PUT /identity/v3/projects/dac6e5b74146479aab8f37da16475417/users/e5f7c954f81f4287a18105017d557eb4/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:14.529774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc09761-1166-45b4-a045-402e5db75bee admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:14.541660 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc09761-1166-45b4-a045-402e5db75bee admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:14.591018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:14.648161 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b612b5-34c9-45c5-884d-461f6461d7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:14.648901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b612b5-34c9-45c5-884d-461f6461d7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:14.649191 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b612b5-34c9-45c5-884d-461f6461d7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:14.649466 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b612b5-34c9-45c5-884d-461f6461d7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:14.650146 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b612b5-34c9-45c5-884d-461f6461d7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:14.651805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b612b5-34c9-45c5-884d-461f6461d7c1 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:14.664138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1123/2256] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:14.668532 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129516e1-195e-40b5-9a9e-5a99948c2361 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:14.679391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129516e1-195e-40b5-9a9e-5a99948c2361 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:14.684023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117865cf-92be-428f-8e32-3d16b395ee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:14.684670 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117865cf-92be-428f-8e32-3d16b395ee26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:14.684949 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117865cf-92be-428f-8e32-3d16b395ee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:14.685226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117865cf-92be-428f-8e32-3d16b395ee26 admin admin] PATH_INFO: `/v3/projects/dac6e5b74146479aab8f37da16475417/users/e5f7c954f81f4287a18105017d557eb4/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:14.687153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117865cf-92be-428f-8e32-3d16b395ee26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac6e5b74146479aab8f37da16475417, user_id=e5f7c954f81f4287a18105017d557eb4, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:14.689895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117865cf-92be-428f-8e32-3d16b395ee26 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:14.701859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1134/2257] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:14 2022] PUT /identity/v3/projects/dac6e5b74146479aab8f37da16475417/users/e5f7c954f81f4287a18105017d557eb4/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:14.712620 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ca2e-18e0-4fec-8f04-7fd4b6883949 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:14.712986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ca2e-18e0-4fec-8f04-7fd4b6883949 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:14.713335 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ca2e-18e0-4fec-8f04-7fd4b6883949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:14.747237 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-0983ca2e-18e0-4fec-8f04-7fd4b6883949 None None] MFA Rules not processed for user `e5f7c954f81f4287a18105017d557eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:14.748486 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0983ca2e-18e0-4fec-8f04-7fd4b6883949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:14.833057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1124/2258] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:14.841273 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117865cf-92be-428f-8e32-3d16b395ee26 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:14.843835 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-117865cf-92be-428f-8e32-3d16b395ee26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:14.920823 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117865cf-92be-428f-8e32-3d16b395ee26 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:14.934276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad369c88-3217-406e-afb5-087fe62dc9a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:14.935760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad369c88-3217-406e-afb5-087fe62dc9a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:14.936217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad369c88-3217-406e-afb5-087fe62dc9a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:14.936707 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad369c88-3217-406e-afb5-087fe62dc9a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:14.947243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad369c88-3217-406e-afb5-087fe62dc9a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:14.948734 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad369c88-3217-406e-afb5-087fe62dc9a9 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:14.965579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1135/2259] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:14 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:15.042039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983ca2e-18e0-4fec-8f04-7fd4b6883949 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:15.051520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983ca2e-18e0-4fec-8f04-7fd4b6883949 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:15.055067 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93834e-a7b6-4214-8867-ed2bf06d8148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:15.055657 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93834e-a7b6-4214-8867-ed2bf06d8148 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:15.055931 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93834e-a7b6-4214-8867-ed2bf06d8148 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:15.056198 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93834e-a7b6-4214-8867-ed2bf06d8148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:15.111708 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93834e-a7b6-4214-8867-ed2bf06d8148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:15.113113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93834e-a7b6-4214-8867-ed2bf06d8148 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:15.121710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1125/2260] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:15 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:20.273282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad369c88-3217-406e-afb5-087fe62dc9a9 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:20.334062 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad369c88-3217-406e-afb5-087fe62dc9a9 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:20.339974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8361247-cef4-4945-ab5f-a9f217e28c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:20.340613 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8361247-cef4-4945-ab5f-a9f217e28c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:20.341064 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8361247-cef4-4945-ab5f-a9f217e28c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:20.341345 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8361247-cef4-4945-ab5f-a9f217e28c41 admin admin] PATH_INFO: `/v3/users/38d7b32afb8940fa94f3077dcbb2a5d2` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:20.342737 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8361247-cef4-4945-ab5f-a9f217e28c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d7b32afb8940fa94f3077dcbb2a5d2)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:20.345007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8361247-cef4-4945-ab5f-a9f217e28c41 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:20.406168 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b8361247-cef4-4945-ab5f-a9f217e28c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d7b32afb8940fa94f3077dcbb2a5d2'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:20.406858 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b8361247-cef4-4945-ab5f-a9f217e28c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d7b32afb8940fa94f3077dcbb2a5d2'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:20.414433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b8361247-cef4-4945-ab5f-a9f217e28c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d7b32afb8940fa94f3077dcbb2a5d2'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:20.425372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:20.426943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b8361247-cef4-4945-ab5f-a9f217e28c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d7b32afb8940fa94f3077dcbb2a5d2'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:20.435961 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b8361247-cef4-4945-ab5f-a9f217e28c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d7b32afb8940fa94f3077dcbb2a5d2'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:20.441880 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1136/2261] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:34:20 2022] DELETE /identity/v3/users/38d7b32afb8940fa94f3077dcbb2a5d2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:34:20.446970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf2b1d-4f1f-462b-91ec-3f904e0fb57c None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:20.447436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf2b1d-4f1f-462b-91ec-3f904e0fb57c None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:20.447514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf2b1d-4f1f-462b-91ec-3f904e0fb57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:20.467142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-e7cf2b1d-4f1f-462b-91ec-3f904e0fb57c None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:20.468440 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e7cf2b1d-4f1f-462b-91ec-3f904e0fb57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:20.512682 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:20.528889 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1126/2262] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:20.539241 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8361247-cef4-4945-ab5f-a9f217e28c41 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:20.540756 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b8361247-cef4-4945-ab5f-a9f217e28c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:20.599511 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8361247-cef4-4945-ab5f-a9f217e28c41 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:20.604036 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57e395-ca2b-4929-8dd1-27be338f6fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:20.604649 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57e395-ca2b-4929-8dd1-27be338f6fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:20.604927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57e395-ca2b-4929-8dd1-27be338f6fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:20.605205 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57e395-ca2b-4929-8dd1-27be338f6fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:20.625068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57e395-ca2b-4929-8dd1-27be338f6fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:20.626519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57e395-ca2b-4929-8dd1-27be338f6fa4 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:20.637153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1137/2263] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:21.036795 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf2b1d-4f1f-462b-91ec-3f904e0fb57c None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:21.038375 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e7cf2b1d-4f1f-462b-91ec-3f904e0fb57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:21.057258 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf2b1d-4f1f-462b-91ec-3f904e0fb57c None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:21.069789 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5debc81-c333-4534-822b-a02636428d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:21.070383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5debc81-c333-4534-822b-a02636428d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:21.070689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5debc81-c333-4534-822b-a02636428d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:21.070974 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5debc81-c333-4534-822b-a02636428d82 admin admin] PATH_INFO: `/v3/projects/22670872a54340878962ff46f4a87624` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:21.072119 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5debc81-c333-4534-822b-a02636428d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22670872a54340878962ff46f4a87624)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:21.074054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5debc81-c333-4534-822b-a02636428d82 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:21.125609 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5debc81-c333-4534-822b-a02636428d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22670872a54340878962ff46f4a87624', 'request_id': 'req-f5debc81-c333-4534-822b-a02636428d82'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:21.134823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5debc81-c333-4534-822b-a02636428d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22670872a54340878962ff46f4a87624', 'request_id': 'req-f5debc81-c333-4534-822b-a02636428d82'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:21.141629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5debc81-c333-4534-822b-a02636428d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22670872a54340878962ff46f4a87624', 'request_id': 'req-f5debc81-c333-4534-822b-a02636428d82'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:21.151873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5debc81-c333-4534-822b-a02636428d82 admin admin] The token cache is being invalidate because project 22670872a54340878962ff46f4a87624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:34:21.152159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5debc81-c333-4534-822b-a02636428d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:21.152829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5debc81-c333-4534-822b-a02636428d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:21.154505 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1127/2264] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:34:21 2022] DELETE /identity/v3/projects/22670872a54340878962ff46f4a87624 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:21.158701 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57e395-ca2b-4929-8dd1-27be338f6fa4 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:21.168795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57e395-ca2b-4929-8dd1-27be338f6fa4 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:21.224274 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322756f-8f72-447d-9422-d27f5b036fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:21.225334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322756f-8f72-447d-9422-d27f5b036fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:21.225605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322756f-8f72-447d-9422-d27f5b036fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:21.225867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322756f-8f72-447d-9422-d27f5b036fd5 admin admin] PATH_INFO: `/v3/users/e5f7c954f81f4287a18105017d557eb4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:21.226987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322756f-8f72-447d-9422-d27f5b036fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f7c954f81f4287a18105017d557eb4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:21.228880 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322756f-8f72-447d-9422-d27f5b036fd5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:21.277700 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3322756f-8f72-447d-9422-d27f5b036fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f7c954f81f4287a18105017d557eb4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:21.278363 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3322756f-8f72-447d-9422-d27f5b036fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f7c954f81f4287a18105017d557eb4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:21.287187 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3322756f-8f72-447d-9422-d27f5b036fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f7c954f81f4287a18105017d557eb4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:21.300312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3322756f-8f72-447d-9422-d27f5b036fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f7c954f81f4287a18105017d557eb4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:21.308080 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3322756f-8f72-447d-9422-d27f5b036fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f7c954f81f4287a18105017d557eb4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:21.314043 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1138/2265] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:34:21 2022] DELETE /identity/v3/users/e5f7c954f81f4287a18105017d557eb4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:21.613879 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5debc81-c333-4534-822b-a02636428d82 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:21.616162 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f5debc81-c333-4534-822b-a02636428d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:21.655598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5debc81-c333-4534-822b-a02636428d82 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:21.757912 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038125a-9464-42af-9b59-f82a15259459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:21.758584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038125a-9464-42af-9b59-f82a15259459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:21.758888 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038125a-9464-42af-9b59-f82a15259459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:21.759632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038125a-9464-42af-9b59-f82a15259459 admin admin] PATH_INFO: `/v3/projects/dac6e5b74146479aab8f37da16475417` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:21.763883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038125a-9464-42af-9b59-f82a15259459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dac6e5b74146479aab8f37da16475417)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:21.765642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038125a-9464-42af-9b59-f82a15259459 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:21.846677 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2038125a-9464-42af-9b59-f82a15259459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac6e5b74146479aab8f37da16475417', 'request_id': 'req-2038125a-9464-42af-9b59-f82a15259459'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:21.876479 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2038125a-9464-42af-9b59-f82a15259459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac6e5b74146479aab8f37da16475417', 'request_id': 'req-2038125a-9464-42af-9b59-f82a15259459'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:21.892837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2038125a-9464-42af-9b59-f82a15259459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac6e5b74146479aab8f37da16475417', 'request_id': 'req-2038125a-9464-42af-9b59-f82a15259459'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:21.907349 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2038125a-9464-42af-9b59-f82a15259459 admin admin] The token cache is being invalidate because project dac6e5b74146479aab8f37da16475417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:34:21.907643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2038125a-9464-42af-9b59-f82a15259459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:21.911168 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2038125a-9464-42af-9b59-f82a15259459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:21.918544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1128/2266] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:34:21 2022] DELETE /identity/v3/projects/dac6e5b74146479aab8f37da16475417 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:21.919666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14d1ef-147d-4a4b-b30c-f5de7e75862a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:21.919953 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14d1ef-147d-4a4b-b30c-f5de7e75862a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:21.920227 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14d1ef-147d-4a4b-b30c-f5de7e75862a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:21.950191 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-be14d1ef-147d-4a4b-b30c-f5de7e75862a None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:21.950896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-be14d1ef-147d-4a4b-b30c-f5de7e75862a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:21.956191 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:22.022646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1139/2267] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:34:22.029352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5c2f5-1307-4101-96f0-2eb041d01729 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:22.029641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5c2f5-1307-4101-96f0-2eb041d01729 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:22.029948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5c2f5-1307-4101-96f0-2eb041d01729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:22.038202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:22.053556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-f3d5c2f5-1307-4101-96f0-2eb041d01729 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:22.060516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f3d5c2f5-1307-4101-96f0-2eb041d01729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:22.063067 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1129/2268] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:22.067183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14d1ef-147d-4a4b-b30c-f5de7e75862a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:22.078752 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14d1ef-147d-4a4b-b30c-f5de7e75862a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:22.086135 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa36cea-e58f-4c7f-9ae6-5e17e706f80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:22.087344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa36cea-e58f-4c7f-9ae6-5e17e706f80f admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:22.087831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa36cea-e58f-4c7f-9ae6-5e17e706f80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:22.088395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa36cea-e58f-4c7f-9ae6-5e17e706f80f admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:22.089309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa36cea-e58f-4c7f-9ae6-5e17e706f80f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:34:22.089687 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa36cea-e58f-4c7f-9ae6-5e17e706f80f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:22.093935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa36cea-e58f-4c7f-9ae6-5e17e706f80f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:22.113186 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1140/2269] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:34:22.118250 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5c2f5-1307-4101-96f0-2eb041d01729 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:22.128487 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5c2f5-1307-4101-96f0-2eb041d01729 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:22.165858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe00f2-6bd4-4adc-a4d3-dcfdccdf1e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:22.166951 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe00f2-6bd4-4adc-a4d3-dcfdccdf1e82 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:22.167252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe00f2-6bd4-4adc-a4d3-dcfdccdf1e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:22.167616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe00f2-6bd4-4adc-a4d3-dcfdccdf1e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:22.168393 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe00f2-6bd4-4adc-a4d3-dcfdccdf1e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:22.170713 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe00f2-6bd4-4adc-a4d3-dcfdccdf1e82 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:22.238346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1130/2270] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:22 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:22.241113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106f1f3-d9f2-4573-a849-14c696ebf1de None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:22.241398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106f1f3-d9f2-4573-a849-14c696ebf1de None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:22.241670 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106f1f3-d9f2-4573-a849-14c696ebf1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:22.245442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe00f2-6bd4-4adc-a4d3-dcfdccdf1e82 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:22.279565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d106f1f3-d9f2-4573-a849-14c696ebf1de None None] MFA Rules not processed for user `cd0dbb2c140946f69c3f508b4184e998`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:22.280805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d106f1f3-d9f2-4573-a849-14c696ebf1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:22.390511 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe00f2-6bd4-4adc-a4d3-dcfdccdf1e82 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:22.399184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910b0d8-eeda-4789-a1fd-7906824b4656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:22.400124 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910b0d8-eeda-4789-a1fd-7906824b4656 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:22.400783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910b0d8-eeda-4789-a1fd-7906824b4656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:22.402002 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910b0d8-eeda-4789-a1fd-7906824b4656 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:22.402793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910b0d8-eeda-4789-a1fd-7906824b4656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:22.410654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910b0d8-eeda-4789-a1fd-7906824b4656 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:22.438581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1141/2271] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Sep 1 16:34:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:34:22.447970 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106f1f3-d9f2-4573-a849-14c696ebf1de None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:22.449418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d106f1f3-d9f2-4573-a849-14c696ebf1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:22.471661 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1131/2272] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:22 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:22.477667 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910b0d8-eeda-4789-a1fd-7906824b4656 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:22.492149 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910b0d8-eeda-4789-a1fd-7906824b4656 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:22.503834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79566480-9311-46a2-a7a4-f9898c111fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:22.510163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79566480-9311-46a2-a7a4-f9898c111fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:22.510163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79566480-9311-46a2-a7a4-f9898c111fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:22.510163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79566480-9311-46a2-a7a4-f9898c111fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:22.513489 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79566480-9311-46a2-a7a4-f9898c111fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:22.515331 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79566480-9311-46a2-a7a4-f9898c111fc3 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:22.554854 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1132/2273] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:22.556426 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79566480-9311-46a2-a7a4-f9898c111fc3 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:22.575599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79566480-9311-46a2-a7a4-f9898c111fc3 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:22.588514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90156163-1e66-4f05-a443-9c152dab2a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:22.589287 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90156163-1e66-4f05-a443-9c152dab2a4a admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:22.592144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90156163-1e66-4f05-a443-9c152dab2a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:22.592528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90156163-1e66-4f05-a443-9c152dab2a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:22.593312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90156163-1e66-4f05-a443-9c152dab2a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:22.595049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90156163-1e66-4f05-a443-9c152dab2a4a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:22.612637 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106f1f3-d9f2-4573-a849-14c696ebf1de None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:22.626281 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1133/2274] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:22.630358 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8fbf5-6a67-43d1-b716-4e4e2a21c80e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f7afa63815643f580c91df4e4c3bafc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:22.632957 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8fbf5-6a67-43d1-b716-4e4e2a21c80e service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:22.633515 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8fbf5-6a67-43d1-b716-4e4e2a21c80e service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:22.634014 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90156163-1e66-4f05-a443-9c152dab2a4a admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:22.634936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8fbf5-6a67-43d1-b716-4e4e2a21c80e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:22.656274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90156163-1e66-4f05-a443-9c152dab2a4a admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:22.658190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8fbf5-6a67-43d1-b716-4e4e2a21c80e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:22.661218 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8fbf5-6a67-43d1-b716-4e4e2a21c80e service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:22.669585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50d459-044b-4646-9d23-07eac09049d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:22.672182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50d459-044b-4646-9d23-07eac09049d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:22.672697 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50d459-044b-4646-9d23-07eac09049d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:22.674342 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50d459-044b-4646-9d23-07eac09049d1 admin admin] PATH_INFO: `/v3/projects/9125dddbbe65490ba48bad11035b08df/users/9d9034d13fbf4716bd79f0443857a83c/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:22.681805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1142/2275] 10.222.0.71 () {60 vars in 1384 bytes} [Thu Sep 1 16:34:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:34:22.716710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50d459-044b-4646-9d23-07eac09049d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9125dddbbe65490ba48bad11035b08df, user_id=9d9034d13fbf4716bd79f0443857a83c, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:22.721099 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50d459-044b-4646-9d23-07eac09049d1 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:22.759737 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1134/2276] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:22 2022] PUT /identity/v3/projects/9125dddbbe65490ba48bad11035b08df/users/9d9034d13fbf4716bd79f0443857a83c/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:22.770464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0b55f-8eb7-4b01-ad5b-fcaf4ee5f76e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:22.770745 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0b55f-8eb7-4b01-ad5b-fcaf4ee5f76e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:22.771127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0b55f-8eb7-4b01-ad5b-fcaf4ee5f76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:22.907127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1be0b55f-8eb7-4b01-ad5b-fcaf4ee5f76e None None] MFA Rules not processed for user `9d9034d13fbf4716bd79f0443857a83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:22.909263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1be0b55f-8eb7-4b01-ad5b-fcaf4ee5f76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:22.951858 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:23.129192 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1143/2277] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:23.131529 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50d459-044b-4646-9d23-07eac09049d1 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:23.305620 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50d459-044b-4646-9d23-07eac09049d1 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:23.311125 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd76e0-6a16-4c38-8fa0-5c2306fa02dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:23.311843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd76e0-6a16-4c38-8fa0-5c2306fa02dd admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:23.312125 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd76e0-6a16-4c38-8fa0-5c2306fa02dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:23.312403 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd76e0-6a16-4c38-8fa0-5c2306fa02dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:23.313100 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd76e0-6a16-4c38-8fa0-5c2306fa02dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:23.317290 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd76e0-6a16-4c38-8fa0-5c2306fa02dd admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:23.385613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1135/2278] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:23 2022] POST /identity/v3/projects => generated 379 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:23.387083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0b55f-8eb7-4b01-ad5b-fcaf4ee5f76e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:23.423166 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0b55f-8eb7-4b01-ad5b-fcaf4ee5f76e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:23.617913 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c2547-8a13-440a-a44d-fa01c5889e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:23.618661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c2547-8a13-440a-a44d-fa01c5889e48 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:23.619171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c2547-8a13-440a-a44d-fa01c5889e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:23.620335 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c2547-8a13-440a-a44d-fa01c5889e48 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:23.621190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c2547-8a13-440a-a44d-fa01c5889e48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:23.623241 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c2547-8a13-440a-a44d-fa01c5889e48 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:23.652788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1144/2279] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:23 2022] POST /identity/v3/users => generated 290 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:23.656566 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd76e0-6a16-4c38-8fa0-5c2306fa02dd admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:23.676067 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:23.691666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd76e0-6a16-4c38-8fa0-5c2306fa02dd admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:23.700323 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e87a8-f496-462b-a45e-6acb98d509c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:23.703013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e87a8-f496-462b-a45e-6acb98d509c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:23.703686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e87a8-f496-462b-a45e-6acb98d509c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:23.704400 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e87a8-f496-462b-a45e-6acb98d509c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:23.706816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e87a8-f496-462b-a45e-6acb98d509c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:23.708587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e87a8-f496-462b-a45e-6acb98d509c9 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:23.727391 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1136/2280] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:23.727650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c2547-8a13-440a-a44d-fa01c5889e48 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:23.743323 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c2547-8a13-440a-a44d-fa01c5889e48 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:23.765427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cb8ad-b894-4a82-8eb9-1f85a8929d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:23.766056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cb8ad-b894-4a82-8eb9-1f85a8929d8b admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:23.766335 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cb8ad-b894-4a82-8eb9-1f85a8929d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:23.766606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cb8ad-b894-4a82-8eb9-1f85a8929d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:23.767293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cb8ad-b894-4a82-8eb9-1f85a8929d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:23.768907 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cb8ad-b894-4a82-8eb9-1f85a8929d8b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:23.786163 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1145/2281] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:34:23.792584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e87a8-f496-462b-a45e-6acb98d509c9 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:23.811224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e87a8-f496-462b-a45e-6acb98d509c9 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:23.840965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaf9f8-350a-4383-8a91-e60ae7b24963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:23.841964 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaf9f8-350a-4383-8a91-e60ae7b24963 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:23.842476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaf9f8-350a-4383-8a91-e60ae7b24963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:23.842983 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaf9f8-350a-4383-8a91-e60ae7b24963 admin admin] PATH_INFO: `/v3/projects/107dcf27a3d748d2a5b46aecf6ce370f/users/c05796e7151940a7814a3a1155bfbe25/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:23.876493 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaaf9f8-350a-4383-8a91-e60ae7b24963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=107dcf27a3d748d2a5b46aecf6ce370f, user_id=c05796e7151940a7814a3a1155bfbe25, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:23.879322 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaaf9f8-350a-4383-8a91-e60ae7b24963 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:23.927545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1137/2282] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:23 2022] PUT /identity/v3/projects/107dcf27a3d748d2a5b46aecf6ce370f/users/c05796e7151940a7814a3a1155bfbe25/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:23.940080 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f7364-acc5-4b64-86bf-2d71194a364f None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:23.940437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f7364-acc5-4b64-86bf-2d71194a364f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:23.940786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f7364-acc5-4b64-86bf-2d71194a364f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:23.971690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-779f7364-acc5-4b64-86bf-2d71194a364f None None] MFA Rules not processed for user `c05796e7151940a7814a3a1155bfbe25`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:23.972907 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-779f7364-acc5-4b64-86bf-2d71194a364f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:24.043984 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1146/2283] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:24.048416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaf9f8-350a-4383-8a91-e60ae7b24963 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:24.139178 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaf9f8-350a-4383-8a91-e60ae7b24963 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:24.145012 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b44f8-9b66-440c-ab13-4babcdbd28ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:24.145756 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b44f8-9b66-440c-ab13-4babcdbd28ae admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:24.146031 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b44f8-9b66-440c-ab13-4babcdbd28ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:24.146299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b44f8-9b66-440c-ab13-4babcdbd28ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:24.147017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b44f8-9b66-440c-ab13-4babcdbd28ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:24.148921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b44f8-9b66-440c-ab13-4babcdbd28ae admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:24.177288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1138/2284] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:24 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:24.181781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f7364-acc5-4b64-86bf-2d71194a364f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:24.192347 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f7364-acc5-4b64-86bf-2d71194a364f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:24.218254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:24.250058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e225354-9f6a-4f43-b014-7bca15ea87c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:24.250746 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e225354-9f6a-4f43-b014-7bca15ea87c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:24.251028 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e225354-9f6a-4f43-b014-7bca15ea87c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:24.251303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e225354-9f6a-4f43-b014-7bca15ea87c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:24.251922 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e225354-9f6a-4f43-b014-7bca15ea87c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:24.253811 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e225354-9f6a-4f43-b014-7bca15ea87c4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:24.274634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1147/2285] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:24 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:34:24.278726 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b44f8-9b66-440c-ab13-4babcdbd28ae admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:24.289451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b44f8-9b66-440c-ab13-4babcdbd28ae admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:24.294012 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71620c45-dbf7-4a18-8aa2-60753019f102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:24.294597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71620c45-dbf7-4a18-8aa2-60753019f102 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:24.294902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71620c45-dbf7-4a18-8aa2-60753019f102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:24.295176 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71620c45-dbf7-4a18-8aa2-60753019f102 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:24.295810 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71620c45-dbf7-4a18-8aa2-60753019f102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:24.297388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71620c45-dbf7-4a18-8aa2-60753019f102 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:24.308317 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1139/2286] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:24.312619 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e225354-9f6a-4f43-b014-7bca15ea87c4 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:24.322307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e225354-9f6a-4f43-b014-7bca15ea87c4 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:24.326873 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50e493-308e-4253-9d9d-3f4e777e407d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:24.327501 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50e493-308e-4253-9d9d-3f4e777e407d admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:24.327777 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50e493-308e-4253-9d9d-3f4e777e407d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:24.328047 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50e493-308e-4253-9d9d-3f4e777e407d admin admin] PATH_INFO: `/v3/projects/ec50568b79f343f99a3cb697cb8c6a93/users/db18a76e36df4610b1d9c564eea26c2b/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:24.342964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50e493-308e-4253-9d9d-3f4e777e407d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec50568b79f343f99a3cb697cb8c6a93, user_id=db18a76e36df4610b1d9c564eea26c2b, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:24.345768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50e493-308e-4253-9d9d-3f4e777e407d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:24.358536 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1148/2287] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:24 2022] PUT /identity/v3/projects/ec50568b79f343f99a3cb697cb8c6a93/users/db18a76e36df4610b1d9c564eea26c2b/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:24.362483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71620c45-dbf7-4a18-8aa2-60753019f102 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:24.372638 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71620c45-dbf7-4a18-8aa2-60753019f102 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:24.472805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf6677-8970-4d79-b33d-2dae11ded7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:24.473455 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf6677-8970-4d79-b33d-2dae11ded7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:24.473760 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf6677-8970-4d79-b33d-2dae11ded7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:24.474031 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf6677-8970-4d79-b33d-2dae11ded7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:24.474783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf6677-8970-4d79-b33d-2dae11ded7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:24.476423 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf6677-8970-4d79-b33d-2dae11ded7c6 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:24.503930 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1140/2288] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:24.508911 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50e493-308e-4253-9d9d-3f4e777e407d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:24.519433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50e493-308e-4253-9d9d-3f4e777e407d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:24.524088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0adeae-25bf-443c-8dfb-113b50e05e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:24.524725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0adeae-25bf-443c-8dfb-113b50e05e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:24.525003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0adeae-25bf-443c-8dfb-113b50e05e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:24.525282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0adeae-25bf-443c-8dfb-113b50e05e6a admin admin] PATH_INFO: `/v3/projects/ec50568b79f343f99a3cb697cb8c6a93/users/db18a76e36df4610b1d9c564eea26c2b/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:24.527249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0adeae-25bf-443c-8dfb-113b50e05e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec50568b79f343f99a3cb697cb8c6a93, user_id=db18a76e36df4610b1d9c564eea26c2b, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:24.529856 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0adeae-25bf-443c-8dfb-113b50e05e6a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:24.540960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1149/2289] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:24 2022] PUT /identity/v3/projects/ec50568b79f343f99a3cb697cb8c6a93/users/db18a76e36df4610b1d9c564eea26c2b/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:24.551050 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2452d-13c5-4c76-ade9-65d70e3c7065 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:24.551339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2452d-13c5-4c76-ade9-65d70e3c7065 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:24.551611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2452d-13c5-4c76-ade9-65d70e3c7065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:24.579963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-d6c2452d-13c5-4c76-ade9-65d70e3c7065 None None] MFA Rules not processed for user `db18a76e36df4610b1d9c564eea26c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:24.581159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d6c2452d-13c5-4c76-ade9-65d70e3c7065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:24.619112 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:24.663528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1141/2290] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:24.675115 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0adeae-25bf-443c-8dfb-113b50e05e6a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:24.676852 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8b0adeae-25bf-443c-8dfb-113b50e05e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:24.733538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0adeae-25bf-443c-8dfb-113b50e05e6a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:24.737197 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69823ba8-f9f4-448c-8b8a-c260d5e31696 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:24.737800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69823ba8-f9f4-448c-8b8a-c260d5e31696 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:24.738079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69823ba8-f9f4-448c-8b8a-c260d5e31696 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:24.738352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69823ba8-f9f4-448c-8b8a-c260d5e31696 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:24.747630 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69823ba8-f9f4-448c-8b8a-c260d5e31696 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:24.749031 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69823ba8-f9f4-448c-8b8a-c260d5e31696 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:24.758229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1150/2291] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:24.800270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2452d-13c5-4c76-ade9-65d70e3c7065 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:24.801660 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d6c2452d-13c5-4c76-ade9-65d70e3c7065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:24.842751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2452d-13c5-4c76-ade9-65d70e3c7065 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:24.851580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad061cb-ff16-471b-a41a-9318d2dd574f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:24.852603 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad061cb-ff16-471b-a41a-9318d2dd574f service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:24.852885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad061cb-ff16-471b-a41a-9318d2dd574f service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:24.853163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad061cb-ff16-471b-a41a-9318d2dd574f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:24.950748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad061cb-ff16-471b-a41a-9318d2dd574f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:24.952236 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad061cb-ff16-471b-a41a-9318d2dd574f service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:24.962909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1142/2292] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:29.097100 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69823ba8-f9f4-448c-8b8a-c260d5e31696 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:29.098710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-69823ba8-f9f4-448c-8b8a-c260d5e31696 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:29.107658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad061cb-ff16-471b-a41a-9318d2dd574f service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:29.164708 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69823ba8-f9f4-448c-8b8a-c260d5e31696 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:29.169768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a57c52-45df-4ba4-b15d-25295b14659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:29.170414 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a57c52-45df-4ba4-b15d-25295b14659c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:29.170718 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a57c52-45df-4ba4-b15d-25295b14659c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:29.170987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a57c52-45df-4ba4-b15d-25295b14659c admin admin] PATH_INFO: `/v3/users/bf06ba58861749da9ca3c4ed5743b5c5` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:29.172108 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a57c52-45df-4ba4-b15d-25295b14659c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf06ba58861749da9ca3c4ed5743b5c5)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:29.174561 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a57c52-45df-4ba4-b15d-25295b14659c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:29.177439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad061cb-ff16-471b-a41a-9318d2dd574f service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:29.183005 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec48918-884a-4b44-b00f-b24d1666af19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:29.183901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec48918-884a-4b44-b00f-b24d1666af19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:29.184252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec48918-884a-4b44-b00f-b24d1666af19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:29.184589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec48918-884a-4b44-b00f-b24d1666af19 admin admin] PATH_INFO: `/v3/users/9d9034d13fbf4716bd79f0443857a83c` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:29.185776 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec48918-884a-4b44-b00f-b24d1666af19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d9034d13fbf4716bd79f0443857a83c)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:29.187889 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec48918-884a-4b44-b00f-b24d1666af19 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:29.206767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:29.235868 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-78a57c52-45df-4ba4-b15d-25295b14659c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf06ba58861749da9ca3c4ed5743b5c5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:29.236601 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-78a57c52-45df-4ba4-b15d-25295b14659c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf06ba58861749da9ca3c4ed5743b5c5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:29.244523 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-78a57c52-45df-4ba4-b15d-25295b14659c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf06ba58861749da9ca3c4ed5743b5c5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:29.249541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-bec48918-884a-4b44-b00f-b24d1666af19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d9034d13fbf4716bd79f0443857a83c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:29.250195 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-bec48918-884a-4b44-b00f-b24d1666af19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d9034d13fbf4716bd79f0443857a83c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:29.263176 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-78a57c52-45df-4ba4-b15d-25295b14659c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf06ba58861749da9ca3c4ed5743b5c5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:29.263652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:29.265274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-bec48918-884a-4b44-b00f-b24d1666af19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d9034d13fbf4716bd79f0443857a83c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:29.274010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-78a57c52-45df-4ba4-b15d-25295b14659c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf06ba58861749da9ca3c4ed5743b5c5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:29.275891 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-bec48918-884a-4b44-b00f-b24d1666af19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d9034d13fbf4716bd79f0443857a83c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:29.280665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1151/2293] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:34:29 2022] DELETE /identity/v3/users/bf06ba58861749da9ca3c4ed5743b5c5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:29.284175 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-bec48918-884a-4b44-b00f-b24d1666af19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d9034d13fbf4716bd79f0443857a83c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:29.285092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5f3f3-5fe9-4464-a971-3df12cfa4981 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:29.285375 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5f3f3-5fe9-4464-a971-3df12cfa4981 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:29.285650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5f3f3-5fe9-4464-a971-3df12cfa4981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:29.292091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1143/2294] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:34:29 2022] DELETE /identity/v3/users/9d9034d13fbf4716bd79f0443857a83c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:34:29.296512 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88b755-7e1d-494e-9d6b-00b292b4c097 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:29.296996 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88b755-7e1d-494e-9d6b-00b292b4c097 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:29.297392 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88b755-7e1d-494e-9d6b-00b292b4c097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:29.309289 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-c5f5f3f3-5fe9-4464-a971-3df12cfa4981 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:29.310570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c5f5f3f3-5fe9-4464-a971-3df12cfa4981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:29.319024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-4f88b755-7e1d-494e-9d6b-00b292b4c097 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:29.320342 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4f88b755-7e1d-494e-9d6b-00b292b4c097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:29.382904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1152/2295] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:34:29.387385 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1144/2296] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:29.392877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5f3f3-5fe9-4464-a971-3df12cfa4981 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:29.394263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c5f5f3f3-5fe9-4464-a971-3df12cfa4981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:29.397447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88b755-7e1d-494e-9d6b-00b292b4c097 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:29.398784 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4f88b755-7e1d-494e-9d6b-00b292b4c097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:29.451652 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5f3f3-5fe9-4464-a971-3df12cfa4981 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:29.454627 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88b755-7e1d-494e-9d6b-00b292b4c097 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:29.455428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc33c2-5e39-4fab-b54f-4e070b6a7680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:29.456042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc33c2-5e39-4fab-b54f-4e070b6a7680 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:29.456316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc33c2-5e39-4fab-b54f-4e070b6a7680 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:29.456589 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc33c2-5e39-4fab-b54f-4e070b6a7680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:29.462208 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbaeec-7010-43a2-bb1d-1d9bc504806b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:29.463249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbaeec-7010-43a2-bb1d-1d9bc504806b service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:29.463741 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbaeec-7010-43a2-bb1d-1d9bc504806b service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:29.464222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbaeec-7010-43a2-bb1d-1d9bc504806b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:29.469466 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc33c2-5e39-4fab-b54f-4e070b6a7680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:29.471139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc33c2-5e39-4fab-b54f-4e070b6a7680 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:29.486573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1153/2297] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:34:29.491405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbaeec-7010-43a2-bb1d-1d9bc504806b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:29.492996 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbaeec-7010-43a2-bb1d-1d9bc504806b service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:29.504666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1145/2298] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:34:30.021130 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc33c2-5e39-4fab-b54f-4e070b6a7680 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:30.023473 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bcdc33c2-5e39-4fab-b54f-4e070b6a7680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:30.029090 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbaeec-7010-43a2-bb1d-1d9bc504806b service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:30.030961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-debbaeec-7010-43a2-bb1d-1d9bc504806b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:30.045067 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbaeec-7010-43a2-bb1d-1d9bc504806b service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:30.050806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e893d2-4048-48dc-8565-39448ad99191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:30.051520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e893d2-4048-48dc-8565-39448ad99191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:30.052658 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e893d2-4048-48dc-8565-39448ad99191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:30.053051 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e893d2-4048-48dc-8565-39448ad99191 admin admin] PATH_INFO: `/v3/projects/9125dddbbe65490ba48bad11035b08df` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:30.054303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e893d2-4048-48dc-8565-39448ad99191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9125dddbbe65490ba48bad11035b08df)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:30.057145 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e893d2-4048-48dc-8565-39448ad99191 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:30.057274 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc33c2-5e39-4fab-b54f-4e070b6a7680 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:30.061931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153d78d-d91c-4ad8-bfe3-b75537845b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:30.062560 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153d78d-d91c-4ad8-bfe3-b75537845b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:30.062927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153d78d-d91c-4ad8-bfe3-b75537845b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:30.063136 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153d78d-d91c-4ad8-bfe3-b75537845b32 admin admin] PATH_INFO: `/v3/projects/4ef0af9e578b4d119f577b17355e6911` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:30.064313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153d78d-d91c-4ad8-bfe3-b75537845b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef0af9e578b4d119f577b17355e6911)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:30.067314 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153d78d-d91c-4ad8-bfe3-b75537845b32 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:30.112103 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a0e893d2-4048-48dc-8565-39448ad99191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9125dddbbe65490ba48bad11035b08df', 'request_id': 'req-a0e893d2-4048-48dc-8565-39448ad99191'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.113423 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:30.119455 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a0e893d2-4048-48dc-8565-39448ad99191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9125dddbbe65490ba48bad11035b08df', 'request_id': 'req-a0e893d2-4048-48dc-8565-39448ad99191'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.121621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3153d78d-d91c-4ad8-bfe3-b75537845b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef0af9e578b4d119f577b17355e6911', 'request_id': 'req-3153d78d-d91c-4ad8-bfe3-b75537845b32'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.125930 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a0e893d2-4048-48dc-8565-39448ad99191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9125dddbbe65490ba48bad11035b08df', 'request_id': 'req-a0e893d2-4048-48dc-8565-39448ad99191'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.129591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3153d78d-d91c-4ad8-bfe3-b75537845b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef0af9e578b4d119f577b17355e6911', 'request_id': 'req-3153d78d-d91c-4ad8-bfe3-b75537845b32'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.138923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a0e893d2-4048-48dc-8565-39448ad99191 admin admin] The token cache is being invalidate because project 9125dddbbe65490ba48bad11035b08df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:34:30.139564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a0e893d2-4048-48dc-8565-39448ad99191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.140574 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a0e893d2-4048-48dc-8565-39448ad99191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.142318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1146/2299] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:34:30 2022] DELETE /identity/v3/projects/9125dddbbe65490ba48bad11035b08df => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:30.147503 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e893d2-4048-48dc-8565-39448ad99191 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:30.149232 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a0e893d2-4048-48dc-8565-39448ad99191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:30.158579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3153d78d-d91c-4ad8-bfe3-b75537845b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef0af9e578b4d119f577b17355e6911', 'request_id': 'req-3153d78d-d91c-4ad8-bfe3-b75537845b32'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.161592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:30.181702 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3153d78d-d91c-4ad8-bfe3-b75537845b32 admin admin] The token cache is being invalidate because project 4ef0af9e578b4d119f577b17355e6911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:34:30.182044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3153d78d-d91c-4ad8-bfe3-b75537845b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.182952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3153d78d-d91c-4ad8-bfe3-b75537845b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.188042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1154/2300] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:34:30 2022] DELETE /identity/v3/projects/4ef0af9e578b4d119f577b17355e6911 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:30.189650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fc88c-de08-43f9-9ef1-4f9aa48ea23e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:30.189933 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fc88c-de08-43f9-9ef1-4f9aa48ea23e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:30.190199 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fc88c-de08-43f9-9ef1-4f9aa48ea23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:30.216241 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-316fc88c-de08-43f9-9ef1-4f9aa48ea23e None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:30.218153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-316fc88c-de08-43f9-9ef1-4f9aa48ea23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:30.230935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e893d2-4048-48dc-8565-39448ad99191 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:30.301937 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245399d-30eb-4a5a-8f2c-78ce0a343b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:30.303164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245399d-30eb-4a5a-8f2c-78ce0a343b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:30.303452 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245399d-30eb-4a5a-8f2c-78ce0a343b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:30.303719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245399d-30eb-4a5a-8f2c-78ce0a343b7b admin admin] PATH_INFO: `/v3/users/c05796e7151940a7814a3a1155bfbe25` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:30.304943 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245399d-30eb-4a5a-8f2c-78ce0a343b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c05796e7151940a7814a3a1155bfbe25)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:30.307009 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245399d-30eb-4a5a-8f2c-78ce0a343b7b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:30.314880 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1155/2301] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:30.323425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62398435-2d26-4629-ae56-534b45dd20e5 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:30.323783 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62398435-2d26-4629-ae56-534b45dd20e5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:30.324064 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62398435-2d26-4629-ae56-534b45dd20e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:30.344863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-62398435-2d26-4629-ae56-534b45dd20e5 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:30.346088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-62398435-2d26-4629-ae56-534b45dd20e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:30.354447 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1156/2302] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:30.359579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62398435-2d26-4629-ae56-534b45dd20e5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:30.364287 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e245399d-30eb-4a5a-8f2c-78ce0a343b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c05796e7151940a7814a3a1155bfbe25'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.365687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e245399d-30eb-4a5a-8f2c-78ce0a343b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c05796e7151940a7814a3a1155bfbe25'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.369446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62398435-2d26-4629-ae56-534b45dd20e5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:30.374953 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447bb3e-c4e4-4bb0-9d71-72e9a95381b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:30.376089 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447bb3e-c4e4-4bb0-9d71-72e9a95381b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:30.376368 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447bb3e-c4e4-4bb0-9d71-72e9a95381b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:30.376631 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447bb3e-c4e4-4bb0-9d71-72e9a95381b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:30.377278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447bb3e-c4e4-4bb0-9d71-72e9a95381b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:34:30.377578 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447bb3e-c4e4-4bb0-9d71-72e9a95381b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:30.379175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447bb3e-c4e4-4bb0-9d71-72e9a95381b7 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:30.380352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e245399d-30eb-4a5a-8f2c-78ce0a343b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c05796e7151940a7814a3a1155bfbe25'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.389588 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e245399d-30eb-4a5a-8f2c-78ce0a343b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c05796e7151940a7814a3a1155bfbe25'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.395911 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1157/2303] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:34:30.397581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447bb3e-c4e4-4bb0-9d71-72e9a95381b7 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:30.400268 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2447bb3e-c4e4-4bb0-9d71-72e9a95381b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:30.402140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e245399d-30eb-4a5a-8f2c-78ce0a343b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c05796e7151940a7814a3a1155bfbe25'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.408727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1147/2304] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:34:30 2022] DELETE /identity/v3/users/c05796e7151940a7814a3a1155bfbe25 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:30.416876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447bb3e-c4e4-4bb0-9d71-72e9a95381b7 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:30.501446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc3848-702d-4942-8c71-8cd367a3f500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:30.502600 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc3848-702d-4942-8c71-8cd367a3f500 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:30.503052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc3848-702d-4942-8c71-8cd367a3f500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:30.503442 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc3848-702d-4942-8c71-8cd367a3f500 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:30.504814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc3848-702d-4942-8c71-8cd367a3f500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:30.507203 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc3848-702d-4942-8c71-8cd367a3f500 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:30.566651 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1158/2305] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:30 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:34:30.571028 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245399d-30eb-4a5a-8f2c-78ce0a343b7b admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:30.585756 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245399d-30eb-4a5a-8f2c-78ce0a343b7b admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:30.634423 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:30.666513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eefae-9e92-4420-89ca-90987a4e7296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:30.671252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eefae-9e92-4420-89ca-90987a4e7296 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:30.671538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eefae-9e92-4420-89ca-90987a4e7296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:30.671815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eefae-9e92-4420-89ca-90987a4e7296 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:30.672484 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835eefae-9e92-4420-89ca-90987a4e7296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:30.674458 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835eefae-9e92-4420-89ca-90987a4e7296 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:30.698397 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1148/2306] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:30 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:34:30.702441 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc3848-702d-4942-8c71-8cd367a3f500 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:30.713599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc3848-702d-4942-8c71-8cd367a3f500 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:30.726121 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0336d-1ee5-45d2-8bb4-3bcec5747c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:30.726784 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0336d-1ee5-45d2-8bb4-3bcec5747c85 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:30.727057 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0336d-1ee5-45d2-8bb4-3bcec5747c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:30.727328 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0336d-1ee5-45d2-8bb4-3bcec5747c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:30.727983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0336d-1ee5-45d2-8bb4-3bcec5747c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:30.729662 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0336d-1ee5-45d2-8bb4-3bcec5747c85 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:30.741667 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1159/2307] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:30.745820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eefae-9e92-4420-89ca-90987a4e7296 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:30.757555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eefae-9e92-4420-89ca-90987a4e7296 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:30.762724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a15a32-4432-4e14-98a3-5adcf1ac743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:30.763693 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a15a32-4432-4e14-98a3-5adcf1ac743f admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:30.763693 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a15a32-4432-4e14-98a3-5adcf1ac743f admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:30.763915 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a15a32-4432-4e14-98a3-5adcf1ac743f admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:30.765143 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a15a32-4432-4e14-98a3-5adcf1ac743f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:30.766275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a15a32-4432-4e14-98a3-5adcf1ac743f admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:30.785664 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0336d-1ee5-45d2-8bb4-3bcec5747c85 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:30.802890 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1149/2308] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:34:30.803903 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a15a32-4432-4e14-98a3-5adcf1ac743f admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:30.810731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-87a15a32-4432-4e14-98a3-5adcf1ac743f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:30.816994 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0336d-1ee5-45d2-8bb4-3bcec5747c85 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:30.829042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee945ec-85a0-49fe-9f5c-ccb76e73e920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:30.830959 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee945ec-85a0-49fe-9f5c-ccb76e73e920 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:30.830959 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee945ec-85a0-49fe-9f5c-ccb76e73e920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:30.831168 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee945ec-85a0-49fe-9f5c-ccb76e73e920 admin admin] PATH_INFO: `/v3/projects/de035518f1f5444ea6fe1b7c6638b1c5/users/823536ae9bb145499c5c562e46409e1b/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:30.844519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a15a32-4432-4e14-98a3-5adcf1ac743f admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:30.858401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:30.859622 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:30.860266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:30.861080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b admin admin] PATH_INFO: `/v3/projects/107dcf27a3d748d2a5b46aecf6ce370f` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:30.862587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b admin admin] RBAC: Authorizing `identity:delete_project(project_id=107dcf27a3d748d2a5b46aecf6ce370f)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:30.865819 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:30.866225 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee945ec-85a0-49fe-9f5c-ccb76e73e920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de035518f1f5444ea6fe1b7c6638b1c5, user_id=823536ae9bb145499c5c562e46409e1b, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:30.869158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee945ec-85a0-49fe-9f5c-ccb76e73e920 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:30.881912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:30.890482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1160/2309] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:30 2022] PUT /identity/v3/projects/de035518f1f5444ea6fe1b7c6638b1c5/users/823536ae9bb145499c5c562e46409e1b/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:30.901805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec2f40-4c08-4c76-8161-aa9208bbbc43 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:30.902092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec2f40-4c08-4c76-8161-aa9208bbbc43 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:30.902368 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec2f40-4c08-4c76-8161-aa9208bbbc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:30.931583 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-3eec2f40-4c08-4c76-8161-aa9208bbbc43 None None] MFA Rules not processed for user `823536ae9bb145499c5c562e46409e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:30.932921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3eec2f40-4c08-4c76-8161-aa9208bbbc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:30.945543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '107dcf27a3d748d2a5b46aecf6ce370f', 'request_id': 'req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.963251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '107dcf27a3d748d2a5b46aecf6ce370f', 'request_id': 'req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.972810 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '107dcf27a3d748d2a5b46aecf6ce370f', 'request_id': 'req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.989749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b admin admin] The token cache is being invalidate because project 107dcf27a3d748d2a5b46aecf6ce370f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:34:30.990833 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.991492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:30.993183 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1150/2310] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:34:30 2022] DELETE /identity/v3/projects/107dcf27a3d748d2a5b46aecf6ce370f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:30.999523 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:31.003544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:31.016769 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1161/2311] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:31.025515 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec2f40-4c08-4c76-8161-aa9208bbbc43 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:31.027862 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3eec2f40-4c08-4c76-8161-aa9208bbbc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:31.090824 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c7d9d-d7b3-49d4-8e19-d82d8b5b011b admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:31.096009 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9d958-c6e9-4604-8dd8-94734da40a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:31.096742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9d958-c6e9-4604-8dd8-94734da40a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:31.097072 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9d958-c6e9-4604-8dd8-94734da40a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:31.097292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9d958-c6e9-4604-8dd8-94734da40a5a admin admin] PATH_INFO: `/v3/users/db18a76e36df4610b1d9c564eea26c2b` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:31.098415 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9d958-c6e9-4604-8dd8-94734da40a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db18a76e36df4610b1d9c564eea26c2b)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:31.109587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9d958-c6e9-4604-8dd8-94734da40a5a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:31.111367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec2f40-4c08-4c76-8161-aa9208bbbc43 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:31.115940 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adce29-a523-4fb2-a673-07a32cd90931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:31.116640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adce29-a523-4fb2-a673-07a32cd90931 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:31.117106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adce29-a523-4fb2-a673-07a32cd90931 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:31.117356 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adce29-a523-4fb2-a673-07a32cd90931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:31.127197 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adce29-a523-4fb2-a673-07a32cd90931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:31.129045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adce29-a523-4fb2-a673-07a32cd90931 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:31.152273 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:31.159147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1162/2312] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:34:31.167079 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-65d9d958-c6e9-4604-8dd8-94734da40a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db18a76e36df4610b1d9c564eea26c2b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:31.167892 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-65d9d958-c6e9-4604-8dd8-94734da40a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db18a76e36df4610b1d9c564eea26c2b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:31.181542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-65d9d958-c6e9-4604-8dd8-94734da40a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db18a76e36df4610b1d9c564eea26c2b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:31.192299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-65d9d958-c6e9-4604-8dd8-94734da40a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db18a76e36df4610b1d9c564eea26c2b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:31.204993 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adce29-a523-4fb2-a673-07a32cd90931 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:31.207247 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-65d9d958-c6e9-4604-8dd8-94734da40a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db18a76e36df4610b1d9c564eea26c2b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:31.207393 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-58adce29-a523-4fb2-a673-07a32cd90931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:31.226657 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1151/2313] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:34:30 2022] DELETE /identity/v3/users/db18a76e36df4610b1d9c564eea26c2b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:31.246500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adce29-a523-4fb2-a673-07a32cd90931 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:31.330967 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09776f-7430-488d-aece-58e7404b7b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:31.331621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09776f-7430-488d-aece-58e7404b7b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:31.331893 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09776f-7430-488d-aece-58e7404b7b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:31.332157 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09776f-7430-488d-aece-58e7404b7b5e admin admin] PATH_INFO: `/v3/users/823536ae9bb145499c5c562e46409e1b` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:31.333512 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09776f-7430-488d-aece-58e7404b7b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=823536ae9bb145499c5c562e46409e1b)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:31.335796 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09776f-7430-488d-aece-58e7404b7b5e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:31.379110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:31.389830 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-0d09776f-7430-488d-aece-58e7404b7b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '823536ae9bb145499c5c562e46409e1b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:31.390570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-0d09776f-7430-488d-aece-58e7404b7b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '823536ae9bb145499c5c562e46409e1b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:31.407707 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-0d09776f-7430-488d-aece-58e7404b7b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '823536ae9bb145499c5c562e46409e1b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:31.432976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-0d09776f-7430-488d-aece-58e7404b7b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '823536ae9bb145499c5c562e46409e1b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:31.441827 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-0d09776f-7430-488d-aece-58e7404b7b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '823536ae9bb145499c5c562e46409e1b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:31.451080 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1163/2314] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:34:31 2022] DELETE /identity/v3/users/823536ae9bb145499c5c562e46409e1b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:34:31.455246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c898bf5-3c6f-44a7-ab2c-3c667f48bb10 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:31.455854 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c898bf5-3c6f-44a7-ab2c-3c667f48bb10 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:31.456272 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c898bf5-3c6f-44a7-ab2c-3c667f48bb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:31.489357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-4c898bf5-3c6f-44a7-ab2c-3c667f48bb10 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:31.492178 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4c898bf5-3c6f-44a7-ab2c-3c667f48bb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:31.581971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09776f-7430-488d-aece-58e7404b7b5e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:31.583267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0d09776f-7430-488d-aece-58e7404b7b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:31.586122 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1152/2315] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:31.596771 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c898bf5-3c6f-44a7-ab2c-3c667f48bb10 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:31.598166 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09776f-7430-488d-aece-58e7404b7b5e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:31.598420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4c898bf5-3c6f-44a7-ab2c-3c667f48bb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:31.603834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08099b95-48e8-4cde-b389-db95eab5615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:31.604639 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08099b95-48e8-4cde-b389-db95eab5615d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:31.604915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08099b95-48e8-4cde-b389-db95eab5615d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:31.605189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08099b95-48e8-4cde-b389-db95eab5615d admin admin] PATH_INFO: `/v3/projects/ec50568b79f343f99a3cb697cb8c6a93` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:31.606959 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08099b95-48e8-4cde-b389-db95eab5615d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec50568b79f343f99a3cb697cb8c6a93)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:31.608869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08099b95-48e8-4cde-b389-db95eab5615d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:31.674109 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-08099b95-48e8-4cde-b389-db95eab5615d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec50568b79f343f99a3cb697cb8c6a93', 'request_id': 'req-08099b95-48e8-4cde-b389-db95eab5615d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:31.678110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c898bf5-3c6f-44a7-ab2c-3c667f48bb10 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:31.681589 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-08099b95-48e8-4cde-b389-db95eab5615d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec50568b79f343f99a3cb697cb8c6a93', 'request_id': 'req-08099b95-48e8-4cde-b389-db95eab5615d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:31.691428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-08099b95-48e8-4cde-b389-db95eab5615d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec50568b79f343f99a3cb697cb8c6a93', 'request_id': 'req-08099b95-48e8-4cde-b389-db95eab5615d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:31.723804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-08099b95-48e8-4cde-b389-db95eab5615d admin admin] The token cache is being invalidate because project ec50568b79f343f99a3cb697cb8c6a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:34:31.725496 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-08099b95-48e8-4cde-b389-db95eab5615d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:31.726603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-08099b95-48e8-4cde-b389-db95eab5615d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:31.730118 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1164/2316] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:34:31 2022] DELETE /identity/v3/projects/ec50568b79f343f99a3cb697cb8c6a93 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:34:31.736067 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15f35e-956b-410a-b421-589c4ad7374c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:31.736713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15f35e-956b-410a-b421-589c4ad7374c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:31.737168 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15f35e-956b-410a-b421-589c4ad7374c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:31.757173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d1c5e-c250-4e23-98a2-842402ff4dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:31.757793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d1c5e-c250-4e23-98a2-842402ff4dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:31.758075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d1c5e-c250-4e23-98a2-842402ff4dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:31.758348 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d1c5e-c250-4e23-98a2-842402ff4dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:31.760136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-521d1c5e-c250-4e23-98a2-842402ff4dd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:31.786199 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ac15f35e-956b-410a-b421-589c4ad7374c None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:31.787661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ac15f35e-956b-410a-b421-589c4ad7374c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:31.796736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:31.848520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d1c5e-c250-4e23-98a2-842402ff4dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:31.850036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d1c5e-c250-4e23-98a2-842402ff4dd9 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:31.858658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1165/2317] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:31.860209 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1153/2318] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:34:31.866015 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52224876-f79f-48f9-82ed-617cdb718ce0 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:31.866364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52224876-f79f-48f9-82ed-617cdb718ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:31.866680 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52224876-f79f-48f9-82ed-617cdb718ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:31.887108 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-52224876-f79f-48f9-82ed-617cdb718ce0 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:31.888544 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-52224876-f79f-48f9-82ed-617cdb718ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:31.898104 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1166/2319] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:34:31.902604 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d1c5e-c250-4e23-98a2-842402ff4dd9 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:31.912797 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d1c5e-c250-4e23-98a2-842402ff4dd9 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:31.918270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523f298-71c7-4f0d-a9a3-6d60412f03fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:31.918894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523f298-71c7-4f0d-a9a3-6d60412f03fd admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:31.919171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523f298-71c7-4f0d-a9a3-6d60412f03fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:31.919439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523f298-71c7-4f0d-a9a3-6d60412f03fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:31.920082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523f298-71c7-4f0d-a9a3-6d60412f03fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:34:31.920382 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523f298-71c7-4f0d-a9a3-6d60412f03fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:31.922015 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523f298-71c7-4f0d-a9a3-6d60412f03fd admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:31.935296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1154/2320] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:34:31.940106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52224876-f79f-48f9-82ed-617cdb718ce0 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:31.949653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52224876-f79f-48f9-82ed-617cdb718ce0 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:31.954836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4f979-4420-46f1-9769-0a0a371a11f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:31.955592 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f979-4420-46f1-9769-0a0a371a11f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:31.955886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f979-4420-46f1-9769-0a0a371a11f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:31.956158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f979-4420-46f1-9769-0a0a371a11f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:31.956828 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4f979-4420-46f1-9769-0a0a371a11f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:31.959525 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4f979-4420-46f1-9769-0a0a371a11f8 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:31.987160 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1167/2321] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:31 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:31.991304 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523f298-71c7-4f0d-a9a3-6d60412f03fd admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:32.001400 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523f298-71c7-4f0d-a9a3-6d60412f03fd admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:32.074401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f701e5e-08d1-4477-8d66-5918778603ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:32.075881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f701e5e-08d1-4477-8d66-5918778603ba admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:32.076604 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f701e5e-08d1-4477-8d66-5918778603ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:32.077223 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f701e5e-08d1-4477-8d66-5918778603ba admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:32.078250 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f701e5e-08d1-4477-8d66-5918778603ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:32.080805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f701e5e-08d1-4477-8d66-5918778603ba admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:32.113087 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1155/2322] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:31 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:32.117238 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4f979-4420-46f1-9769-0a0a371a11f8 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:32.131375 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4f979-4420-46f1-9769-0a0a371a11f8 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:32.141147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a95d4-e15e-4286-93c5-7e28082165e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:32.141880 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a95d4-e15e-4286-93c5-7e28082165e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:32.142297 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a95d4-e15e-4286-93c5-7e28082165e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:32.142688 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a95d4-e15e-4286-93c5-7e28082165e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:32.143615 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a95d4-e15e-4286-93c5-7e28082165e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:32.145628 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a95d4-e15e-4286-93c5-7e28082165e3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:32.148069 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:32.178673 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1168/2323] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:32.180375 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f701e5e-08d1-4477-8d66-5918778603ba admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:32.196320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f701e5e-08d1-4477-8d66-5918778603ba admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:32.197336 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a95d4-e15e-4286-93c5-7e28082165e3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:32.199575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3e2a95d4-e15e-4286-93c5-7e28082165e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:32.208079 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9c18c-eb00-45d1-9f82-291352917e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:32.208987 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c18c-eb00-45d1-9f82-291352917e27 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:32.209700 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c18c-eb00-45d1-9f82-291352917e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:32.210260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c18c-eb00-45d1-9f82-291352917e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:32.211130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9c18c-eb00-45d1-9f82-291352917e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:32.212935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9c18c-eb00-45d1-9f82-291352917e27 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:32.224005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a95d4-e15e-4286-93c5-7e28082165e3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:32.231262 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1156/2324] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:32.236035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a49a25-230e-4e52-b231-fd30a4f388e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:32.236686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a49a25-230e-4e52-b231-fd30a4f388e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:32.237363 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a49a25-230e-4e52-b231-fd30a4f388e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:32.237363 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a49a25-230e-4e52-b231-fd30a4f388e7 admin admin] PATH_INFO: `/v3/projects/de035518f1f5444ea6fe1b7c6638b1c5` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:32.239648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a49a25-230e-4e52-b231-fd30a4f388e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de035518f1f5444ea6fe1b7c6638b1c5)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:32.242137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a49a25-230e-4e52-b231-fd30a4f388e7 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:32.245392 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9c18c-eb00-45d1-9f82-291352917e27 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:32.268541 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9c18c-eb00-45d1-9f82-291352917e27 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:32.284002 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10381d9d-4e0a-46c9-b209-33d27ce667f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:32.284861 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10381d9d-4e0a-46c9-b209-33d27ce667f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:32.285360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10381d9d-4e0a-46c9-b209-33d27ce667f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:32.285788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10381d9d-4e0a-46c9-b209-33d27ce667f9 admin admin] PATH_INFO: `/v3/projects/869f81fb8713439ea619cc9ef2edb5e8/users/e727f046e3b7491c98404ad680235b2c/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:32.313029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10381d9d-4e0a-46c9-b209-33d27ce667f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869f81fb8713439ea619cc9ef2edb5e8, user_id=e727f046e3b7491c98404ad680235b2c, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:32.317192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10381d9d-4e0a-46c9-b209-33d27ce667f9 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:32.336704 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1157/2325] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:32 2022] PUT /identity/v3/projects/869f81fb8713439ea619cc9ef2edb5e8/users/e727f046e3b7491c98404ad680235b2c/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:32.344436 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f2a49a25-230e-4e52-b231-fd30a4f388e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de035518f1f5444ea6fe1b7c6638b1c5', 'request_id': 'req-f2a49a25-230e-4e52-b231-fd30a4f388e7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:32.349713 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635ae86-fb6c-4418-b41b-ea9add415ca4 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:32.349904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635ae86-fb6c-4418-b41b-ea9add415ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:32.350181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635ae86-fb6c-4418-b41b-ea9add415ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:32.358254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f2a49a25-230e-4e52-b231-fd30a4f388e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de035518f1f5444ea6fe1b7c6638b1c5', 'request_id': 'req-f2a49a25-230e-4e52-b231-fd30a4f388e7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:32.366099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f2a49a25-230e-4e52-b231-fd30a4f388e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de035518f1f5444ea6fe1b7c6638b1c5', 'request_id': 'req-f2a49a25-230e-4e52-b231-fd30a4f388e7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:32.399053 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-b635ae86-fb6c-4418-b41b-ea9add415ca4 None None] MFA Rules not processed for user `e727f046e3b7491c98404ad680235b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:32.400840 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b635ae86-fb6c-4418-b41b-ea9add415ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:32.406495 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f2a49a25-230e-4e52-b231-fd30a4f388e7 admin admin] The token cache is being invalidate because project de035518f1f5444ea6fe1b7c6638b1c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:34:32.407103 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f2a49a25-230e-4e52-b231-fd30a4f388e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:32.407553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f2a49a25-230e-4e52-b231-fd30a4f388e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:32.411594 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1169/2326] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:34:32 2022] DELETE /identity/v3/projects/de035518f1f5444ea6fe1b7c6638b1c5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:32.526543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:32.555800 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1158/2327] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:34:32.560559 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a49a25-230e-4e52-b231-fd30a4f388e7 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:32.562000 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f2a49a25-230e-4e52-b231-fd30a4f388e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:32.662643 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a49a25-230e-4e52-b231-fd30a4f388e7 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:32.667481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa877346-a8a0-4547-9178-c874dc497f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:32.668119 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877346-a8a0-4547-9178-c874dc497f8d admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:32.668587 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877346-a8a0-4547-9178-c874dc497f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:32.668855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877346-a8a0-4547-9178-c874dc497f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:32.669581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa877346-a8a0-4547-9178-c874dc497f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:32.671513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa877346-a8a0-4547-9178-c874dc497f8d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:32.699545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1170/2328] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:32 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:34:32.703636 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635ae86-fb6c-4418-b41b-ea9add415ca4 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:32.715066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635ae86-fb6c-4418-b41b-ea9add415ca4 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:32.773405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ea351-b8b0-4f2e-9cfe-e4e143188fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:32.774027 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ea351-b8b0-4f2e-9cfe-e4e143188fcb admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:32.774306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ea351-b8b0-4f2e-9cfe-e4e143188fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:32.774580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ea351-b8b0-4f2e-9cfe-e4e143188fcb admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:32.775274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ea351-b8b0-4f2e-9cfe-e4e143188fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:32.777254 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ea351-b8b0-4f2e-9cfe-e4e143188fcb admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:32.803535 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1159/2329] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:32 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:32.807590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa877346-a8a0-4547-9178-c874dc497f8d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:32.818381 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa877346-a8a0-4547-9178-c874dc497f8d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:32.823008 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb9cdc-2485-4b04-96a4-ac517658e11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:32.823624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb9cdc-2485-4b04-96a4-ac517658e11f admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:32.824537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb9cdc-2485-4b04-96a4-ac517658e11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:32.824915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb9cdc-2485-4b04-96a4-ac517658e11f admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:32.825554 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb9cdc-2485-4b04-96a4-ac517658e11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:32.827503 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb9cdc-2485-4b04-96a4-ac517658e11f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:32.839025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1171/2330] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:32.843106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ea351-b8b0-4f2e-9cfe-e4e143188fcb admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:32.853554 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ea351-b8b0-4f2e-9cfe-e4e143188fcb admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:32.858166 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28fc25-2739-4a9c-af8c-c9bf33f6b3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:32.858861 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28fc25-2739-4a9c-af8c-c9bf33f6b3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:32.859143 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28fc25-2739-4a9c-af8c-c9bf33f6b3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:32.859416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28fc25-2739-4a9c-af8c-c9bf33f6b3bd admin admin] PATH_INFO: `/v3/projects/98f89cf5843b4bdfa58ae678eae5aaa8/users/8a77ae847fab46c6bf31497ed6e289db/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:32.874865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28fc25-2739-4a9c-af8c-c9bf33f6b3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f89cf5843b4bdfa58ae678eae5aaa8, user_id=8a77ae847fab46c6bf31497ed6e289db, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:32.878042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28fc25-2739-4a9c-af8c-c9bf33f6b3bd admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:32.892508 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1160/2331] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:32 2022] PUT /identity/v3/projects/98f89cf5843b4bdfa58ae678eae5aaa8/users/8a77ae847fab46c6bf31497ed6e289db/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:32.896656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb9cdc-2485-4b04-96a4-ac517658e11f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:32.907571 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb9cdc-2485-4b04-96a4-ac517658e11f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:32.960167 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:32.979276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c60aa-61ed-4436-8caa-beb611324722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:32.979676 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c60aa-61ed-4436-8caa-beb611324722 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:32.979959 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c60aa-61ed-4436-8caa-beb611324722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:32.980230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c60aa-61ed-4436-8caa-beb611324722 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:32.980881 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c60aa-61ed-4436-8caa-beb611324722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:32.982639 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c60aa-61ed-4436-8caa-beb611324722 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:32.996091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1172/2332] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:33.000129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28fc25-2739-4a9c-af8c-c9bf33f6b3bd admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:33.016716 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28fc25-2739-4a9c-af8c-c9bf33f6b3bd admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:33.026224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd55ef4-850c-412a-9afa-b9cc1e986797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:33.026982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd55ef4-850c-412a-9afa-b9cc1e986797 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:33.027255 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd55ef4-850c-412a-9afa-b9cc1e986797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:33.027532 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd55ef4-850c-412a-9afa-b9cc1e986797 admin admin] PATH_INFO: `/v3/projects/98f89cf5843b4bdfa58ae678eae5aaa8/users/8a77ae847fab46c6bf31497ed6e289db/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:33.042996 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd55ef4-850c-412a-9afa-b9cc1e986797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f89cf5843b4bdfa58ae678eae5aaa8, user_id=8a77ae847fab46c6bf31497ed6e289db, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:33.042996 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd55ef4-850c-412a-9afa-b9cc1e986797 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:33.048154 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1161/2333] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:32 2022] PUT /identity/v3/projects/98f89cf5843b4bdfa58ae678eae5aaa8/users/8a77ae847fab46c6bf31497ed6e289db/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:33.058904 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5942c43-17c8-472b-be8e-8b93675f0eca None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:33.059184 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5942c43-17c8-472b-be8e-8b93675f0eca None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:33.059460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5942c43-17c8-472b-be8e-8b93675f0eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:33.087828 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-e5942c43-17c8-472b-be8e-8b93675f0eca None None] MFA Rules not processed for user `8a77ae847fab46c6bf31497ed6e289db`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:33.089028 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e5942c43-17c8-472b-be8e-8b93675f0eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:33.155075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1173/2334] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:33.167698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd55ef4-850c-412a-9afa-b9cc1e986797 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:33.169348 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2fd55ef4-850c-412a-9afa-b9cc1e986797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:33.233073 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd55ef4-850c-412a-9afa-b9cc1e986797 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:33.237202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a680e59-fd77-46bc-92a1-fd364de574e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:33.238021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a680e59-fd77-46bc-92a1-fd364de574e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:33.238394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a680e59-fd77-46bc-92a1-fd364de574e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:33.238877 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a680e59-fd77-46bc-92a1-fd364de574e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:33.257275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a680e59-fd77-46bc-92a1-fd364de574e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:33.259535 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a680e59-fd77-46bc-92a1-fd364de574e0 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:33.272231 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1162/2335] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:33.352061 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5942c43-17c8-472b-be8e-8b93675f0eca None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:33.361656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5942c43-17c8-472b-be8e-8b93675f0eca None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:33.365215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a6458-ec79-448e-bfb4-805f27df5c8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:33.365804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a6458-ec79-448e-bfb4-805f27df5c8a service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:33.366081 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a6458-ec79-448e-bfb4-805f27df5c8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:33.366351 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a6458-ec79-448e-bfb4-805f27df5c8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:33.422536 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a6458-ec79-448e-bfb4-805f27df5c8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:33.424263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a6458-ec79-448e-bfb4-805f27df5c8a service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:33.433511 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1174/2336] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:33.777321 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a680e59-fd77-46bc-92a1-fd364de574e0 service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:33.829436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:33.847722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a680e59-fd77-46bc-92a1-fd364de574e0 service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:33.852917 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca6604-d3e4-4006-8f00-b04ea36a6bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:33.853559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca6604-d3e4-4006-8f00-b04ea36a6bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:33.853839 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca6604-d3e4-4006-8f00-b04ea36a6bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:33.854127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca6604-d3e4-4006-8f00-b04ea36a6bc1 admin admin] PATH_INFO: `/v3/users/e727f046e3b7491c98404ad680235b2c` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:33.855291 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca6604-d3e4-4006-8f00-b04ea36a6bc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e727f046e3b7491c98404ad680235b2c)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:33.857215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca6604-d3e4-4006-8f00-b04ea36a6bc1 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:33.903979 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5bca6604-d3e4-4006-8f00-b04ea36a6bc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e727f046e3b7491c98404ad680235b2c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:33.904627 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5bca6604-d3e4-4006-8f00-b04ea36a6bc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e727f046e3b7491c98404ad680235b2c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:33.916791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5bca6604-d3e4-4006-8f00-b04ea36a6bc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e727f046e3b7491c98404ad680235b2c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:33.924024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5bca6604-d3e4-4006-8f00-b04ea36a6bc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e727f046e3b7491c98404ad680235b2c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:33.931439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5bca6604-d3e4-4006-8f00-b04ea36a6bc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e727f046e3b7491c98404ad680235b2c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:33.937085 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1163/2337] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:34:33 2022] DELETE /identity/v3/users/e727f046e3b7491c98404ad680235b2c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:33.941589 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeebeb-9fe7-49ec-8310-80408acffbf7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:33.941879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeebeb-9fe7-49ec-8310-80408acffbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:33.942155 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeebeb-9fe7-49ec-8310-80408acffbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:33.960960 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-0aeeebeb-9fe7-49ec-8310-80408acffbf7 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:33.962145 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0aeeebeb-9fe7-49ec-8310-80408acffbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:34.018802 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1175/2338] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:34.028793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca6604-d3e4-4006-8f00-b04ea36a6bc1 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:34.030176 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5bca6604-d3e4-4006-8f00-b04ea36a6bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:34.123885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca6604-d3e4-4006-8f00-b04ea36a6bc1 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:34.128545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd09bcd-72c2-4c1e-991d-65b1fc22cb50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:34.129534 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd09bcd-72c2-4c1e-991d-65b1fc22cb50 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:34.129962 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd09bcd-72c2-4c1e-991d-65b1fc22cb50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:34.130509 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd09bcd-72c2-4c1e-991d-65b1fc22cb50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:34.141547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd09bcd-72c2-4c1e-991d-65b1fc22cb50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:34.143255 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd09bcd-72c2-4c1e-991d-65b1fc22cb50 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:34.154670 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1164/2339] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:34.487059 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeeebeb-9fe7-49ec-8310-80408acffbf7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:34.488531 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0aeeebeb-9fe7-49ec-8310-80408acffbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:34.506046 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeeebeb-9fe7-49ec-8310-80408acffbf7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:34.512093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364eca8-aaab-4ff9-b91e-aed8872abe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:34.513065 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364eca8-aaab-4ff9-b91e-aed8872abe67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:34.513346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364eca8-aaab-4ff9-b91e-aed8872abe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:34.513615 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364eca8-aaab-4ff9-b91e-aed8872abe67 admin admin] PATH_INFO: `/v3/projects/869f81fb8713439ea619cc9ef2edb5e8` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:34.515215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364eca8-aaab-4ff9-b91e-aed8872abe67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=869f81fb8713439ea619cc9ef2edb5e8)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:34.518145 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364eca8-aaab-4ff9-b91e-aed8872abe67 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:34.533725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:34.581094 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7364eca8-aaab-4ff9-b91e-aed8872abe67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869f81fb8713439ea619cc9ef2edb5e8', 'request_id': 'req-7364eca8-aaab-4ff9-b91e-aed8872abe67'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:34.588678 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7364eca8-aaab-4ff9-b91e-aed8872abe67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869f81fb8713439ea619cc9ef2edb5e8', 'request_id': 'req-7364eca8-aaab-4ff9-b91e-aed8872abe67'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:34.596260 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7364eca8-aaab-4ff9-b91e-aed8872abe67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869f81fb8713439ea619cc9ef2edb5e8', 'request_id': 'req-7364eca8-aaab-4ff9-b91e-aed8872abe67'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:34.616211 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7364eca8-aaab-4ff9-b91e-aed8872abe67 admin admin] The token cache is being invalidate because project 869f81fb8713439ea619cc9ef2edb5e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:34:34.616589 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7364eca8-aaab-4ff9-b91e-aed8872abe67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:34.617159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7364eca8-aaab-4ff9-b91e-aed8872abe67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:34.618677 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1176/2340] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:34:34 2022] DELETE /identity/v3/projects/869f81fb8713439ea619cc9ef2edb5e8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:34.622666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd09bcd-72c2-4c1e-991d-65b1fc22cb50 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:34.632637 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd09bcd-72c2-4c1e-991d-65b1fc22cb50 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:34.690590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e988f3e-e747-4b4a-9ca2-897cbdaba16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:34.691248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e988f3e-e747-4b4a-9ca2-897cbdaba16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:34.691529 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e988f3e-e747-4b4a-9ca2-897cbdaba16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:34.691804 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e988f3e-e747-4b4a-9ca2-897cbdaba16e admin admin] PATH_INFO: `/v3/users/8a77ae847fab46c6bf31497ed6e289db` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:34.692959 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e988f3e-e747-4b4a-9ca2-897cbdaba16e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a77ae847fab46c6bf31497ed6e289db)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:34.694900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e988f3e-e747-4b4a-9ca2-897cbdaba16e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:34.705129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:34.745804 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-9e988f3e-e747-4b4a-9ca2-897cbdaba16e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a77ae847fab46c6bf31497ed6e289db'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:34.746477 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-9e988f3e-e747-4b4a-9ca2-897cbdaba16e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a77ae847fab46c6bf31497ed6e289db'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:34.758375 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-9e988f3e-e747-4b4a-9ca2-897cbdaba16e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a77ae847fab46c6bf31497ed6e289db'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:34.765832 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-9e988f3e-e747-4b4a-9ca2-897cbdaba16e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a77ae847fab46c6bf31497ed6e289db'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:34.774207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-9e988f3e-e747-4b4a-9ca2-897cbdaba16e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a77ae847fab46c6bf31497ed6e289db'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:34.780284 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1165/2341] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:34:34 2022] DELETE /identity/v3/users/8a77ae847fab46c6bf31497ed6e289db => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:35.103425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364eca8-aaab-4ff9-b91e-aed8872abe67 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:35.105195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7364eca8-aaab-4ff9-b91e-aed8872abe67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:35.119401 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364eca8-aaab-4ff9-b91e-aed8872abe67 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:35.181386 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee73135-18c5-4226-b263-cc40e8d7204c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:35.182017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee73135-18c5-4226-b263-cc40e8d7204c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:35.182298 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee73135-18c5-4226-b263-cc40e8d7204c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:35.182570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee73135-18c5-4226-b263-cc40e8d7204c admin admin] PATH_INFO: `/v3/projects/98f89cf5843b4bdfa58ae678eae5aaa8` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:35.183713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee73135-18c5-4226-b263-cc40e8d7204c admin admin] RBAC: Authorizing `identity:delete_project(project_id=98f89cf5843b4bdfa58ae678eae5aaa8)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:35.185668 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee73135-18c5-4226-b263-cc40e8d7204c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:35.233724 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2ee73135-18c5-4226-b263-cc40e8d7204c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98f89cf5843b4bdfa58ae678eae5aaa8', 'request_id': 'req-2ee73135-18c5-4226-b263-cc40e8d7204c'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:35.240035 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2ee73135-18c5-4226-b263-cc40e8d7204c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98f89cf5843b4bdfa58ae678eae5aaa8', 'request_id': 'req-2ee73135-18c5-4226-b263-cc40e8d7204c'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:35.245517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2ee73135-18c5-4226-b263-cc40e8d7204c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98f89cf5843b4bdfa58ae678eae5aaa8', 'request_id': 'req-2ee73135-18c5-4226-b263-cc40e8d7204c'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:35.258363 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2ee73135-18c5-4226-b263-cc40e8d7204c admin admin] The token cache is being invalidate because project 98f89cf5843b4bdfa58ae678eae5aaa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:34:35.258587 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2ee73135-18c5-4226-b263-cc40e8d7204c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:35.259251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2ee73135-18c5-4226-b263-cc40e8d7204c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:35.260723 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1177/2342] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:34:35 2022] DELETE /identity/v3/projects/98f89cf5843b4bdfa58ae678eae5aaa8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:35.265500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f29e9a-1847-4472-9e8b-631fd8d53d44 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:35.265789 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f29e9a-1847-4472-9e8b-631fd8d53d44 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:35.266071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f29e9a-1847-4472-9e8b-631fd8d53d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:35.285876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-a4f29e9a-1847-4472-9e8b-631fd8d53d44 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:35.287123 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a4f29e9a-1847-4472-9e8b-631fd8d53d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:35.389776 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1166/2343] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:35.399344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731054e-06cf-48bb-9785-c7f4110d5967 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:35.399893 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731054e-06cf-48bb-9785-c7f4110d5967 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:35.400380 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731054e-06cf-48bb-9785-c7f4110d5967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:35.423060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f731054e-06cf-48bb-9785-c7f4110d5967 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:35.424426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f731054e-06cf-48bb-9785-c7f4110d5967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:35.433400 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1178/2344] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:35.439991 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f29e9a-1847-4472-9e8b-631fd8d53d44 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:35.450982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f29e9a-1847-4472-9e8b-631fd8d53d44 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:35.455652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291192e-ac3e-44bd-b589-f5ddb09b39b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:35.456254 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291192e-ac3e-44bd-b589-f5ddb09b39b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:35.456533 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291192e-ac3e-44bd-b589-f5ddb09b39b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:35.456803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291192e-ac3e-44bd-b589-f5ddb09b39b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:35.457454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291192e-ac3e-44bd-b589-f5ddb09b39b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:34:35.457759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291192e-ac3e-44bd-b589-f5ddb09b39b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:35.460222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291192e-ac3e-44bd-b589-f5ddb09b39b3 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:35.473424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1167/2345] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:34:35.477918 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731054e-06cf-48bb-9785-c7f4110d5967 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:35.487330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731054e-06cf-48bb-9785-c7f4110d5967 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:35.492485 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298192b-538b-4eb1-9a06-e27ab9460295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:35.493077 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298192b-538b-4eb1-9a06-e27ab9460295 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:35.493350 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298192b-538b-4eb1-9a06-e27ab9460295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:35.493618 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298192b-538b-4eb1-9a06-e27ab9460295 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:35.494303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298192b-538b-4eb1-9a06-e27ab9460295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:35.496209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298192b-538b-4eb1-9a06-e27ab9460295 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:35.518406 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:35.527061 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1179/2346] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:35 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:35.532159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291192e-ac3e-44bd-b589-f5ddb09b39b3 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:35.542061 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291192e-ac3e-44bd-b589-f5ddb09b39b3 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:35.598515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6773e87-a881-4cc1-97bc-fd9dd4e1b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:35.599234 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6773e87-a881-4cc1-97bc-fd9dd4e1b92f admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:35.599533 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6773e87-a881-4cc1-97bc-fd9dd4e1b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:35.599809 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6773e87-a881-4cc1-97bc-fd9dd4e1b92f admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:35.600508 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6773e87-a881-4cc1-97bc-fd9dd4e1b92f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:35.602642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6773e87-a881-4cc1-97bc-fd9dd4e1b92f admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:35.629804 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1168/2347] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:35 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:34:35.634537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298192b-538b-4eb1-9a06-e27ab9460295 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:35.645083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298192b-538b-4eb1-9a06-e27ab9460295 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:35.651125 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659a800-60b2-49e8-b13b-7276192bb07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:35.651682 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659a800-60b2-49e8-b13b-7276192bb07f admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:35.651911 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659a800-60b2-49e8-b13b-7276192bb07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:35.652259 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659a800-60b2-49e8-b13b-7276192bb07f admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:35.652884 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659a800-60b2-49e8-b13b-7276192bb07f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:35.654493 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659a800-60b2-49e8-b13b-7276192bb07f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:35.667426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1180/2348] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:35.671167 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6773e87-a881-4cc1-97bc-fd9dd4e1b92f admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:35.678144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:35.682135 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6773e87-a881-4cc1-97bc-fd9dd4e1b92f admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:35.688804 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ae491-8a36-4de6-93a4-eb56d584e19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:35.689651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ae491-8a36-4de6-93a4-eb56d584e19a admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:35.690129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ae491-8a36-4de6-93a4-eb56d584e19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:35.690580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ae491-8a36-4de6-93a4-eb56d584e19a admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:35.691451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ae491-8a36-4de6-93a4-eb56d584e19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:35.693175 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ae491-8a36-4de6-93a4-eb56d584e19a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:35.711795 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1169/2349] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:35.713068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659a800-60b2-49e8-b13b-7276192bb07f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:35.724743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659a800-60b2-49e8-b13b-7276192bb07f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:35.729719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da921f8-84b7-4c1d-8f15-72dc71043dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:35.730507 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da921f8-84b7-4c1d-8f15-72dc71043dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:35.730860 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da921f8-84b7-4c1d-8f15-72dc71043dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:35.731136 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da921f8-84b7-4c1d-8f15-72dc71043dd6 admin admin] PATH_INFO: `/v3/projects/5e330c966b3b45c3be972e3db0050b2d/users/ec22d971197d406ba04d014509621257/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:35.747768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da921f8-84b7-4c1d-8f15-72dc71043dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e330c966b3b45c3be972e3db0050b2d, user_id=ec22d971197d406ba04d014509621257, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:35.754532 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da921f8-84b7-4c1d-8f15-72dc71043dd6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:35.772328 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1181/2350] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:35 2022] PUT /identity/v3/projects/5e330c966b3b45c3be972e3db0050b2d/users/ec22d971197d406ba04d014509621257/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:34:35.782595 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be48e4-3b76-4bf4-b3db-a62b26743d2e None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:35.782903 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be48e4-3b76-4bf4-b3db-a62b26743d2e None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:35.783179 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be48e4-3b76-4bf4-b3db-a62b26743d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:35.810671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-c3be48e4-3b76-4bf4-b3db-a62b26743d2e None None] MFA Rules not processed for user `ec22d971197d406ba04d014509621257`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:35.811877 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c3be48e4-3b76-4bf4-b3db-a62b26743d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:35.874894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1170/2351] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:35.886421 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da921f8-84b7-4c1d-8f15-72dc71043dd6 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:35.888139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8da921f8-84b7-4c1d-8f15-72dc71043dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:35.949401 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da921f8-84b7-4c1d-8f15-72dc71043dd6 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:35.953386 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf5162-6337-4b9b-b3a7-d2d28bad604e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:35.954066 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf5162-6337-4b9b-b3a7-d2d28bad604e service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:35.954411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf5162-6337-4b9b-b3a7-d2d28bad604e service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:35.954790 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf5162-6337-4b9b-b3a7-d2d28bad604e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:35.982530 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf5162-6337-4b9b-b3a7-d2d28bad604e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:35.984413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf5162-6337-4b9b-b3a7-d2d28bad604e service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:36.006847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1182/2352] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:40.173933 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be48e4-3b76-4bf4-b3db-a62b26743d2e None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:40.236044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be48e4-3b76-4bf4-b3db-a62b26743d2e None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:40.240552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b4c78-43c6-49a2-9416-a74b01fdca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:40.241171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b4c78-43c6-49a2-9416-a74b01fdca69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:40.241448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b4c78-43c6-49a2-9416-a74b01fdca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:40.241718 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b4c78-43c6-49a2-9416-a74b01fdca69 admin admin] PATH_INFO: `/v3/users/ec22d971197d406ba04d014509621257` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:40.242857 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b4c78-43c6-49a2-9416-a74b01fdca69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec22d971197d406ba04d014509621257)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:40.244757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b4c78-43c6-49a2-9416-a74b01fdca69 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:40.289789 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e69b4c78-43c6-49a2-9416-a74b01fdca69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec22d971197d406ba04d014509621257'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:40.290448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e69b4c78-43c6-49a2-9416-a74b01fdca69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec22d971197d406ba04d014509621257'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:40.302298 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e69b4c78-43c6-49a2-9416-a74b01fdca69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec22d971197d406ba04d014509621257'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:40.309646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e69b4c78-43c6-49a2-9416-a74b01fdca69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec22d971197d406ba04d014509621257'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:40.316685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e69b4c78-43c6-49a2-9416-a74b01fdca69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec22d971197d406ba04d014509621257'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:40.322457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1171/2353] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:34:40 2022] DELETE /identity/v3/users/ec22d971197d406ba04d014509621257 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:40.327227 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3ec38-9de9-425e-a3f1-cae8b3c838fb None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:40.327743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3ec38-9de9-425e-a3f1-cae8b3c838fb None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:40.327922 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3ec38-9de9-425e-a3f1-cae8b3c838fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:40.348102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f9f3ec38-9de9-425e-a3f1-cae8b3c838fb None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:40.349861 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f9f3ec38-9de9-425e-a3f1-cae8b3c838fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:40.406750 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1183/2354] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:40.416362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b4c78-43c6-49a2-9416-a74b01fdca69 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:40.417759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e69b4c78-43c6-49a2-9416-a74b01fdca69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:40.423112 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:40.481489 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b4c78-43c6-49a2-9416-a74b01fdca69 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:40.486102 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995c362-1ff5-4d8f-87f8-f5349c9c4df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:40.486734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995c362-1ff5-4d8f-87f8-f5349c9c4df3 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:40.487017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995c362-1ff5-4d8f-87f8-f5349c9c4df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:40.489215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995c362-1ff5-4d8f-87f8-f5349c9c4df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:40.498131 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995c362-1ff5-4d8f-87f8-f5349c9c4df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:40.499581 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995c362-1ff5-4d8f-87f8-f5349c9c4df3 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:40.509362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1172/2355] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:40.854748 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3ec38-9de9-425e-a3f1-cae8b3c838fb None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:40.856450 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f9f3ec38-9de9-425e-a3f1-cae8b3c838fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:40.871881 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3ec38-9de9-425e-a3f1-cae8b3c838fb None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:40.877148 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cadf31-76aa-4a98-b9d9-4094ba2c1532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:40.877780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cadf31-76aa-4a98-b9d9-4094ba2c1532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:40.878196 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cadf31-76aa-4a98-b9d9-4094ba2c1532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:40.878475 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cadf31-76aa-4a98-b9d9-4094ba2c1532 admin admin] PATH_INFO: `/v3/projects/5e330c966b3b45c3be972e3db0050b2d` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:40.879637 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cadf31-76aa-4a98-b9d9-4094ba2c1532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e330c966b3b45c3be972e3db0050b2d)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:40.882128 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cadf31-76aa-4a98-b9d9-4094ba2c1532 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:40.936837 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f3cadf31-76aa-4a98-b9d9-4094ba2c1532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e330c966b3b45c3be972e3db0050b2d', 'request_id': 'req-f3cadf31-76aa-4a98-b9d9-4094ba2c1532'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:40.943265 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f3cadf31-76aa-4a98-b9d9-4094ba2c1532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e330c966b3b45c3be972e3db0050b2d', 'request_id': 'req-f3cadf31-76aa-4a98-b9d9-4094ba2c1532'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:40.947891 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:40.949165 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f3cadf31-76aa-4a98-b9d9-4094ba2c1532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e330c966b3b45c3be972e3db0050b2d', 'request_id': 'req-f3cadf31-76aa-4a98-b9d9-4094ba2c1532'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:40.963873 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f3cadf31-76aa-4a98-b9d9-4094ba2c1532 admin admin] The token cache is being invalidate because project 5e330c966b3b45c3be972e3db0050b2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:34:40.964185 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f3cadf31-76aa-4a98-b9d9-4094ba2c1532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:40.964806 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f3cadf31-76aa-4a98-b9d9-4094ba2c1532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:40.966277 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1184/2356] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:34:40 2022] DELETE /identity/v3/projects/5e330c966b3b45c3be972e3db0050b2d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:40.971060 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a289e1-94c1-44bc-9dbc-ab6e042e6dd4 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:40.971347 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a289e1-94c1-44bc-9dbc-ab6e042e6dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:40.971622 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a289e1-94c1-44bc-9dbc-ab6e042e6dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:40.991291 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-50a289e1-94c1-44bc-9dbc-ab6e042e6dd4 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:40.992496 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-50a289e1-94c1-44bc-9dbc-ab6e042e6dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:41.050139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1173/2357] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:41.058236 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80b9f5-ec0f-4cf3-994a-83239dbd862d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:41.058519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80b9f5-ec0f-4cf3-994a-83239dbd862d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:41.058836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80b9f5-ec0f-4cf3-994a-83239dbd862d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:41.078669 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4f80b9f5-ec0f-4cf3-994a-83239dbd862d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:41.079858 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4f80b9f5-ec0f-4cf3-994a-83239dbd862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:41.087909 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1185/2358] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:41.092308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a289e1-94c1-44bc-9dbc-ab6e042e6dd4 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:41.102761 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a289e1-94c1-44bc-9dbc-ab6e042e6dd4 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:41.107438 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55412878-5fb8-4ac3-bf06-93ec3e81d080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:41.108039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55412878-5fb8-4ac3-bf06-93ec3e81d080 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:41.108320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55412878-5fb8-4ac3-bf06-93ec3e81d080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:41.108594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55412878-5fb8-4ac3-bf06-93ec3e81d080 admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:41.109281 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55412878-5fb8-4ac3-bf06-93ec3e81d080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:34:41.109588 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55412878-5fb8-4ac3-bf06-93ec3e81d080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:41.111220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55412878-5fb8-4ac3-bf06-93ec3e81d080 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:41.123515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1174/2359] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:34:41.128037 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80b9f5-ec0f-4cf3-994a-83239dbd862d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:41.139132 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80b9f5-ec0f-4cf3-994a-83239dbd862d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:41.143847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae661722-fbdb-430f-a0b4-8a08d552dc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:41.144443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae661722-fbdb-430f-a0b4-8a08d552dc7d admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:41.144719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae661722-fbdb-430f-a0b4-8a08d552dc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:41.146976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae661722-fbdb-430f-a0b4-8a08d552dc7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:41.147663 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae661722-fbdb-430f-a0b4-8a08d552dc7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:41.149567 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae661722-fbdb-430f-a0b4-8a08d552dc7d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:41.178415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1186/2360] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:41 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:41.183743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55412878-5fb8-4ac3-bf06-93ec3e81d080 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:41.194565 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55412878-5fb8-4ac3-bf06-93ec3e81d080 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:41.253538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57315d7-460d-453b-8a46-c5216b7abf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:41.254207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57315d7-460d-453b-8a46-c5216b7abf13 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:41.254488 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57315d7-460d-453b-8a46-c5216b7abf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:41.254803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57315d7-460d-453b-8a46-c5216b7abf13 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:41.255954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57315d7-460d-453b-8a46-c5216b7abf13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:41.257894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57315d7-460d-453b-8a46-c5216b7abf13 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:41.282713 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1175/2361] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:41 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:41.283882 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae661722-fbdb-430f-a0b4-8a08d552dc7d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:41.295082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae661722-fbdb-430f-a0b4-8a08d552dc7d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:41.299831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a525d5-4c07-4454-b4e8-d3295d38c427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:41.300367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a525d5-4c07-4454-b4e8-d3295d38c427 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:41.300621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a525d5-4c07-4454-b4e8-d3295d38c427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:41.300892 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a525d5-4c07-4454-b4e8-d3295d38c427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:41.301557 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a525d5-4c07-4454-b4e8-d3295d38c427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:41.303238 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a525d5-4c07-4454-b4e8-d3295d38c427 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:41.313516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1187/2362] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:41.318001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57315d7-460d-453b-8a46-c5216b7abf13 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:41.328005 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57315d7-460d-453b-8a46-c5216b7abf13 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:41.332696 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d3f92-c167-4b50-b3b3-20194d61bd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:41.333384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d3f92-c167-4b50-b3b3-20194d61bd75 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:41.333663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d3f92-c167-4b50-b3b3-20194d61bd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:41.333935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d3f92-c167-4b50-b3b3-20194d61bd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:41.334853 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d3f92-c167-4b50-b3b3-20194d61bd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:41.336444 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d3f92-c167-4b50-b3b3-20194d61bd75 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:41.350101 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1176/2363] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:41.351568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a525d5-4c07-4454-b4e8-d3295d38c427 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:41.361653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a525d5-4c07-4454-b4e8-d3295d38c427 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:41.366603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb9c5c-3b82-4b92-b672-ee73285e5442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:41.367276 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb9c5c-3b82-4b92-b672-ee73285e5442 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:41.367608 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb9c5c-3b82-4b92-b672-ee73285e5442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:41.367883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb9c5c-3b82-4b92-b672-ee73285e5442 admin admin] PATH_INFO: `/v3/projects/b818f2d4cb944937a98375b39a588262/users/2fde848bcc814e2ab7aba0fbb0609bc2/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:41.383108 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb9c5c-3b82-4b92-b672-ee73285e5442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b818f2d4cb944937a98375b39a588262, user_id=2fde848bcc814e2ab7aba0fbb0609bc2, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:41.385754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb9c5c-3b82-4b92-b672-ee73285e5442 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:41.398665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1188/2364] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:41 2022] PUT /identity/v3/projects/b818f2d4cb944937a98375b39a588262/users/2fde848bcc814e2ab7aba0fbb0609bc2/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:41.409627 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3075f6-4100-4637-a50f-257c8e699409 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:41.409921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3075f6-4100-4637-a50f-257c8e699409 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:41.410203 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3075f6-4100-4637-a50f-257c8e699409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:41.432753 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:41.441556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-8a3075f6-4100-4637-a50f-257c8e699409 None None] MFA Rules not processed for user `2fde848bcc814e2ab7aba0fbb0609bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:41.443053 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-8a3075f6-4100-4637-a50f-257c8e699409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:41.504243 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1177/2365] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:41.508644 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb9c5c-3b82-4b92-b672-ee73285e5442 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:41.569029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb9c5c-3b82-4b92-b672-ee73285e5442 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:41.573576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8acb69-2475-4443-918e-f7a404c77e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:41.574162 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8acb69-2475-4443-918e-f7a404c77e0d admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:41.574434 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8acb69-2475-4443-918e-f7a404c77e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:41.574732 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8acb69-2475-4443-918e-f7a404c77e0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:41.575359 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8acb69-2475-4443-918e-f7a404c77e0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:41.577223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8acb69-2475-4443-918e-f7a404c77e0d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:41.602553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1189/2366] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:41 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:34:41.606645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3075f6-4100-4637-a50f-257c8e699409 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:41.617794 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3075f6-4100-4637-a50f-257c8e699409 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:41.674230 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3da7c-cbe6-4ae1-a903-9e5dc0087656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:41.674860 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3da7c-cbe6-4ae1-a903-9e5dc0087656 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:41.675144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3da7c-cbe6-4ae1-a903-9e5dc0087656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:41.675415 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3da7c-cbe6-4ae1-a903-9e5dc0087656 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:41.676042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3da7c-cbe6-4ae1-a903-9e5dc0087656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:41.678440 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3da7c-cbe6-4ae1-a903-9e5dc0087656 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:41.699875 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1178/2367] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:41 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:41.703842 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8acb69-2475-4443-918e-f7a404c77e0d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:41.714479 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8acb69-2475-4443-918e-f7a404c77e0d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:41.719057 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68580ba3-74af-4ed7-a5de-0fa61e69b486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:41.719645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68580ba3-74af-4ed7-a5de-0fa61e69b486 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:41.719922 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68580ba3-74af-4ed7-a5de-0fa61e69b486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:41.720188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68580ba3-74af-4ed7-a5de-0fa61e69b486 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:41.720823 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68580ba3-74af-4ed7-a5de-0fa61e69b486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:41.722400 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68580ba3-74af-4ed7-a5de-0fa61e69b486 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:41.732659 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1190/2368] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:41.736436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3da7c-cbe6-4ae1-a903-9e5dc0087656 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:41.747802 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3da7c-cbe6-4ae1-a903-9e5dc0087656 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:41.752450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230adc3-5207-443d-adba-ce28b0bbd2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:41.753035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230adc3-5207-443d-adba-ce28b0bbd2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:41.753313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230adc3-5207-443d-adba-ce28b0bbd2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:41.753584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230adc3-5207-443d-adba-ce28b0bbd2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:41.754217 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230adc3-5207-443d-adba-ce28b0bbd2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:41.756398 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230adc3-5207-443d-adba-ce28b0bbd2d6 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:41.766301 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1179/2369] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:41.770235 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68580ba3-74af-4ed7-a5de-0fa61e69b486 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:41.780072 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68580ba3-74af-4ed7-a5de-0fa61e69b486 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:41.784649 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e4b65-a93f-4669-9d1a-1d8c69092f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:41.785297 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e4b65-a93f-4669-9d1a-1d8c69092f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:41.785574 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e4b65-a93f-4669-9d1a-1d8c69092f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:41.785842 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e4b65-a93f-4669-9d1a-1d8c69092f84 admin admin] PATH_INFO: `/v3/projects/1feac3be554040d6abc0d6c5e6cabbb5/users/5a7f8a4ae8ef46eab8ec4f44be782fbc/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:41.799804 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e4b65-a93f-4669-9d1a-1d8c69092f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1feac3be554040d6abc0d6c5e6cabbb5, user_id=5a7f8a4ae8ef46eab8ec4f44be782fbc, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:41.802923 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e4b65-a93f-4669-9d1a-1d8c69092f84 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:41.815206 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1191/2370] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:41 2022] PUT /identity/v3/projects/1feac3be554040d6abc0d6c5e6cabbb5/users/5a7f8a4ae8ef46eab8ec4f44be782fbc/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:41.825223 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648acca-98b2-4cef-a970-63c0f7b09bdd None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:41.825545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648acca-98b2-4cef-a970-63c0f7b09bdd None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:41.825822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648acca-98b2-4cef-a970-63c0f7b09bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:41.854075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-9648acca-98b2-4cef-a970-63c0f7b09bdd None None] MFA Rules not processed for user `5a7f8a4ae8ef46eab8ec4f44be782fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:41.855303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-9648acca-98b2-4cef-a970-63c0f7b09bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:41.921076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1180/2371] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:41.925648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e4b65-a93f-4669-9d1a-1d8c69092f84 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:41.967019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:41.992590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e4b65-a93f-4669-9d1a-1d8c69092f84 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:41.997366 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3d1e0-37b3-4b7f-8183-3834d88fdd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:41.997965 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3d1e0-37b3-4b7f-8183-3834d88fdd5a admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:41.998240 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3d1e0-37b3-4b7f-8183-3834d88fdd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:41.998508 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3d1e0-37b3-4b7f-8183-3834d88fdd5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:41.999175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3d1e0-37b3-4b7f-8183-3834d88fdd5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:42.001050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3d1e0-37b3-4b7f-8183-3834d88fdd5a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:42.028449 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1192/2372] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:41 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:42.032465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648acca-98b2-4cef-a970-63c0f7b09bdd None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:42.043590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648acca-98b2-4cef-a970-63c0f7b09bdd None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:42.049289 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:42.100919 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c977c-35a7-4980-938b-fdaebb70cde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:42.101525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c977c-35a7-4980-938b-fdaebb70cde8 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:42.101801 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c977c-35a7-4980-938b-fdaebb70cde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:42.102066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c977c-35a7-4980-938b-fdaebb70cde8 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:42.102732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c977c-35a7-4980-938b-fdaebb70cde8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:42.104618 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c977c-35a7-4980-938b-fdaebb70cde8 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:42.124900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1181/2373] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:42 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:34:42.128860 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3d1e0-37b3-4b7f-8183-3834d88fdd5a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:42.139547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3d1e0-37b3-4b7f-8183-3834d88fdd5a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:42.145580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e022ba0-f385-47d7-ad9d-f3bb05c20032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:42.147173 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e022ba0-f385-47d7-ad9d-f3bb05c20032 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:42.147603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e022ba0-f385-47d7-ad9d-f3bb05c20032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:42.147925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e022ba0-f385-47d7-ad9d-f3bb05c20032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:42.149143 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e022ba0-f385-47d7-ad9d-f3bb05c20032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:42.150780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e022ba0-f385-47d7-ad9d-f3bb05c20032 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:42.162398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1193/2374] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:42.168782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c977c-35a7-4980-938b-fdaebb70cde8 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:42.180777 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c977c-35a7-4980-938b-fdaebb70cde8 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:42.185623 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633852f7-16ba-4c71-9b59-bcf84b6af854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:42.186274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633852f7-16ba-4c71-9b59-bcf84b6af854 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:42.186556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633852f7-16ba-4c71-9b59-bcf84b6af854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:42.186864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633852f7-16ba-4c71-9b59-bcf84b6af854 admin admin] PATH_INFO: `/v3/projects/c4e4ecc0eaf6490d838e30e241ece93c/users/a2a945a67a0241c5bb3c4a073d3b3a50/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:42.201937 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633852f7-16ba-4c71-9b59-bcf84b6af854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e4ecc0eaf6490d838e30e241ece93c, user_id=a2a945a67a0241c5bb3c4a073d3b3a50, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:42.204584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633852f7-16ba-4c71-9b59-bcf84b6af854 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:42.218637 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1182/2375] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:42 2022] PUT /identity/v3/projects/c4e4ecc0eaf6490d838e30e241ece93c/users/a2a945a67a0241c5bb3c4a073d3b3a50/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:34:42.222564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e022ba0-f385-47d7-ad9d-f3bb05c20032 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:42.234039 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e022ba0-f385-47d7-ad9d-f3bb05c20032 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:42.292023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b2b3a-e9a8-4ef4-b74b-bd2d0aed88f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:42.292632 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b2b3a-e9a8-4ef4-b74b-bd2d0aed88f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:42.292908 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b2b3a-e9a8-4ef4-b74b-bd2d0aed88f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:42.293179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b2b3a-e9a8-4ef4-b74b-bd2d0aed88f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:42.293819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b2b3a-e9a8-4ef4-b74b-bd2d0aed88f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:42.295437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b2b3a-e9a8-4ef4-b74b-bd2d0aed88f0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:42.306114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1194/2376] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:42.310136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633852f7-16ba-4c71-9b59-bcf84b6af854 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:42.321259 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633852f7-16ba-4c71-9b59-bcf84b6af854 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:42.326049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25301e4a-ce8d-42da-9dc2-6399754ed791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:42.326816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25301e4a-ce8d-42da-9dc2-6399754ed791 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:42.327183 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25301e4a-ce8d-42da-9dc2-6399754ed791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:42.327519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25301e4a-ce8d-42da-9dc2-6399754ed791 admin admin] PATH_INFO: `/v3/projects/c4e4ecc0eaf6490d838e30e241ece93c/users/a2a945a67a0241c5bb3c4a073d3b3a50/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:42.329503 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25301e4a-ce8d-42da-9dc2-6399754ed791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e4ecc0eaf6490d838e30e241ece93c, user_id=a2a945a67a0241c5bb3c4a073d3b3a50, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:42.332147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25301e4a-ce8d-42da-9dc2-6399754ed791 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:42.343914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1183/2377] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:42 2022] PUT /identity/v3/projects/c4e4ecc0eaf6490d838e30e241ece93c/users/a2a945a67a0241c5bb3c4a073d3b3a50/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:42.353910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd83e4-0c30-4847-9776-71768187e158 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:42.354397 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd83e4-0c30-4847-9776-71768187e158 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:42.354595 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd83e4-0c30-4847-9776-71768187e158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:42.385144 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1fdd83e4-0c30-4847-9776-71768187e158 None None] MFA Rules not processed for user `a2a945a67a0241c5bb3c4a073d3b3a50`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:42.386344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1fdd83e4-0c30-4847-9776-71768187e158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:42.454728 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1195/2378] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:42.468460 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25301e4a-ce8d-42da-9dc2-6399754ed791 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:42.470312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-25301e4a-ce8d-42da-9dc2-6399754ed791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:42.528142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25301e4a-ce8d-42da-9dc2-6399754ed791 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:42.531958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f26f4-3cb3-4947-a8d0-8407dcabcf6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:42.532563 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f26f4-3cb3-4947-a8d0-8407dcabcf6f service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:42.532840 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f26f4-3cb3-4947-a8d0-8407dcabcf6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:42.533109 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f26f4-3cb3-4947-a8d0-8407dcabcf6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:42.589075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f26f4-3cb3-4947-a8d0-8407dcabcf6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:42.590671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f26f4-3cb3-4947-a8d0-8407dcabcf6f service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:42.599940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1184/2379] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:45.151337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd83e4-0c30-4847-9776-71768187e158 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:45.152775 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1fdd83e4-0c30-4847-9776-71768187e158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:45.164313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd83e4-0c30-4847-9776-71768187e158 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:45.168031 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8626556-987e-4e75-bce6-96d100fcf1e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:45.168679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8626556-987e-4e75-bce6-96d100fcf1e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:45.168956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8626556-987e-4e75-bce6-96d100fcf1e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:45.169234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8626556-987e-4e75-bce6-96d100fcf1e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:45.197808 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:45.226890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8626556-987e-4e75-bce6-96d100fcf1e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:45.228244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8626556-987e-4e75-bce6-96d100fcf1e0 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:45.236905 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1196/2380] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:45.892716 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f26f4-3cb3-4947-a8d0-8407dcabcf6f service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:45.902791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f26f4-3cb3-4947-a8d0-8407dcabcf6f service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:45.908472 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc327aa7-a796-4d1f-b2f3-251689128a44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:45.909582 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc327aa7-a796-4d1f-b2f3-251689128a44 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:45.909582 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc327aa7-a796-4d1f-b2f3-251689128a44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:45.909837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc327aa7-a796-4d1f-b2f3-251689128a44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:45.924864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc327aa7-a796-4d1f-b2f3-251689128a44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:45.926399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc327aa7-a796-4d1f-b2f3-251689128a44 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:45.950835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1185/2381] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:49.538046 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a836755-2c11-4d7c-a0cd-c402464a4e04 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:49.538524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a836755-2c11-4d7c-a0cd-c402464a4e04 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:49.538673 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a836755-2c11-4d7c-a0cd-c402464a4e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:49.557781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4a836755-2c11-4d7c-a0cd-c402464a4e04 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:49.559014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4a836755-2c11-4d7c-a0cd-c402464a4e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:49.624189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1197/2382] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 1 16:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:49.665841 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc327aa7-a796-4d1f-b2f3-251689128a44 service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:49.667351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-cc327aa7-a796-4d1f-b2f3-251689128a44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:49.672809 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:49.743042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc327aa7-a796-4d1f-b2f3-251689128a44 service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:49.748435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b07c9c-c900-4d3e-a657-1ec964de34e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:49.749038 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b07c9c-c900-4d3e-a657-1ec964de34e4 service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:49.749318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b07c9c-c900-4d3e-a657-1ec964de34e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:49.749609 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b07c9c-c900-4d3e-a657-1ec964de34e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:49.758029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b07c9c-c900-4d3e-a657-1ec964de34e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:49.759631 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b07c9c-c900-4d3e-a657-1ec964de34e4 service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:49.768971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1186/2383] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:49.946375 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a836755-2c11-4d7c-a0cd-c402464a4e04 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:49.955966 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a836755-2c11-4d7c-a0cd-c402464a4e04 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:49.960766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be4977-9fa6-4b27-9120-7961b500c7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:49.961386 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be4977-9fa6-4b27-9120-7961b500c7b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:49.961656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be4977-9fa6-4b27-9120-7961b500c7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:49.961927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be4977-9fa6-4b27-9120-7961b500c7b7 admin admin] PATH_INFO: `/v3/users/2fde848bcc814e2ab7aba0fbb0609bc2` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:49.963073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be4977-9fa6-4b27-9120-7961b500c7b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fde848bcc814e2ab7aba0fbb0609bc2)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:49.964993 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be4977-9fa6-4b27-9120-7961b500c7b7 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:50.009631 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b4be4977-9fa6-4b27-9120-7961b500c7b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fde848bcc814e2ab7aba0fbb0609bc2'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:50.010273 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b4be4977-9fa6-4b27-9120-7961b500c7b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fde848bcc814e2ab7aba0fbb0609bc2'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:50.018360 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b4be4977-9fa6-4b27-9120-7961b500c7b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fde848bcc814e2ab7aba0fbb0609bc2'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:50.030016 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b4be4977-9fa6-4b27-9120-7961b500c7b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fde848bcc814e2ab7aba0fbb0609bc2'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:50.036781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b4be4977-9fa6-4b27-9120-7961b500c7b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fde848bcc814e2ab7aba0fbb0609bc2'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:50.042858 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1198/2384] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:34:49 2022] DELETE /identity/v3/users/2fde848bcc814e2ab7aba0fbb0609bc2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:50.047924 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b3398-ca98-447f-978a-ea92d3e49b3e None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:50.048207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b3398-ca98-447f-978a-ea92d3e49b3e None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:50.048481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b3398-ca98-447f-978a-ea92d3e49b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:50.068550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-e93b3398-ca98-447f-978a-ea92d3e49b3e None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:50.069746 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e93b3398-ca98-447f-978a-ea92d3e49b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:50.132671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1187/2385] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:50.144195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be4977-9fa6-4b27-9120-7961b500c7b7 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:50.145958 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b4be4977-9fa6-4b27-9120-7961b500c7b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:50.197584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:50.213009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be4977-9fa6-4b27-9120-7961b500c7b7 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:50.217755 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dd893-6672-4e7d-9e5f-f5bebcd64921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:50.218447 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dd893-6672-4e7d-9e5f-f5bebcd64921 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:50.218819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dd893-6672-4e7d-9e5f-f5bebcd64921 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:50.219170 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dd893-6672-4e7d-9e5f-f5bebcd64921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:50.229246 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dd893-6672-4e7d-9e5f-f5bebcd64921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:50.230708 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dd893-6672-4e7d-9e5f-f5bebcd64921 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:50.240907 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1199/2386] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:50.523599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b3398-ca98-447f-978a-ea92d3e49b3e None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:50.525096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e93b3398-ca98-447f-978a-ea92d3e49b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:50.537991 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b3398-ca98-447f-978a-ea92d3e49b3e None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:50.542722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:50.543543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:50.543818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:50.544086 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb admin admin] PATH_INFO: `/v3/projects/b818f2d4cb944937a98375b39a588262` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:50.545214 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b818f2d4cb944937a98375b39a588262)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:50.547154 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:50.595808 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b818f2d4cb944937a98375b39a588262', 'request_id': 'req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:50.604295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b818f2d4cb944937a98375b39a588262', 'request_id': 'req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:50.611959 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b818f2d4cb944937a98375b39a588262', 'request_id': 'req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:50.622894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb admin admin] The token cache is being invalidate because project b818f2d4cb944937a98375b39a588262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:34:50.623196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:50.623856 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:50.628148 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1188/2387] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:34:50 2022] DELETE /identity/v3/projects/b818f2d4cb944937a98375b39a588262 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:50.629553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dd893-6672-4e7d-9e5f-f5bebcd64921 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:50.639726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dd893-6672-4e7d-9e5f-f5bebcd64921 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:50.696771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca058a-6385-49e7-8224-54c61778ba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:50.697397 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca058a-6385-49e7-8224-54c61778ba09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:50.697674 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca058a-6385-49e7-8224-54c61778ba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:50.697945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca058a-6385-49e7-8224-54c61778ba09 admin admin] PATH_INFO: `/v3/users/5a7f8a4ae8ef46eab8ec4f44be782fbc` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:50.699102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca058a-6385-49e7-8224-54c61778ba09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a7f8a4ae8ef46eab8ec4f44be782fbc)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:50.700992 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca058a-6385-49e7-8224-54c61778ba09 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:50.745667 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7fca058a-6385-49e7-8224-54c61778ba09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a7f8a4ae8ef46eab8ec4f44be782fbc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:50.746307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7fca058a-6385-49e7-8224-54c61778ba09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a7f8a4ae8ef46eab8ec4f44be782fbc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:50.753790 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7fca058a-6385-49e7-8224-54c61778ba09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a7f8a4ae8ef46eab8ec4f44be782fbc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:50.766641 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7fca058a-6385-49e7-8224-54c61778ba09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a7f8a4ae8ef46eab8ec4f44be782fbc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:50.773987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7fca058a-6385-49e7-8224-54c61778ba09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a7f8a4ae8ef46eab8ec4f44be782fbc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:50.779911 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1200/2388] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:34:50 2022] DELETE /identity/v3/users/5a7f8a4ae8ef46eab8ec4f44be782fbc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:51.132670 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:51.134177 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:51.148074 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bf0b0-bee6-4b89-aade-dcdbab90d0eb admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:51.157230 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:51.209500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:51.210135 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:51.210420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:51.210724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca admin admin] PATH_INFO: `/v3/projects/1feac3be554040d6abc0d6c5e6cabbb5` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:51.212354 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=1feac3be554040d6abc0d6c5e6cabbb5)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:51.214236 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:51.260085 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1feac3be554040d6abc0d6c5e6cabbb5', 'request_id': 'req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:51.266991 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1feac3be554040d6abc0d6c5e6cabbb5', 'request_id': 'req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:51.273084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1feac3be554040d6abc0d6c5e6cabbb5', 'request_id': 'req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:51.283246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca admin admin] The token cache is being invalidate because project 1feac3be554040d6abc0d6c5e6cabbb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:34:51.283533 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:51.284189 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:51.285657 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1189/2389] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:34:51 2022] DELETE /identity/v3/projects/1feac3be554040d6abc0d6c5e6cabbb5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:51.289647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca058a-6385-49e7-8224-54c61778ba09 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:51.291137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7fca058a-6385-49e7-8224-54c61778ba09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:51.304108 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca058a-6385-49e7-8224-54c61778ba09 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:51.361994 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf19a12-8542-4916-8589-b996a9ad4561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:51.362633 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf19a12-8542-4916-8589-b996a9ad4561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:51.362923 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf19a12-8542-4916-8589-b996a9ad4561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:51.363196 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf19a12-8542-4916-8589-b996a9ad4561 admin admin] PATH_INFO: `/v3/users/a2a945a67a0241c5bb3c4a073d3b3a50` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:51.364830 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf19a12-8542-4916-8589-b996a9ad4561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2a945a67a0241c5bb3c4a073d3b3a50)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:51.366766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf19a12-8542-4916-8589-b996a9ad4561 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:51.371576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:51.418213 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eaf19a12-8542-4916-8589-b996a9ad4561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2a945a67a0241c5bb3c4a073d3b3a50'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:51.418946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eaf19a12-8542-4916-8589-b996a9ad4561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2a945a67a0241c5bb3c4a073d3b3a50'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:51.426802 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eaf19a12-8542-4916-8589-b996a9ad4561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2a945a67a0241c5bb3c4a073d3b3a50'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:51.439377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eaf19a12-8542-4916-8589-b996a9ad4561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2a945a67a0241c5bb3c4a073d3b3a50'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:51.446526 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eaf19a12-8542-4916-8589-b996a9ad4561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2a945a67a0241c5bb3c4a073d3b3a50'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:51.452731 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1201/2390] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:34:51 2022] DELETE /identity/v3/users/a2a945a67a0241c5bb3c4a073d3b3a50 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:51.733157 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:51.734907 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:51.759934 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd19f7a-a036-4b74-8eaf-eb0dafca81ca admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:51.818295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dd374-6989-4727-a011-de160139457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:51.818963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dd374-6989-4727-a011-de160139457b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:51.819238 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dd374-6989-4727-a011-de160139457b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:51.819511 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dd374-6989-4727-a011-de160139457b admin admin] PATH_INFO: `/v3/projects/c4e4ecc0eaf6490d838e30e241ece93c` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:51.820698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dd374-6989-4727-a011-de160139457b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4e4ecc0eaf6490d838e30e241ece93c)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:51.822592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dd374-6989-4727-a011-de160139457b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:51.868104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:51.872817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ea4dd374-6989-4727-a011-de160139457b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e4ecc0eaf6490d838e30e241ece93c', 'request_id': 'req-ea4dd374-6989-4727-a011-de160139457b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:51.885216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ea4dd374-6989-4727-a011-de160139457b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e4ecc0eaf6490d838e30e241ece93c', 'request_id': 'req-ea4dd374-6989-4727-a011-de160139457b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:51.891750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ea4dd374-6989-4727-a011-de160139457b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e4ecc0eaf6490d838e30e241ece93c', 'request_id': 'req-ea4dd374-6989-4727-a011-de160139457b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:51.904094 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ea4dd374-6989-4727-a011-de160139457b admin admin] The token cache is being invalidate because project c4e4ecc0eaf6490d838e30e241ece93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:34:51.904383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ea4dd374-6989-4727-a011-de160139457b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:51.905020 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-ea4dd374-6989-4727-a011-de160139457b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:34:51.906497 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1190/2391] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:34:51 2022] DELETE /identity/v3/projects/c4e4ecc0eaf6490d838e30e241ece93c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:51.911402 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce050a8-e3cb-481e-bf3b-ad0f599ae97c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:51.911855 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce050a8-e3cb-481e-bf3b-ad0f599ae97c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:51.911942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce050a8-e3cb-481e-bf3b-ad0f599ae97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:51.931425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4ce050a8-e3cb-481e-bf3b-ad0f599ae97c None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:51.932632 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4ce050a8-e3cb-481e-bf3b-ad0f599ae97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:51.994756 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1202/2392] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:52.002429 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb74d6b-8136-4600-bdcc-f141961aae8d None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:52.002747 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb74d6b-8136-4600-bdcc-f141961aae8d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:52.003029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb74d6b-8136-4600-bdcc-f141961aae8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:52.024025 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-0eb74d6b-8136-4600-bdcc-f141961aae8d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:52.025243 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0eb74d6b-8136-4600-bdcc-f141961aae8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:52.033285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1191/2393] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:52.037685 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce050a8-e3cb-481e-bf3b-ad0f599ae97c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:52.049662 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce050a8-e3cb-481e-bf3b-ad0f599ae97c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:52.055707 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278dd30-4b1b-479d-9921-dbc80081818c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:52.056313 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278dd30-4b1b-479d-9921-dbc80081818c admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:52.056592 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278dd30-4b1b-479d-9921-dbc80081818c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:52.056863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278dd30-4b1b-479d-9921-dbc80081818c admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:52.057513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278dd30-4b1b-479d-9921-dbc80081818c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:34:52.057818 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278dd30-4b1b-479d-9921-dbc80081818c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:52.059531 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278dd30-4b1b-479d-9921-dbc80081818c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:52.072984 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1203/2394] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:34:52.077284 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb74d6b-8136-4600-bdcc-f141961aae8d None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:52.088491 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb74d6b-8136-4600-bdcc-f141961aae8d None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:52.093754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced46664-9dfe-44ce-9712-f8efa4777af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:52.094622 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced46664-9dfe-44ce-9712-f8efa4777af7 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:52.094990 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced46664-9dfe-44ce-9712-f8efa4777af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:52.095311 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced46664-9dfe-44ce-9712-f8efa4777af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:52.096580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced46664-9dfe-44ce-9712-f8efa4777af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:52.100804 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced46664-9dfe-44ce-9712-f8efa4777af7 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:52.131623 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1192/2395] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:52 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:52.135863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278dd30-4b1b-479d-9921-dbc80081818c admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:52.148698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278dd30-4b1b-479d-9921-dbc80081818c admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:52.213606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7777a68-4046-4fd2-804f-4a2160708dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:52.214271 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777a68-4046-4fd2-804f-4a2160708dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:52.214549 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777a68-4046-4fd2-804f-4a2160708dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:52.214859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777a68-4046-4fd2-804f-4a2160708dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:52.215510 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7777a68-4046-4fd2-804f-4a2160708dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:52.218001 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7777a68-4046-4fd2-804f-4a2160708dd6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:52.236607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:52.242657 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1204/2396] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:52 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:52.246879 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced46664-9dfe-44ce-9712-f8efa4777af7 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:52.258367 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced46664-9dfe-44ce-9712-f8efa4777af7 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:52.262999 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce30f9-9fb9-4783-a803-899f0ba0da5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:52.263587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce30f9-9fb9-4783-a803-899f0ba0da5d admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:52.263865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce30f9-9fb9-4783-a803-899f0ba0da5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:52.264137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce30f9-9fb9-4783-a803-899f0ba0da5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:52.264775 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce30f9-9fb9-4783-a803-899f0ba0da5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:52.266335 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce30f9-9fb9-4783-a803-899f0ba0da5d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:52.276612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1193/2397] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:52.280482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7777a68-4046-4fd2-804f-4a2160708dd6 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:52.290849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7777a68-4046-4fd2-804f-4a2160708dd6 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:52.295469 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00dd2b-b6ea-4b28-a39d-c699b973b6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:52.296052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00dd2b-b6ea-4b28-a39d-c699b973b6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:52.296328 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00dd2b-b6ea-4b28-a39d-c699b973b6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:52.296596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00dd2b-b6ea-4b28-a39d-c699b973b6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:52.297237 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00dd2b-b6ea-4b28-a39d-c699b973b6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:52.298830 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00dd2b-b6ea-4b28-a39d-c699b973b6e2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:52.308936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1205/2398] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:52.313060 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce30f9-9fb9-4783-a803-899f0ba0da5d admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:52.322856 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce30f9-9fb9-4783-a803-899f0ba0da5d admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:52.327467 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb66307-53e8-4b65-baac-fdbbacee124e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:52.328108 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb66307-53e8-4b65-baac-fdbbacee124e admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:52.328391 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb66307-53e8-4b65-baac-fdbbacee124e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:52.328663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb66307-53e8-4b65-baac-fdbbacee124e admin admin] PATH_INFO: `/v3/projects/9caf6f4175484b1d8e98b82db06054c8/users/dd01e8631dc4419bb03d2707b4841948/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:52.343592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb66307-53e8-4b65-baac-fdbbacee124e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9caf6f4175484b1d8e98b82db06054c8, user_id=dd01e8631dc4419bb03d2707b4841948, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:52.346286 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb66307-53e8-4b65-baac-fdbbacee124e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:52.359815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1194/2399] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:52 2022] PUT /identity/v3/projects/9caf6f4175484b1d8e98b82db06054c8/users/dd01e8631dc4419bb03d2707b4841948/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:52.369833 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5147f-48e9-4625-8c8c-062d77de6c10 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:52.370120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5147f-48e9-4625-8c8c-062d77de6c10 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:52.370424 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5147f-48e9-4625-8c8c-062d77de6c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:52.398185 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8af5147f-48e9-4625-8c8c-062d77de6c10 None None] MFA Rules not processed for user `dd01e8631dc4419bb03d2707b4841948`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:52.399443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8af5147f-48e9-4625-8c8c-062d77de6c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:52.462658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1206/2400] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:34:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:52.475681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb66307-53e8-4b65-baac-fdbbacee124e admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:52.477548 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2eb66307-53e8-4b65-baac-fdbbacee124e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:52.547884 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb66307-53e8-4b65-baac-fdbbacee124e admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:52.551891 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab89f56-a473-47b1-9c8f-ab7dbbb59495 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11356a5e3d041729f71515482033dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:52.552499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab89f56-a473-47b1-9c8f-ab7dbbb59495 service glance] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:52.552781 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab89f56-a473-47b1-9c8f-ab7dbbb59495 service glance] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:52.553052 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab89f56-a473-47b1-9c8f-ab7dbbb59495 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:52.562450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab89f56-a473-47b1-9c8f-ab7dbbb59495 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:52.564069 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab89f56-a473-47b1-9c8f-ab7dbbb59495 service glance] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:52.574493 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1195/2401] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:57.730500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c242a0-e8c7-4233-ad5d-b88531fcf742 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:57.731121 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c242a0-e8c7-4233-ad5d-b88531fcf742 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:57.731121 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c242a0-e8c7-4233-ad5d-b88531fcf742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:57.751232 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d5c242a0-e8c7-4233-ad5d-b88531fcf742 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:57.752555 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d5c242a0-e8c7-4233-ad5d-b88531fcf742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:57.812286 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1207/2402] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 1 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:57.842556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab89f56-a473-47b1-9c8f-ab7dbbb59495 service glance] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:57.844006 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0ab89f56-a473-47b1-9c8f-ab7dbbb59495 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:57.933435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab89f56-a473-47b1-9c8f-ab7dbbb59495 service glance] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:57.939534 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50181a8d-24c3-43ca-a4ee-057a225f6fe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:57.940310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50181a8d-24c3-43ca-a4ee-057a225f6fe2 service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:57.940656 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50181a8d-24c3-43ca-a4ee-057a225f6fe2 service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:57.940998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50181a8d-24c3-43ca-a4ee-057a225f6fe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:57.948909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:57.951985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50181a8d-24c3-43ca-a4ee-057a225f6fe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:57.954576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50181a8d-24c3-43ca-a4ee-057a225f6fe2 service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:57.967686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1196/2403] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:03.059017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ba272-9f9d-4eef-afab-8b0589c08620 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:03.059672 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ba272-9f9d-4eef-afab-8b0589c08620 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:03.059672 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ba272-9f9d-4eef-afab-8b0589c08620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:03.080309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5a6ba272-9f9d-4eef-afab-8b0589c08620 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:03.081512 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5a6ba272-9f9d-4eef-afab-8b0589c08620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:03.090022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1208/2404] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 1 16:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:03.115543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50181a8d-24c3-43ca-a4ee-057a225f6fe2 service nova] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:03.126563 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50181a8d-24c3-43ca-a4ee-057a225f6fe2 service nova] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:03.132558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1864800-79eb-45f8-8539-0b89e22181ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:03.133140 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1864800-79eb-45f8-8539-0b89e22181ab service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:03.133420 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1864800-79eb-45f8-8539-0b89e22181ab service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:03.133695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1864800-79eb-45f8-8539-0b89e22181ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:03.141992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1864800-79eb-45f8-8539-0b89e22181ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:03.143619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1864800-79eb-45f8-8539-0b89e22181ab service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:03.153463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1197/2405] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:09.191609 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ae43b-63ea-4ea1-97ef-6ce6b5e38c96 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:09.192101 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ae43b-63ea-4ea1-97ef-6ce6b5e38c96 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:09.192101 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ae43b-63ea-4ea1-97ef-6ce6b5e38c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:09.211920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-143ae43b-63ea-4ea1-97ef-6ce6b5e38c96 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:09.213116 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-143ae43b-63ea-4ea1-97ef-6ce6b5e38c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:09.220866 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1209/2406] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 1 16:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:09.243302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1864800-79eb-45f8-8539-0b89e22181ab service nova] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:09.244687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b1864800-79eb-45f8-8539-0b89e22181ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:09.259754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1864800-79eb-45f8-8539-0b89e22181ab service nova] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:09.265309 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea82fa6-b4d6-4215-b570-aeba4fb8d20b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:09.265902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea82fa6-b4d6-4215-b570-aeba4fb8d20b service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:09.266181 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea82fa6-b4d6-4215-b570-aeba4fb8d20b service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:09.266451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea82fa6-b4d6-4215-b570-aeba4fb8d20b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:09.274555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea82fa6-b4d6-4215-b570-aeba4fb8d20b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:09.276204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea82fa6-b4d6-4215-b570-aeba4fb8d20b service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:09.285366 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1198/2407] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:11.567532 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b100d-6cd2-4b91-9ea3-209deb0fee03 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:11.568000 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b100d-6cd2-4b91-9ea3-209deb0fee03 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:11.568109 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b100d-6cd2-4b91-9ea3-209deb0fee03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:11.587854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a99b100d-6cd2-4b91-9ea3-209deb0fee03 None None] MFA Rules not processed for user `cd0dbb2c140946f69c3f508b4184e998`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:11.589041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a99b100d-6cd2-4b91-9ea3-209deb0fee03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:11.652389 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1210/2408] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Sep 1 16:35:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:11.674151 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea82fa6-b4d6-4215-b570-aeba4fb8d20b service nova] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:11.675862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-9ea82fa6-b4d6-4215-b570-aeba4fb8d20b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:11.750356 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea82fa6-b4d6-4215-b570-aeba4fb8d20b service nova] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:11.755976 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba75b4a-55a0-4686-855e-56ee03fc3950 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f7afa63815643f580c91df4e4c3bafc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:11.756586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba75b4a-55a0-4686-855e-56ee03fc3950 service swift] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:11.756866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba75b4a-55a0-4686-855e-56ee03fc3950 service swift] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:11.757139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba75b4a-55a0-4686-855e-56ee03fc3950 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:11.765236 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba75b4a-55a0-4686-855e-56ee03fc3950 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:11.766846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba75b4a-55a0-4686-855e-56ee03fc3950 service swift] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:11.774907 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1199/2409] 10.222.0.71 () {60 vars in 1384 bytes} [Thu Sep 1 16:35:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:35:13.677765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b100d-6cd2-4b91-9ea3-209deb0fee03 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:13.679298 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a99b100d-6cd2-4b91-9ea3-209deb0fee03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:13.699079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:13.755957 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b100d-6cd2-4b91-9ea3-209deb0fee03 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:13.760464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d637d-a7a2-46f1-947d-9fa75c06febd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:13.761262 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d637d-a7a2-46f1-947d-9fa75c06febd service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:13.761548 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d637d-a7a2-46f1-947d-9fa75c06febd service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:13.761823 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d637d-a7a2-46f1-947d-9fa75c06febd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:13.763785 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-050d637d-a7a2-46f1-947d-9fa75c06febd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:13.851275 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d637d-a7a2-46f1-947d-9fa75c06febd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:13.853007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d637d-a7a2-46f1-947d-9fa75c06febd service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:13.864572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1211/2410] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:18.749711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a929e-ec30-4f63-baec-ef3b1fb7b68c None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:18.750726 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a929e-ec30-4f63-baec-ef3b1fb7b68c None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:18.751170 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a929e-ec30-4f63-baec-ef3b1fb7b68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:18.797091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-5c9a929e-ec30-4f63-baec-ef3b1fb7b68c None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:18.798791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5c9a929e-ec30-4f63-baec-ef3b1fb7b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:18.823697 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1200/2411] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 1 16:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:18.870395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d637d-a7a2-46f1-947d-9fa75c06febd service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:18.889169 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d637d-a7a2-46f1-947d-9fa75c06febd service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:18.904768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa74ed2-5946-4898-8caf-fae0620727b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:18.905669 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa74ed2-5946-4898-8caf-fae0620727b1 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:18.906102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa74ed2-5946-4898-8caf-fae0620727b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:18.906537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa74ed2-5946-4898-8caf-fae0620727b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:18.920623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa74ed2-5946-4898-8caf-fae0620727b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:18.922561 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa74ed2-5946-4898-8caf-fae0620727b1 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:18.944828 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1212/2412] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:22.695850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4a73d-adc2-4514-822b-8eedf69b06f1 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:22.696538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4a73d-adc2-4514-822b-8eedf69b06f1 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:22.696538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4a73d-adc2-4514-822b-8eedf69b06f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:22.853543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-48e4a73d-adc2-4514-822b-8eedf69b06f1 None None] MFA Rules not processed for user `08d87dbdb5e8475ebee33fd65e62b3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:22.855636 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-48e4a73d-adc2-4514-822b-8eedf69b06f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:22.928904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1201/2413] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:35:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:24.080732 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aede5c4-a6f8-400f-a036-7b545099792d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:24.080732 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aede5c4-a6f8-400f-a036-7b545099792d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:24.080732 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aede5c4-a6f8-400f-a036-7b545099792d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:24.109319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4aede5c4-a6f8-400f-a036-7b545099792d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:24.111027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4aede5c4-a6f8-400f-a036-7b545099792d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:24.121034 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1213/2414] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 1 16:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:24.146987 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4a73d-adc2-4514-822b-8eedf69b06f1 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:24.169458 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4a73d-adc2-4514-822b-8eedf69b06f1 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:24.178805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a820e33-f3e9-479b-b278-d11f5926266a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:24.179904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a820e33-f3e9-479b-b278-d11f5926266a service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:24.180638 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a820e33-f3e9-479b-b278-d11f5926266a service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:24.181379 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a820e33-f3e9-479b-b278-d11f5926266a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:24.197367 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a820e33-f3e9-479b-b278-d11f5926266a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:24.200492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a820e33-f3e9-479b-b278-d11f5926266a service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:24.222413 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1202/2415] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:35:29.340179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aede5c4-a6f8-400f-a036-7b545099792d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:29.357611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aede5c4-a6f8-400f-a036-7b545099792d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:29.372602 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313c976-9f5d-4da7-bc32-668bcd8b0052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:29.375196 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313c976-9f5d-4da7-bc32-668bcd8b0052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:29.375730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313c976-9f5d-4da7-bc32-668bcd8b0052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:29.376254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313c976-9f5d-4da7-bc32-668bcd8b0052 admin admin] PATH_INFO: `/v3/users/dd01e8631dc4419bb03d2707b4841948` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:29.378584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313c976-9f5d-4da7-bc32-668bcd8b0052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd01e8631dc4419bb03d2707b4841948)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:29.385071 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313c976-9f5d-4da7-bc32-668bcd8b0052 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:29.507332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f313c976-9f5d-4da7-bc32-668bcd8b0052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd01e8631dc4419bb03d2707b4841948'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:29.509618 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f313c976-9f5d-4da7-bc32-668bcd8b0052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd01e8631dc4419bb03d2707b4841948'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:29.522258 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f313c976-9f5d-4da7-bc32-668bcd8b0052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd01e8631dc4419bb03d2707b4841948'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:29.538414 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f313c976-9f5d-4da7-bc32-668bcd8b0052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd01e8631dc4419bb03d2707b4841948'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:29.547994 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f313c976-9f5d-4da7-bc32-668bcd8b0052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd01e8631dc4419bb03d2707b4841948'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:29.556788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1214/2416] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:29 2022] DELETE /identity/v3/users/dd01e8631dc4419bb03d2707b4841948 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:29.560992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31856e-4580-45c0-b253-3e1d6de340a7 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:29.563338 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31856e-4580-45c0-b253-3e1d6de340a7 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:29.565012 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31856e-4580-45c0-b253-3e1d6de340a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:29.572750 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=81 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:29.586405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-4c31856e-4580-45c0-b253-3e1d6de340a7 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:29.587941 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4c31856e-4580-45c0-b253-3e1d6de340a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:29.656753 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1203/2417] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:35:29.667207 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313c976-9f5d-4da7-bc32-668bcd8b0052 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:29.668634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f313c976-9f5d-4da7-bc32-668bcd8b0052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:29.687534 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:29.770676 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313c976-9f5d-4da7-bc32-668bcd8b0052 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:29.778012 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10554c9-441c-4241-bdd9-b13a1860ef40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:29.785163 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10554c9-441c-4241-bdd9-b13a1860ef40 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:29.786064 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10554c9-441c-4241-bdd9-b13a1860ef40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:29.786064 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10554c9-441c-4241-bdd9-b13a1860ef40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:29.801328 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10554c9-441c-4241-bdd9-b13a1860ef40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:29.803314 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10554c9-441c-4241-bdd9-b13a1860ef40 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:29.819504 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1215/2418] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:30.530150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31856e-4580-45c0-b253-3e1d6de340a7 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:30.531723 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4c31856e-4580-45c0-b253-3e1d6de340a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:30.546450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31856e-4580-45c0-b253-3e1d6de340a7 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:30.560475 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:30.561139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:30.562057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:30.562331 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7 admin admin] PATH_INFO: `/v3/projects/9caf6f4175484b1d8e98b82db06054c8` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:30.563825 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9caf6f4175484b1d8e98b82db06054c8)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:30.565742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:30.644223 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9caf6f4175484b1d8e98b82db06054c8', 'request_id': 'req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:30.655639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9caf6f4175484b1d8e98b82db06054c8', 'request_id': 'req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:30.667840 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9caf6f4175484b1d8e98b82db06054c8', 'request_id': 'req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:30.684439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7 admin admin] The token cache is being invalidate because project 9caf6f4175484b1d8e98b82db06054c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:30.684893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:30.685753 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:30.687674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1204/2419] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:30 2022] DELETE /identity/v3/projects/9caf6f4175484b1d8e98b82db06054c8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:33.308958 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049409e-a592-466f-861e-d91721b12477 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:33.309500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049409e-a592-466f-861e-d91721b12477 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:33.309914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049409e-a592-466f-861e-d91721b12477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:33.334693 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4049409e-a592-466f-861e-d91721b12477 None None] MFA Rules not processed for user `cd0dbb2c140946f69c3f508b4184e998`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:33.335923 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4049409e-a592-466f-861e-d91721b12477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:33.392693 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1216/2420] 10.222.0.71 () {58 vars in 967 bytes} [Thu Sep 1 16:35:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:33.405810 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:33.407208 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:33.475695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d0c8d-ea1b-4a06-a81e-33a3d5707ba7 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:33.480660 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792e28a-4194-4407-a119-cd5cfeffc0f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f7afa63815643f580c91df4e4c3bafc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:33.481269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792e28a-4194-4407-a119-cd5cfeffc0f2 service swift] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:33.481548 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792e28a-4194-4407-a119-cd5cfeffc0f2 service swift] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:33.481820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792e28a-4194-4407-a119-cd5cfeffc0f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:33.490644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792e28a-4194-4407-a119-cd5cfeffc0f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:33.492227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792e28a-4194-4407-a119-cd5cfeffc0f2 service swift] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:33.500467 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1205/2421] 10.222.0.71 () {60 vars in 1384 bytes} [Thu Sep 1 16:35:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:35:35.432152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049409e-a592-466f-861e-d91721b12477 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:35.433657 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4049409e-a592-466f-861e-d91721b12477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:35.500842 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049409e-a592-466f-861e-d91721b12477 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.506025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc748840-4e3d-4772-852e-5d0d56811a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.506633 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc748840-4e3d-4772-852e-5d0d56811a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.506910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc748840-4e3d-4772-852e-5d0d56811a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.507179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc748840-4e3d-4772-852e-5d0d56811a73 admin admin] PATH_INFO: `/v3/users/2795b294fed84c8cac4d3f481a3eb24d` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.508307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc748840-4e3d-4772-852e-5d0d56811a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2795b294fed84c8cac4d3f481a3eb24d)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:35.510194 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc748840-4e3d-4772-852e-5d0d56811a73 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:35.554016 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cc748840-4e3d-4772-852e-5d0d56811a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2795b294fed84c8cac4d3f481a3eb24d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:35.554683 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cc748840-4e3d-4772-852e-5d0d56811a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2795b294fed84c8cac4d3f481a3eb24d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:35.561725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cc748840-4e3d-4772-852e-5d0d56811a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2795b294fed84c8cac4d3f481a3eb24d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:35.569311 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:35.575744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cc748840-4e3d-4772-852e-5d0d56811a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2795b294fed84c8cac4d3f481a3eb24d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:35.583271 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cc748840-4e3d-4772-852e-5d0d56811a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2795b294fed84c8cac4d3f481a3eb24d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:35.589756 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1217/2422] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:35 2022] DELETE /identity/v3/users/2795b294fed84c8cac4d3f481a3eb24d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:35.803484 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792e28a-4194-4407-a119-cd5cfeffc0f2 service swift] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:35.826858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792e28a-4194-4407-a119-cd5cfeffc0f2 service swift] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.841999 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:35.888949 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440ec92-337c-4fc9-9cbf-d2bf4f1c24ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.889729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440ec92-337c-4fc9-9cbf-d2bf4f1c24ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.890076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440ec92-337c-4fc9-9cbf-d2bf4f1c24ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.890418 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440ec92-337c-4fc9-9cbf-d2bf4f1c24ec admin admin] PATH_INFO: `/v3/projects/0202be007aba4557972d975509216bc1` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.892365 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440ec92-337c-4fc9-9cbf-d2bf4f1c24ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0202be007aba4557972d975509216bc1)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:35.894318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440ec92-337c-4fc9-9cbf-d2bf4f1c24ec admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:35.942809 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-8440ec92-337c-4fc9-9cbf-d2bf4f1c24ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0202be007aba4557972d975509216bc1', 'request_id': 'req-8440ec92-337c-4fc9-9cbf-d2bf4f1c24ec'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:35.951659 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-8440ec92-337c-4fc9-9cbf-d2bf4f1c24ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0202be007aba4557972d975509216bc1', 'request_id': 'req-8440ec92-337c-4fc9-9cbf-d2bf4f1c24ec'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:35.958723 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-8440ec92-337c-4fc9-9cbf-d2bf4f1c24ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0202be007aba4557972d975509216bc1', 'request_id': 'req-8440ec92-337c-4fc9-9cbf-d2bf4f1c24ec'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:35.969095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-8440ec92-337c-4fc9-9cbf-d2bf4f1c24ec admin admin] The token cache is being invalidate because project 0202be007aba4557972d975509216bc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:35.969379 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-8440ec92-337c-4fc9-9cbf-d2bf4f1c24ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:35.970023 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-8440ec92-337c-4fc9-9cbf-d2bf4f1c24ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:35.976345 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3f668-be5b-49df-8095-37a1b5d0abb9 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.976636 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3f668-be5b-49df-8095-37a1b5d0abb9 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.976944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3f668-be5b-49df-8095-37a1b5d0abb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.978680 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1206/2423] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:35 2022] DELETE /identity/v3/projects/0202be007aba4557972d975509216bc1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:35.997217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-76c3f668-be5b-49df-8095-37a1b5d0abb9 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:35.998441 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-76c3f668-be5b-49df-8095-37a1b5d0abb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:36.056369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1218/2424] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:35:36.065069 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803a978-9a5c-44bc-b0b8-f034370d7dbb None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.065357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803a978-9a5c-44bc-b0b8-f034370d7dbb None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.065632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803a978-9a5c-44bc-b0b8-f034370d7dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.086379 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-0803a978-9a5c-44bc-b0b8-f034370d7dbb None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:36.087616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0803a978-9a5c-44bc-b0b8-f034370d7dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:36.095565 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1207/2425] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:36.100027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3f668-be5b-49df-8095-37a1b5d0abb9 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.109454 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3f668-be5b-49df-8095-37a1b5d0abb9 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.113894 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3e27b-dcd2-4193-901f-51fa4f97e09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.114478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3e27b-dcd2-4193-901f-51fa4f97e09b admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.114808 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3e27b-dcd2-4193-901f-51fa4f97e09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.115079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3e27b-dcd2-4193-901f-51fa4f97e09b admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.115728 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3e27b-dcd2-4193-901f-51fa4f97e09b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:36.116016 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3e27b-dcd2-4193-901f-51fa4f97e09b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.117572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3e27b-dcd2-4193-901f-51fa4f97e09b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.128668 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1219/2426] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:36.133492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803a978-9a5c-44bc-b0b8-f034370d7dbb None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.142471 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803a978-9a5c-44bc-b0b8-f034370d7dbb None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.147690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f5a72-4c21-4716-91db-8ec45c18b4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.148262 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f5a72-4c21-4716-91db-8ec45c18b4ed admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.148540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f5a72-4c21-4716-91db-8ec45c18b4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.148809 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f5a72-4c21-4716-91db-8ec45c18b4ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.149426 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f5a72-4c21-4716-91db-8ec45c18b4ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.151333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f5a72-4c21-4716-91db-8ec45c18b4ed admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.180866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1208/2427] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:36 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:36.184962 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3e27b-dcd2-4193-901f-51fa4f97e09b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.195801 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3e27b-dcd2-4193-901f-51fa4f97e09b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.252608 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bad30-cc06-4f7e-b00a-7a8c9b6d975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.253214 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bad30-cc06-4f7e-b00a-7a8c9b6d975c admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.253490 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bad30-cc06-4f7e-b00a-7a8c9b6d975c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.253795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bad30-cc06-4f7e-b00a-7a8c9b6d975c admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.254469 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bad30-cc06-4f7e-b00a-7a8c9b6d975c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.256395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bad30-cc06-4f7e-b00a-7a8c9b6d975c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.281007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1220/2428] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:36 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:36.282327 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f5a72-4c21-4716-91db-8ec45c18b4ed admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.293224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f5a72-4c21-4716-91db-8ec45c18b4ed admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.297744 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87148470-d0f7-48c7-86be-ed7f05157da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.298333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148470-d0f7-48c7-86be-ed7f05157da4 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.298608 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148470-d0f7-48c7-86be-ed7f05157da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.298902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148470-d0f7-48c7-86be-ed7f05157da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.299540 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87148470-d0f7-48c7-86be-ed7f05157da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.301645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87148470-d0f7-48c7-86be-ed7f05157da4 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.311453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1209/2429] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:36.315427 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bad30-cc06-4f7e-b00a-7a8c9b6d975c admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.325737 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bad30-cc06-4f7e-b00a-7a8c9b6d975c admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.330253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81984993-c295-4bc4-a59f-c1e4fcd861ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.330876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81984993-c295-4bc4-a59f-c1e4fcd861ec admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.331152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81984993-c295-4bc4-a59f-c1e4fcd861ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.331419 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81984993-c295-4bc4-a59f-c1e4fcd861ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.332107 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81984993-c295-4bc4-a59f-c1e4fcd861ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.333922 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81984993-c295-4bc4-a59f-c1e4fcd861ec admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.344231 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1221/2430] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:36.348271 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87148470-d0f7-48c7-86be-ed7f05157da4 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.357994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87148470-d0f7-48c7-86be-ed7f05157da4 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.362817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f52abe-33a7-4802-83d7-46809f105708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.363979 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f52abe-33a7-4802-83d7-46809f105708 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.364560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f52abe-33a7-4802-83d7-46809f105708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.365125 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f52abe-33a7-4802-83d7-46809f105708 admin admin] PATH_INFO: `/v3/projects/e8c4ee548fa647caa212eb9dc8058318/users/e3a4e92cbdcd433e9057264b9af94fc0/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.381878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f52abe-33a7-4802-83d7-46809f105708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c4ee548fa647caa212eb9dc8058318, user_id=e3a4e92cbdcd433e9057264b9af94fc0, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.384516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f52abe-33a7-4802-83d7-46809f105708 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.397286 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1210/2431] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:36 2022] PUT /identity/v3/projects/e8c4ee548fa647caa212eb9dc8058318/users/e3a4e92cbdcd433e9057264b9af94fc0/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:36.407972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616fc73-5cf9-4805-a8cd-bd3eea677512 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.408287 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616fc73-5cf9-4805-a8cd-bd3eea677512 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.408563 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616fc73-5cf9-4805-a8cd-bd3eea677512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.437036 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7616fc73-5cf9-4805-a8cd-bd3eea677512 None None] MFA Rules not processed for user `e3a4e92cbdcd433e9057264b9af94fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:36.438305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7616fc73-5cf9-4805-a8cd-bd3eea677512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:36.471757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:36.504852 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1222/2432] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:35:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:35:36.517771 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f52abe-33a7-4802-83d7-46809f105708 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.520549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-51f52abe-33a7-4802-83d7-46809f105708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:36.566793 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:36.579063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f52abe-33a7-4802-83d7-46809f105708 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.583506 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41912ef5-4c62-4838-b28f-5ba66fb93f13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.584101 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41912ef5-4c62-4838-b28f-5ba66fb93f13 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.584378 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41912ef5-4c62-4838-b28f-5ba66fb93f13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.584648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41912ef5-4c62-4838-b28f-5ba66fb93f13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.592727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41912ef5-4c62-4838-b28f-5ba66fb93f13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.594134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41912ef5-4c62-4838-b28f-5ba66fb93f13 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.603494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1211/2433] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:37.979387 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235f114-53d4-46dd-a42d-377d51a170c8 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.979888 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235f114-53d4-46dd-a42d-377d51a170c8 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.979988 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235f114-53d4-46dd-a42d-377d51a170c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.998989 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-c235f114-53d4-46dd-a42d-377d51a170c8 None None] MFA Rules not processed for user `e3a4e92cbdcd433e9057264b9af94fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:38.000262 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c235f114-53d4-46dd-a42d-377d51a170c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:38.007180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1223/2434] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:35:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:41.464711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41912ef5-4c62-4838-b28f-5ba66fb93f13 service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:41.466768 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-41912ef5-4c62-4838-b28f-5ba66fb93f13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:41.547567 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41912ef5-4c62-4838-b28f-5ba66fb93f13 service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:41.552597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90cf7c-777f-4feb-8695-4b527b2be21d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae8db0856ed44088f0bd3cb93701de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:41.553196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90cf7c-777f-4feb-8695-4b527b2be21d service placement] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:41.553471 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90cf7c-777f-4feb-8695-4b527b2be21d service placement] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:41.553742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90cf7c-777f-4feb-8695-4b527b2be21d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:41.555491 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-cc90cf7c-777f-4feb-8695-4b527b2be21d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:41.567661 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90cf7c-777f-4feb-8695-4b527b2be21d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:41.570982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90cf7c-777f-4feb-8695-4b527b2be21d service placement] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:41.583854 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1212/2435] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:47.993610 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=14 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:51.576360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=39 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:52.622304 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f587a55-4e0b-440a-9c81-00e1ce91647e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:52.622810 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f587a55-4e0b-440a-9c81-00e1ce91647e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:52.622895 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f587a55-4e0b-440a-9c81-00e1ce91647e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:52.643965 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5f587a55-4e0b-440a-9c81-00e1ce91647e None None] MFA Rules not processed for user `f8d30ea9f0374b28bdfb50c567d96d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:52.645157 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5f587a55-4e0b-440a-9c81-00e1ce91647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:52.698593 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1224/2436] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:35:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:02.691979 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=25 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:09.956480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74ed82-1f2c-4efc-9792-29d3e01af4be None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:09.957018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74ed82-1f2c-4efc-9792-29d3e01af4be None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:09.957177 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74ed82-1f2c-4efc-9792-29d3e01af4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:09.977370 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-ef74ed82-1f2c-4efc-9792-29d3e01af4be None None] MFA Rules not processed for user `cd0dbb2c140946f69c3f508b4184e998`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:09.978701 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ef74ed82-1f2c-4efc-9792-29d3e01af4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:10.035644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1213/2437] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Sep 1 16:36:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:10.047587 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f587a55-4e0b-440a-9c81-00e1ce91647e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:10.049056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5f587a55-4e0b-440a-9c81-00e1ce91647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:10.117461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f587a55-4e0b-440a-9c81-00e1ce91647e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:10.122356 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5263f1-386c-4142-bdcc-d6a46e34c0a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f7afa63815643f580c91df4e4c3bafc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:10.122984 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5263f1-386c-4142-bdcc-d6a46e34c0a6 service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:10.123260 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5263f1-386c-4142-bdcc-d6a46e34c0a6 service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:10.123526 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5263f1-386c-4142-bdcc-d6a46e34c0a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:10.131274 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5263f1-386c-4142-bdcc-d6a46e34c0a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:10.132825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5263f1-386c-4142-bdcc-d6a46e34c0a6 service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:10.140585 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1225/2438] 10.222.0.71 () {60 vars in 1384 bytes} [Thu Sep 1 16:36:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:36:10.678666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0d77b-5cfa-4583-bc7c-6d2d9be52119 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:10.678951 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0d77b-5cfa-4583-bc7c-6d2d9be52119 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:10.679268 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0d77b-5cfa-4583-bc7c-6d2d9be52119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:10.699073 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-15d0d77b-5cfa-4583-bc7c-6d2d9be52119 None None] MFA Rules not processed for user `cd0dbb2c140946f69c3f508b4184e998`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:10.700265 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-15d0d77b-5cfa-4583-bc7c-6d2d9be52119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:10.707663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1214/2439] 10.222.0.71 () {58 vars in 967 bytes} [Thu Sep 1 16:36:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:10.720172 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5263f1-386c-4142-bdcc-d6a46e34c0a6 service swift] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:10.731470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5263f1-386c-4142-bdcc-d6a46e34c0a6 service swift] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:10.736979 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa280c-de54-42fb-abcf-60ac1b8022c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f7afa63815643f580c91df4e4c3bafc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:10.737566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa280c-de54-42fb-abcf-60ac1b8022c9 service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:10.737841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa280c-de54-42fb-abcf-60ac1b8022c9 service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:10.738109 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa280c-de54-42fb-abcf-60ac1b8022c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:10.746438 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa280c-de54-42fb-abcf-60ac1b8022c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:10.748023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa280c-de54-42fb-abcf-60ac1b8022c9 service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:10.756968 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1226/2440] 10.222.0.71 () {60 vars in 1384 bytes} [Thu Sep 1 16:36:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:36:10.988085 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348766-d414-498f-81db-7c20b13d1a3d None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:10.988588 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348766-d414-498f-81db-7c20b13d1a3d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:10.988694 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348766-d414-498f-81db-7c20b13d1a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:11.010294 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-09348766-d414-498f-81db-7c20b13d1a3d None None] MFA Rules not processed for user `cd0dbb2c140946f69c3f508b4184e998`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:11.011533 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-09348766-d414-498f-81db-7c20b13d1a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:11.020476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1215/2441] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Sep 1 16:36:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:11.033105 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa280c-de54-42fb-abcf-60ac1b8022c9 service swift] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:11.044143 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa280c-de54-42fb-abcf-60ac1b8022c9 service swift] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:11.049102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726fb8c-ed2a-4700-a5a3-658a00a7777c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f7afa63815643f580c91df4e4c3bafc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:11.049685 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726fb8c-ed2a-4700-a5a3-658a00a7777c service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:11.049950 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726fb8c-ed2a-4700-a5a3-658a00a7777c service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:11.050216 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726fb8c-ed2a-4700-a5a3-658a00a7777c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:11.064278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726fb8c-ed2a-4700-a5a3-658a00a7777c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:11.066971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726fb8c-ed2a-4700-a5a3-658a00a7777c service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:11.074997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1227/2442] 10.222.0.71 () {60 vars in 1384 bytes} [Thu Sep 1 16:36:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:36:11.411887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70235e40-cf24-4bdd-ba1d-1e74ff2f2b3f None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:11.412177 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70235e40-cf24-4bdd-ba1d-1e74ff2f2b3f None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:11.412452 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70235e40-cf24-4bdd-ba1d-1e74ff2f2b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:11.431993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-70235e40-cf24-4bdd-ba1d-1e74ff2f2b3f None None] MFA Rules not processed for user `cd0dbb2c140946f69c3f508b4184e998`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:11.433102 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-70235e40-cf24-4bdd-ba1d-1e74ff2f2b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:11.440739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1216/2443] 10.222.0.71 () {58 vars in 967 bytes} [Thu Sep 1 16:36:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:11.461824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726fb8c-ed2a-4700-a5a3-658a00a7777c service swift] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:11.472131 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726fb8c-ed2a-4700-a5a3-658a00a7777c service swift] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:11.477256 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92005ee7-ceeb-4f55-bfb4-bb463dbc25c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f7afa63815643f580c91df4e4c3bafc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:11.477695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92005ee7-ceeb-4f55-bfb4-bb463dbc25c4 service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:11.477977 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92005ee7-ceeb-4f55-bfb4-bb463dbc25c4 service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:11.478248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92005ee7-ceeb-4f55-bfb4-bb463dbc25c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:11.486963 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92005ee7-ceeb-4f55-bfb4-bb463dbc25c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:11.488518 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92005ee7-ceeb-4f55-bfb4-bb463dbc25c4 service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:11.496616 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1228/2444] 10.222.0.71 () {60 vars in 1384 bytes} [Thu Sep 1 16:36:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:36:12.982863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef539eb5-c05d-4709-b2a9-8ad6dc25d880 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:12.983393 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef539eb5-c05d-4709-b2a9-8ad6dc25d880 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:12.983393 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef539eb5-c05d-4709-b2a9-8ad6dc25d880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:13.003783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-ef539eb5-c05d-4709-b2a9-8ad6dc25d880 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:13.004994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ef539eb5-c05d-4709-b2a9-8ad6dc25d880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:13.069298 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1217/2445] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 1 16:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:13.095732 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92005ee7-ceeb-4f55-bfb4-bb463dbc25c4 service swift] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:13.097194 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-92005ee7-ceeb-4f55-bfb4-bb463dbc25c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:13.175434 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92005ee7-ceeb-4f55-bfb4-bb463dbc25c4 service swift] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:13.181516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d984d-dc06-470e-8c6f-ffc4cd4f0b2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:13.182140 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d984d-dc06-470e-8c6f-ffc4cd4f0b2e service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:13.182418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d984d-dc06-470e-8c6f-ffc4cd4f0b2e service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:13.182729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d984d-dc06-470e-8c6f-ffc4cd4f0b2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:13.192209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d984d-dc06-470e-8c6f-ffc4cd4f0b2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:13.193841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d984d-dc06-470e-8c6f-ffc4cd4f0b2e service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:13.203643 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1229/2446] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:13.591255 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef539eb5-c05d-4709-b2a9-8ad6dc25d880 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:13.601034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef539eb5-c05d-4709-b2a9-8ad6dc25d880 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:13.605370 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87159c67-da87-418d-8cd2-14f8fc461c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:13.605979 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87159c67-da87-418d-8cd2-14f8fc461c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:13.606252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87159c67-da87-418d-8cd2-14f8fc461c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:13.606518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87159c67-da87-418d-8cd2-14f8fc461c38 admin admin] PATH_INFO: `/v3/users/e3a4e92cbdcd433e9057264b9af94fc0` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:13.607652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87159c67-da87-418d-8cd2-14f8fc461c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a4e92cbdcd433e9057264b9af94fc0)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:13.609526 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87159c67-da87-418d-8cd2-14f8fc461c38 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:13.654958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-87159c67-da87-418d-8cd2-14f8fc461c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a4e92cbdcd433e9057264b9af94fc0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:13.655613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-87159c67-da87-418d-8cd2-14f8fc461c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a4e92cbdcd433e9057264b9af94fc0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:13.668260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-87159c67-da87-418d-8cd2-14f8fc461c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a4e92cbdcd433e9057264b9af94fc0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:13.675932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-87159c67-da87-418d-8cd2-14f8fc461c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a4e92cbdcd433e9057264b9af94fc0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:13.682901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-87159c67-da87-418d-8cd2-14f8fc461c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a4e92cbdcd433e9057264b9af94fc0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:13.684318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:13.689818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1218/2447] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:13 2022] DELETE /identity/v3/users/e3a4e92cbdcd433e9057264b9af94fc0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:13.694312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce23666-557e-42d1-a9e1-e4a727481616 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:13.694597 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce23666-557e-42d1-a9e1-e4a727481616 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:13.694897 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce23666-557e-42d1-a9e1-e4a727481616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:13.714422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2ce23666-557e-42d1-a9e1-e4a727481616 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:13.715634 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2ce23666-557e-42d1-a9e1-e4a727481616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:13.745269 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:13.773383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1230/2448] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:13.783917 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87159c67-da87-418d-8cd2-14f8fc461c38 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:13.785626 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-87159c67-da87-418d-8cd2-14f8fc461c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:13.843743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87159c67-da87-418d-8cd2-14f8fc461c38 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:13.848228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55831de5-25fa-474f-b724-4262842b2ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:13.848836 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55831de5-25fa-474f-b724-4262842b2ecb service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:13.849119 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55831de5-25fa-474f-b724-4262842b2ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:13.849395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55831de5-25fa-474f-b724-4262842b2ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:13.858473 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55831de5-25fa-474f-b724-4262842b2ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:13.859924 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55831de5-25fa-474f-b724-4262842b2ecb service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:13.869189 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1219/2449] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:14.034376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce23666-557e-42d1-a9e1-e4a727481616 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:14.035842 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2ce23666-557e-42d1-a9e1-e4a727481616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:14.047754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce23666-557e-42d1-a9e1-e4a727481616 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:14.052811 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e687b7-75cc-45a6-b670-500d3db8f437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:14.053455 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e687b7-75cc-45a6-b670-500d3db8f437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:14.053723 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e687b7-75cc-45a6-b670-500d3db8f437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:14.053998 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e687b7-75cc-45a6-b670-500d3db8f437 admin admin] PATH_INFO: `/v3/projects/e8c4ee548fa647caa212eb9dc8058318` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:14.055162 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e687b7-75cc-45a6-b670-500d3db8f437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8c4ee548fa647caa212eb9dc8058318)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:14.057058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e687b7-75cc-45a6-b670-500d3db8f437 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:14.105004 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-22e687b7-75cc-45a6-b670-500d3db8f437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8c4ee548fa647caa212eb9dc8058318', 'request_id': 'req-22e687b7-75cc-45a6-b670-500d3db8f437'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:14.111142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-22e687b7-75cc-45a6-b670-500d3db8f437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8c4ee548fa647caa212eb9dc8058318', 'request_id': 'req-22e687b7-75cc-45a6-b670-500d3db8f437'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:14.116841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-22e687b7-75cc-45a6-b670-500d3db8f437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8c4ee548fa647caa212eb9dc8058318', 'request_id': 'req-22e687b7-75cc-45a6-b670-500d3db8f437'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:14.128691 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-22e687b7-75cc-45a6-b670-500d3db8f437 admin admin] The token cache is being invalidate because project e8c4ee548fa647caa212eb9dc8058318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:14.128978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-22e687b7-75cc-45a6-b670-500d3db8f437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:14.129599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-22e687b7-75cc-45a6-b670-500d3db8f437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:14.131123 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1231/2450] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:14 2022] DELETE /identity/v3/projects/e8c4ee548fa647caa212eb9dc8058318 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:17.423457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f2e2-0ce6-43c0-8f47-8c5c7d51214a None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:17.424425 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f2e2-0ce6-43c0-8f47-8c5c7d51214a None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:17.424583 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f2e2-0ce6-43c0-8f47-8c5c7d51214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:17.444483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-0bf4f2e2-0ce6-43c0-8f47-8c5c7d51214a None None] MFA Rules not processed for user `cd0dbb2c140946f69c3f508b4184e998`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:17.445975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0bf4f2e2-0ce6-43c0-8f47-8c5c7d51214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:17.502781 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1220/2451] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Sep 1 16:36:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:17.514889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e687b7-75cc-45a6-b670-500d3db8f437 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:17.516441 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-22e687b7-75cc-45a6-b670-500d3db8f437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:17.585210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e687b7-75cc-45a6-b670-500d3db8f437 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:17.590135 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b1034-54e3-44ff-8249-c81b83204a5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f7afa63815643f580c91df4e4c3bafc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:17.590765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b1034-54e3-44ff-8249-c81b83204a5a service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:17.591041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b1034-54e3-44ff-8249-c81b83204a5a service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:17.591308 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b1034-54e3-44ff-8249-c81b83204a5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:17.599193 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b1034-54e3-44ff-8249-c81b83204a5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:17.600763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b1034-54e3-44ff-8249-c81b83204a5a service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:17.609371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1232/2452] 10.222.0.71 () {60 vars in 1384 bytes} [Thu Sep 1 16:36:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:36:18.306674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af803eb3-a968-4adc-91e2-e58af28f19a7 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:18.306989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af803eb3-a968-4adc-91e2-e58af28f19a7 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:18.307262 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af803eb3-a968-4adc-91e2-e58af28f19a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:18.328644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-af803eb3-a968-4adc-91e2-e58af28f19a7 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:18.330570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-af803eb3-a968-4adc-91e2-e58af28f19a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:18.398837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1221/2453] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 1 16:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:18.421172 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b1034-54e3-44ff-8249-c81b83204a5a service swift] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:18.422789 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-218b1034-54e3-44ff-8249-c81b83204a5a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:18.481611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:18.516424 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b1034-54e3-44ff-8249-c81b83204a5a service swift] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:18.524044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84b7fd-7756-4ac3-9725-ae371dd45705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:18.525055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84b7fd-7756-4ac3-9725-ae371dd45705 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:18.525055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84b7fd-7756-4ac3-9725-ae371dd45705 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:18.525307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84b7fd-7756-4ac3-9725-ae371dd45705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:18.535198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84b7fd-7756-4ac3-9725-ae371dd45705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:18.536776 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84b7fd-7756-4ac3-9725-ae371dd45705 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:18.547662 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1233/2454] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:22.394706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61016bd9-a48a-4048-8a56-62863af1c125 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.395270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61016bd9-a48a-4048-8a56-62863af1c125 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.395270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61016bd9-a48a-4048-8a56-62863af1c125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.416009 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-61016bd9-a48a-4048-8a56-62863af1c125 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:22.417236 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-61016bd9-a48a-4048-8a56-62863af1c125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:22.426474 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1222/2455] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 1 16:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:22.455447 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84b7fd-7756-4ac3-9725-ae371dd45705 service nova] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:22.468493 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84b7fd-7756-4ac3-9725-ae371dd45705 service nova] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:22.475859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09408560-105e-4238-83f2-e8107626ad04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:22.476470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09408560-105e-4238-83f2-e8107626ad04 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.476751 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09408560-105e-4238-83f2-e8107626ad04 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.477023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09408560-105e-4238-83f2-e8107626ad04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.487846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09408560-105e-4238-83f2-e8107626ad04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:22.489345 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09408560-105e-4238-83f2-e8107626ad04 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:22.502006 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1234/2456] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:27.666527 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a01e12-8013-4a66-a25d-2fcf19154368 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:27.667113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a01e12-8013-4a66-a25d-2fcf19154368 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:27.667224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a01e12-8013-4a66-a25d-2fcf19154368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:27.687799 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-f4a01e12-8013-4a66-a25d-2fcf19154368 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:27.689045 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f4a01e12-8013-4a66-a25d-2fcf19154368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:27.697052 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1223/2457] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 1 16:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:27.721290 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09408560-105e-4238-83f2-e8107626ad04 service nova] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:27.734560 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09408560-105e-4238-83f2-e8107626ad04 service nova] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:27.741606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bab2f-0ded-4840-9896-38a9ac2f77a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:27.742268 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bab2f-0ded-4840-9896-38a9ac2f77a6 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:27.742547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bab2f-0ded-4840-9896-38a9ac2f77a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:27.742933 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bab2f-0ded-4840-9896-38a9ac2f77a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:27.753117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bab2f-0ded-4840-9896-38a9ac2f77a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:27.754730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bab2f-0ded-4840-9896-38a9ac2f77a6 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:27.764972 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1235/2458] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:32.881911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab6e96-7e35-4eca-906e-9751f4e124ba None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:32.882377 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab6e96-7e35-4eca-906e-9751f4e124ba None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:32.882377 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab6e96-7e35-4eca-906e-9751f4e124ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:32.901558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-6cab6e96-7e35-4eca-906e-9751f4e124ba None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:32.902785 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6cab6e96-7e35-4eca-906e-9751f4e124ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:32.911303 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1224/2459] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 1 16:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:32.933853 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bab2f-0ded-4840-9896-38a9ac2f77a6 service nova] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:32.935346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2b8bab2f-0ded-4840-9896-38a9ac2f77a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:32.950019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bab2f-0ded-4840-9896-38a9ac2f77a6 service nova] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:32.955984 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9c5a8-bb39-48e9-8ec2-b6f1f9883c37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:32.956585 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9c5a8-bb39-48e9-8ec2-b6f1f9883c37 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:32.957117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9c5a8-bb39-48e9-8ec2-b6f1f9883c37 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:32.957396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9c5a8-bb39-48e9-8ec2-b6f1f9883c37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:32.965918 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9c5a8-bb39-48e9-8ec2-b6f1f9883c37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:32.967514 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9c5a8-bb39-48e9-8ec2-b6f1f9883c37 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:32.977876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1236/2460] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:38.720996 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e565f5b-7698-414c-9a3a-658e90df7fa1 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:38.721597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e565f5b-7698-414c-9a3a-658e90df7fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:38.721597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e565f5b-7698-414c-9a3a-658e90df7fa1 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:38.723013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1225/2461] 10.222.0.71 () {54 vars in 921 bytes} [Thu Sep 1 16:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:36:38.728965 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d9cc0-95c6-4f72-800b-5dba4513f312 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:38.729420 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d9cc0-95c6-4f72-800b-5dba4513f312 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:38.729518 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d9cc0-95c6-4f72-800b-5dba4513f312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:38.750426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-923d9cc0-95c6-4f72-800b-5dba4513f312 None None] MFA Rules not processed for user `ed71d63cd24f4a6caf6ebba2c30d3608`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:38.751728 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-923d9cc0-95c6-4f72-800b-5dba4513f312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:38.760759 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1237/2462] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Sep 1 16:36:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:38.772427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e565f5b-7698-414c-9a3a-658e90df7fa1 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:38.774155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1e565f5b-7698-414c-9a3a-658e90df7fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:38.805733 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:38.833833 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e565f5b-7698-414c-9a3a-658e90df7fa1 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:38.837536 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab868e-9308-443d-8be3-fde1e50cf190 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11356a5e3d041729f71515482033dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:38.838134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab868e-9308-443d-8be3-fde1e50cf190 service glance] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:38.838408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab868e-9308-443d-8be3-fde1e50cf190 service glance] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:38.838706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab868e-9308-443d-8be3-fde1e50cf190 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:38.849469 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab868e-9308-443d-8be3-fde1e50cf190 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:38.850939 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab868e-9308-443d-8be3-fde1e50cf190 service glance] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:38.862020 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1226/2463] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:38.929628 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c9bd0-912c-44b2-b86e-bc1cec89a3ee None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:38.929824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c9bd0-912c-44b2-b86e-bc1cec89a3ee None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:38.930093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c9bd0-912c-44b2-b86e-bc1cec89a3ee None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:38.931671 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1238/2464] 10.222.0.71 () {54 vars in 921 bytes} [Thu Sep 1 16:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:36:38.936267 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e0221-dec7-4d03-acde-3feb0ea90a1b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:38.936548 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e0221-dec7-4d03-acde-3feb0ea90a1b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:38.936866 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e0221-dec7-4d03-acde-3feb0ea90a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:38.956091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-973e0221-dec7-4d03-acde-3feb0ea90a1b None None] MFA Rules not processed for user `d494fd310b1f40839f113d045f0bdcb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:38.957686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-973e0221-dec7-4d03-acde-3feb0ea90a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:39.008960 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1227/2465] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Sep 1 16:36:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:39.021125 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c9bd0-912c-44b2-b86e-bc1cec89a3ee None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:39.022847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2b4c9bd0-912c-44b2-b86e-bc1cec89a3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:39.036302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c9bd0-912c-44b2-b86e-bc1cec89a3ee None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:39.039789 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b8d27-fda5-4bb7-992e-49629627b98d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:39.040369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b8d27-fda5-4bb7-992e-49629627b98d service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:39.040646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b8d27-fda5-4bb7-992e-49629627b98d service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:39.040911 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b8d27-fda5-4bb7-992e-49629627b98d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:39.048903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b8d27-fda5-4bb7-992e-49629627b98d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:39.050329 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b8d27-fda5-4bb7-992e-49629627b98d service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:39.058019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1239/2466] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:36:39.149085 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4639d7-d813-40d4-a0a8-3858a0afb4f7 None None] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:39.149396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4639d7-d813-40d4-a0a8-3858a0afb4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:39.149671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4639d7-d813-40d4-a0a8-3858a0afb4f7 None None] PATH_INFO: `/` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:39.151057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1228/2467] 10.222.0.71 () {54 vars in 921 bytes} [Thu Sep 1 16:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:36:39.156666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534b1e4-a7af-4cfb-937e-004785aec04b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:39.157876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534b1e4-a7af-4cfb-937e-004785aec04b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:39.158181 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534b1e4-a7af-4cfb-937e-004785aec04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:39.178535 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a534b1e4-a7af-4cfb-937e-004785aec04b None None] MFA Rules not processed for user `ed71d63cd24f4a6caf6ebba2c30d3608`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:39.179846 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a534b1e4-a7af-4cfb-937e-004785aec04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:39.189375 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1240/2468] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Sep 1 16:36:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:39.199954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4639d7-d813-40d4-a0a8-3858a0afb4f7 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:39.211804 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4639d7-d813-40d4-a0a8-3858a0afb4f7 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:39.215453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03093e59-fda0-4a80-a7d8-bb693d31aea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:39.216028 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03093e59-fda0-4a80-a7d8-bb693d31aea7 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:39.216311 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03093e59-fda0-4a80-a7d8-bb693d31aea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:39.216584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03093e59-fda0-4a80-a7d8-bb693d31aea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:39.228848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03093e59-fda0-4a80-a7d8-bb693d31aea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:39.230275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03093e59-fda0-4a80-a7d8-bb693d31aea7 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:39.245187 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1229/2469] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:47.920743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440132e2-0852-46c2-9339-f0bf167b7ea1 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:47.921256 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440132e2-0852-46c2-9339-f0bf167b7ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:47.921496 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440132e2-0852-46c2-9339-f0bf167b7ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:47.941478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-440132e2-0852-46c2-9339-f0bf167b7ea1 None None] MFA Rules not processed for user `cd0dbb2c140946f69c3f508b4184e998`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:47.942699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-440132e2-0852-46c2-9339-f0bf167b7ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:47.949803 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1241/2470] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Sep 1 16:36:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:47.962532 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03093e59-fda0-4a80-a7d8-bb693d31aea7 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:47.974521 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03093e59-fda0-4a80-a7d8-bb693d31aea7 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:47.979491 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd77a8-6791-44f3-977c-e03bcced56e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f7afa63815643f580c91df4e4c3bafc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:47.980095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd77a8-6791-44f3-977c-e03bcced56e2 service swift] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:47.980372 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd77a8-6791-44f3-977c-e03bcced56e2 service swift] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:47.980644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd77a8-6791-44f3-977c-e03bcced56e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:47.989569 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd77a8-6791-44f3-977c-e03bcced56e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:47.991179 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd77a8-6791-44f3-977c-e03bcced56e2 service swift] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:47.999318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1230/2471] 10.222.0.71 () {60 vars in 1384 bytes} [Thu Sep 1 16:36:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:36:57.935984 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=45 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:57.995935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=49 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:13.649096 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a95d65-89a1-44df-b4e8-7c92f432bf42 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:13.649611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a95d65-89a1-44df-b4e8-7c92f432bf42 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:13.649714 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a95d65-89a1-44df-b4e8-7c92f432bf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:13.669311 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-e4a95d65-89a1-44df-b4e8-7c92f432bf42 None None] MFA Rules not processed for user `cd0dbb2c140946f69c3f508b4184e998`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:13.670508 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e4a95d65-89a1-44df-b4e8-7c92f432bf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:13.678301 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1242/2472] 10.222.0.71 () {58 vars in 967 bytes} [Thu Sep 1 16:37:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:13.699774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd77a8-6791-44f3-977c-e03bcced56e2 service swift] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:13.710831 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd77a8-6791-44f3-977c-e03bcced56e2 service swift] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:13.715766 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01aac8-e617-4660-b769-93e3a8bcb4b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f7afa63815643f580c91df4e4c3bafc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:13.716348 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01aac8-e617-4660-b769-93e3a8bcb4b1 service swift] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:13.716622 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01aac8-e617-4660-b769-93e3a8bcb4b1 service swift] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:13.716887 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01aac8-e617-4660-b769-93e3a8bcb4b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:13.725305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01aac8-e617-4660-b769-93e3a8bcb4b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:13.726867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01aac8-e617-4660-b769-93e3a8bcb4b1 service swift] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:13.734734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1231/2473] 10.222.0.71 () {60 vars in 1384 bytes} [Thu Sep 1 16:37:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:37:23.663920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:23.731506 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=6 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:29.305828 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a95d65-89a1-44df-b4e8-7c92f432bf42 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:29.307300 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e4a95d65-89a1-44df-b4e8-7c92f432bf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:29.321396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a95d65-89a1-44df-b4e8-7c92f432bf42 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:29.325827 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a76d4-a074-4307-993d-e74095d685e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:29.326443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a76d4-a074-4307-993d-e74095d685e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:29.326746 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a76d4-a074-4307-993d-e74095d685e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:29.327016 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a76d4-a074-4307-993d-e74095d685e4 admin admin] PATH_INFO: `/v3/users/f8d30ea9f0374b28bdfb50c567d96d6a` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:29.328162 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a76d4-a074-4307-993d-e74095d685e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8d30ea9f0374b28bdfb50c567d96d6a)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:29.330054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a76d4-a074-4307-993d-e74095d685e4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:29.376610 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2e1a76d4-a074-4307-993d-e74095d685e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8d30ea9f0374b28bdfb50c567d96d6a'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:29.377254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2e1a76d4-a074-4307-993d-e74095d685e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8d30ea9f0374b28bdfb50c567d96d6a'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:29.384750 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2e1a76d4-a074-4307-993d-e74095d685e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8d30ea9f0374b28bdfb50c567d96d6a'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:29.397211 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2e1a76d4-a074-4307-993d-e74095d685e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8d30ea9f0374b28bdfb50c567d96d6a'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:29.404097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2e1a76d4-a074-4307-993d-e74095d685e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8d30ea9f0374b28bdfb50c567d96d6a'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:29.410496 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1243/2474] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:29 2022] DELETE /identity/v3/users/f8d30ea9f0374b28bdfb50c567d96d6a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:29.578640 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01aac8-e617-4660-b769-93e3a8bcb4b1 service swift] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:29.602729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01aac8-e617-4660-b769-93e3a8bcb4b1 service swift] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:29.662333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f52225-5094-4638-8e00-5b617c4e7a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:29.662333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f52225-5094-4638-8e00-5b617c4e7a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:29.662333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f52225-5094-4638-8e00-5b617c4e7a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:29.663612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f52225-5094-4638-8e00-5b617c4e7a73 admin admin] PATH_INFO: `/v3/projects/bb3e8e830484448cac65e7629e8c25d9` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:29.664498 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f52225-5094-4638-8e00-5b617c4e7a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3e8e830484448cac65e7629e8c25d9)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:29.666411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f52225-5094-4638-8e00-5b617c4e7a73 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:29.711709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e5f52225-5094-4638-8e00-5b617c4e7a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3e8e830484448cac65e7629e8c25d9', 'request_id': 'req-e5f52225-5094-4638-8e00-5b617c4e7a73'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:29.719447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e5f52225-5094-4638-8e00-5b617c4e7a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3e8e830484448cac65e7629e8c25d9', 'request_id': 'req-e5f52225-5094-4638-8e00-5b617c4e7a73'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:29.725903 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e5f52225-5094-4638-8e00-5b617c4e7a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3e8e830484448cac65e7629e8c25d9', 'request_id': 'req-e5f52225-5094-4638-8e00-5b617c4e7a73'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:29.736458 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e5f52225-5094-4638-8e00-5b617c4e7a73 admin admin] The token cache is being invalidate because project bb3e8e830484448cac65e7629e8c25d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:29.736763 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e5f52225-5094-4638-8e00-5b617c4e7a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:29.737406 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e5f52225-5094-4638-8e00-5b617c4e7a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:29.738996 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1232/2475] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:29 2022] DELETE /identity/v3/projects/bb3e8e830484448cac65e7629e8c25d9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:29.743996 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e444d83-050b-42b1-9662-00414352feaa None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:29.744302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e444d83-050b-42b1-9662-00414352feaa None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:29.744576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e444d83-050b-42b1-9662-00414352feaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:29.764347 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1e444d83-050b-42b1-9662-00414352feaa None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:29.765541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1e444d83-050b-42b1-9662-00414352feaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:29.823699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1244/2476] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:29.832538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725e135-0b98-4f87-aec1-df74176e02d9 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:29.832821 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725e135-0b98-4f87-aec1-df74176e02d9 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:29.833093 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725e135-0b98-4f87-aec1-df74176e02d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:29.852919 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-3725e135-0b98-4f87-aec1-df74176e02d9 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:29.854103 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-3725e135-0b98-4f87-aec1-df74176e02d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:29.861782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1233/2477] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:29.866072 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e444d83-050b-42b1-9662-00414352feaa None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:29.876420 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e444d83-050b-42b1-9662-00414352feaa None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:29.880999 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cc848-b293-40e7-86bc-cc69c0cba778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:29.881594 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc848-b293-40e7-86bc-cc69c0cba778 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:29.881871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc848-b293-40e7-86bc-cc69c0cba778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:29.882139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc848-b293-40e7-86bc-cc69c0cba778 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:29.882812 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cc848-b293-40e7-86bc-cc69c0cba778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:29.883111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cc848-b293-40e7-86bc-cc69c0cba778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:29.884684 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cc848-b293-40e7-86bc-cc69c0cba778 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:29.897106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1245/2478] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:37:29.901642 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725e135-0b98-4f87-aec1-df74176e02d9 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:29.910739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725e135-0b98-4f87-aec1-df74176e02d9 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:29.915340 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d8d7e-248c-4b70-9a6b-04ae8475e4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:29.915931 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d8d7e-248c-4b70-9a6b-04ae8475e4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:29.916207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d8d7e-248c-4b70-9a6b-04ae8475e4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:29.916478 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d8d7e-248c-4b70-9a6b-04ae8475e4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:29.917100 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d8d7e-248c-4b70-9a6b-04ae8475e4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:29.919008 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d8d7e-248c-4b70-9a6b-04ae8475e4d4 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:29.946956 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1234/2479] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:29 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:29.951261 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cc848-b293-40e7-86bc-cc69c0cba778 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:29.963302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cc848-b293-40e7-86bc-cc69c0cba778 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:30.018821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3325ae-1551-4b69-a9f6-59a874658045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:30.019428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3325ae-1551-4b69-a9f6-59a874658045 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:30.019707 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3325ae-1551-4b69-a9f6-59a874658045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:30.019976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3325ae-1551-4b69-a9f6-59a874658045 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:30.020624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3325ae-1551-4b69-a9f6-59a874658045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:30.022535 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3325ae-1551-4b69-a9f6-59a874658045 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:30.030690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:30.046967 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1246/2480] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:29 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:37:30.051213 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d8d7e-248c-4b70-9a6b-04ae8475e4d4 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:30.061542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d8d7e-248c-4b70-9a6b-04ae8475e4d4 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:30.067476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce518e6-8a01-4b59-9619-c25901b267e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:30.068365 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce518e6-8a01-4b59-9619-c25901b267e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:30.068653 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce518e6-8a01-4b59-9619-c25901b267e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:30.068926 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce518e6-8a01-4b59-9619-c25901b267e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:30.069634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce518e6-8a01-4b59-9619-c25901b267e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:30.071478 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce518e6-8a01-4b59-9619-c25901b267e1 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:30.086363 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1235/2481] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:30.087573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3325ae-1551-4b69-a9f6-59a874658045 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:30.098902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3325ae-1551-4b69-a9f6-59a874658045 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:30.103615 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a96070-a4fd-4a5a-908d-894675666a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:30.104221 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a96070-a4fd-4a5a-908d-894675666a89 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:30.104500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a96070-a4fd-4a5a-908d-894675666a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:30.104776 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a96070-a4fd-4a5a-908d-894675666a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:30.105418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a96070-a4fd-4a5a-908d-894675666a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:30.107118 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a96070-a4fd-4a5a-908d-894675666a89 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:30.118739 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1247/2482] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:30.122936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce518e6-8a01-4b59-9619-c25901b267e1 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:30.134425 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce518e6-8a01-4b59-9619-c25901b267e1 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:30.139047 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920569bd-c276-4d2e-a6e9-a0d6cef1fd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:30.139691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920569bd-c276-4d2e-a6e9-a0d6cef1fd98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:30.139989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920569bd-c276-4d2e-a6e9-a0d6cef1fd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:30.140259 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920569bd-c276-4d2e-a6e9-a0d6cef1fd98 admin admin] PATH_INFO: `/v3/projects/b96dd31900fe4c43b730d51f0ab9ff0d/users/6adb608fa0124b0ea117eb216bec76bc/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:30.155931 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920569bd-c276-4d2e-a6e9-a0d6cef1fd98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96dd31900fe4c43b730d51f0ab9ff0d, user_id=6adb608fa0124b0ea117eb216bec76bc, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:30.158589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920569bd-c276-4d2e-a6e9-a0d6cef1fd98 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:30.173736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1236/2483] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:30 2022] PUT /identity/v3/projects/b96dd31900fe4c43b730d51f0ab9ff0d/users/6adb608fa0124b0ea117eb216bec76bc/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:30.243053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755cbb2-6d1a-483e-94fc-c442b58c9645 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:30.243389 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755cbb2-6d1a-483e-94fc-c442b58c9645 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:30.243616 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755cbb2-6d1a-483e-94fc-c442b58c9645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:30.272341 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1755cbb2-6d1a-483e-94fc-c442b58c9645 None None] MFA Rules not processed for user `6adb608fa0124b0ea117eb216bec76bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:30.273556 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1755cbb2-6d1a-483e-94fc-c442b58c9645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:30.339278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1248/2484] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:30.350992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920569bd-c276-4d2e-a6e9-a0d6cef1fd98 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:30.352778 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-920569bd-c276-4d2e-a6e9-a0d6cef1fd98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:30.385660 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:30.420858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920569bd-c276-4d2e-a6e9-a0d6cef1fd98 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:30.424967 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0507663-e341-4c9c-98f2-838c17b00446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:30.425562 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0507663-e341-4c9c-98f2-838c17b00446 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:30.425835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0507663-e341-4c9c-98f2-838c17b00446 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:30.426103 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0507663-e341-4c9c-98f2-838c17b00446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:30.434524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0507663-e341-4c9c-98f2-838c17b00446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:30.435972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0507663-e341-4c9c-98f2-838c17b00446 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:30.445119 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1237/2485] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:30 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:33.873094 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755cbb2-6d1a-483e-94fc-c442b58c9645 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:33.882671 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755cbb2-6d1a-483e-94fc-c442b58c9645 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:33.886131 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f598af-a15f-4d34-a132-598f8a08dc19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:33.886749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f598af-a15f-4d34-a132-598f8a08dc19 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:33.887031 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f598af-a15f-4d34-a132-598f8a08dc19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:33.887300 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f598af-a15f-4d34-a132-598f8a08dc19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:33.888994 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-38f598af-a15f-4d34-a132-598f8a08dc19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:33.958716 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f598af-a15f-4d34-a132-598f8a08dc19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:33.960124 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f598af-a15f-4d34-a132-598f8a08dc19 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:33.971591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1249/2486] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:35.423567 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0507663-e341-4c9c-98f2-838c17b00446 service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:35.484830 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0507663-e341-4c9c-98f2-838c17b00446 service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:35.489265 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5e262-00d7-4b7c-be32-ca3c78ed7a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:35.489877 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e262-00d7-4b7c-be32-ca3c78ed7a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:35.490144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e262-00d7-4b7c-be32-ca3c78ed7a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:35.490412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e262-00d7-4b7c-be32-ca3c78ed7a18 admin admin] PATH_INFO: `/v3/users/6adb608fa0124b0ea117eb216bec76bc` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:35.491535 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5e262-00d7-4b7c-be32-ca3c78ed7a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6adb608fa0124b0ea117eb216bec76bc)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:35.493409 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5e262-00d7-4b7c-be32-ca3c78ed7a18 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:35.537416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f9e5e262-00d7-4b7c-be32-ca3c78ed7a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6adb608fa0124b0ea117eb216bec76bc'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:35.538086 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f9e5e262-00d7-4b7c-be32-ca3c78ed7a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6adb608fa0124b0ea117eb216bec76bc'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:35.549723 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f9e5e262-00d7-4b7c-be32-ca3c78ed7a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6adb608fa0124b0ea117eb216bec76bc'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:35.556417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f9e5e262-00d7-4b7c-be32-ca3c78ed7a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6adb608fa0124b0ea117eb216bec76bc'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:35.563388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f9e5e262-00d7-4b7c-be32-ca3c78ed7a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6adb608fa0124b0ea117eb216bec76bc'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:35.569066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1238/2487] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:35 2022] DELETE /identity/v3/users/6adb608fa0124b0ea117eb216bec76bc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:35.573546 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dfd34-1d2a-4476-8b39-6f8a764ce369 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:35.574048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dfd34-1d2a-4476-8b39-6f8a764ce369 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:35.574159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dfd34-1d2a-4476-8b39-6f8a764ce369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:35.595103 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f80dfd34-1d2a-4476-8b39-6f8a764ce369 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:35.596318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f80dfd34-1d2a-4476-8b39-6f8a764ce369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:35.642008 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:35.655248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1250/2488] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:35.665557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5e262-00d7-4b7c-be32-ca3c78ed7a18 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:35.666966 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f9e5e262-00d7-4b7c-be32-ca3c78ed7a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:35.722070 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:35.726436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5e262-00d7-4b7c-be32-ca3c78ed7a18 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:35.731255 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30a51a-7cc3-4f28-9b5a-04fdf7f83e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:35.731839 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30a51a-7cc3-4f28-9b5a-04fdf7f83e30 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:35.732123 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30a51a-7cc3-4f28-9b5a-04fdf7f83e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:35.732575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30a51a-7cc3-4f28-9b5a-04fdf7f83e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:35.742513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30a51a-7cc3-4f28-9b5a-04fdf7f83e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:35.743952 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30a51a-7cc3-4f28-9b5a-04fdf7f83e30 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:35.753833 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1239/2489] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:36.045665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dfd34-1d2a-4476-8b39-6f8a764ce369 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:36.047237 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f80dfd34-1d2a-4476-8b39-6f8a764ce369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:36.059786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dfd34-1d2a-4476-8b39-6f8a764ce369 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:36.064865 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:36.065745 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:36.066029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:36.066298 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072 admin admin] PATH_INFO: `/v3/projects/b96dd31900fe4c43b730d51f0ab9ff0d` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:36.067467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b96dd31900fe4c43b730d51f0ab9ff0d)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:36.069398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:36.115351 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b96dd31900fe4c43b730d51f0ab9ff0d', 'request_id': 'req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:36.121198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b96dd31900fe4c43b730d51f0ab9ff0d', 'request_id': 'req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:36.127250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b96dd31900fe4c43b730d51f0ab9ff0d', 'request_id': 'req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:36.139265 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072 admin admin] The token cache is being invalidate because project b96dd31900fe4c43b730d51f0ab9ff0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:36.139551 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:36.140200 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:36.141707 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1251/2490] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:36 2022] DELETE /identity/v3/projects/b96dd31900fe4c43b730d51f0ab9ff0d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:36.563916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30a51a-7cc3-4f28-9b5a-04fdf7f83e30 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:36.565317 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6e30a51a-7cc3-4f28-9b5a-04fdf7f83e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:36.620966 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30a51a-7cc3-4f28-9b5a-04fdf7f83e30 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:36.670300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c0681-4f6b-4591-a964-0fda5bc47597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:36.670851 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c0681-4f6b-4591-a964-0fda5bc47597 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:36.671129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c0681-4f6b-4591-a964-0fda5bc47597 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:36.671401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c0681-4f6b-4591-a964-0fda5bc47597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:36.673753 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-106c0681-4f6b-4591-a964-0fda5bc47597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:36.741665 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c0681-4f6b-4591-a964-0fda5bc47597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:36.743115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c0681-4f6b-4591-a964-0fda5bc47597 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:36.753746 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1240/2491] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:45.223927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:45.225619 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:45.242337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8b8a4-5e26-4fe5-a6c6-7e165a3a6072 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:45.247959 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75adcb2c-212d-48b3-9c7b-0f37eb3e891d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:45.248682 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adcb2c-212d-48b3-9c7b-0f37eb3e891d service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:45.248970 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adcb2c-212d-48b3-9c7b-0f37eb3e891d service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:45.249826 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adcb2c-212d-48b3-9c7b-0f37eb3e891d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:45.251599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-75adcb2c-212d-48b3-9c7b-0f37eb3e891d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:45.308600 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75adcb2c-212d-48b3-9c7b-0f37eb3e891d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:45.310087 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75adcb2c-212d-48b3-9c7b-0f37eb3e891d service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:45.319680 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1252/2492] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:46.748947 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=78 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:49.771495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c0681-4f6b-4591-a964-0fda5bc47597 service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:49.772895 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-106c0681-4f6b-4591-a964-0fda5bc47597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:49.787042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c0681-4f6b-4591-a964-0fda5bc47597 service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:49.792398 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1309de5-6739-4dcb-b546-c5367336efb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:49.792982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1309de5-6739-4dcb-b546-c5367336efb2 service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:49.793259 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1309de5-6739-4dcb-b546-c5367336efb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:49.793527 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1309de5-6739-4dcb-b546-c5367336efb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:49.795186 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d1309de5-6739-4dcb-b546-c5367336efb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:49.854511 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1309de5-6739-4dcb-b546-c5367336efb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:49.856193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1309de5-6739-4dcb-b546-c5367336efb2 service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:49.865500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1241/2493] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:49 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:55.315551 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:58.226202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826a7df-68e5-4e51-8923-ef983b543cea None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:58.226824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826a7df-68e5-4e51-8923-ef983b543cea None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:58.226824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826a7df-68e5-4e51-8923-ef983b543cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:58.245406 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-c826a7df-68e5-4e51-8923-ef983b543cea None None] MFA Rules not processed for user `08d87dbdb5e8475ebee33fd65e62b3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:58.246652 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c826a7df-68e5-4e51-8923-ef983b543cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:58.253991 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1253/2494] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:37:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:59.861067 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=28 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:04.644035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1309de5-6739-4dcb-b546-c5367336efb2 service nova] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:04.645539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d1309de5-6739-4dcb-b546-c5367336efb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:04.702510 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1309de5-6739-4dcb-b546-c5367336efb2 service nova] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:04.706351 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a30afd-c532-448f-adc6-bc911b27e822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:04.706975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a30afd-c532-448f-adc6-bc911b27e822 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:04.707251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a30afd-c532-448f-adc6-bc911b27e822 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:04.707518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a30afd-c532-448f-adc6-bc911b27e822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:04.709232 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-88a30afd-c532-448f-adc6-bc911b27e822 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:04.719209 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a30afd-c532-448f-adc6-bc911b27e822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:04.720611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a30afd-c532-448f-adc6-bc911b27e822 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:04.728410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1242/2495] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:08.240049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:14.724919 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=26 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:32.261777 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826a7df-68e5-4e51-8923-ef983b543cea None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:32.274286 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826a7df-68e5-4e51-8923-ef983b543cea None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:32.279664 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641c46c-a4e1-4a83-9335-c3ba6c5429c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:32.280754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641c46c-a4e1-4a83-9335-c3ba6c5429c6 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:32.281019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641c46c-a4e1-4a83-9335-c3ba6c5429c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:32.281286 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641c46c-a4e1-4a83-9335-c3ba6c5429c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:32.283009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0641c46c-a4e1-4a83-9335-c3ba6c5429c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:32.340063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641c46c-a4e1-4a83-9335-c3ba6c5429c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:32.341637 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641c46c-a4e1-4a83-9335-c3ba6c5429c6 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:32.351356 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1254/2496] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:38.211155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a30afd-c532-448f-adc6-bc911b27e822 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:38.225185 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a30afd-c532-448f-adc6-bc911b27e822 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:38.240197 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818d779-ce90-4b39-93bd-dc580746dd58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:38.241069 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818d779-ce90-4b39-93bd-dc580746dd58 service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:38.242002 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818d779-ce90-4b39-93bd-dc580746dd58 service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:38.243306 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818d779-ce90-4b39-93bd-dc580746dd58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:38.244795 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b818d779-ce90-4b39-93bd-dc580746dd58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:38.257242 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818d779-ce90-4b39-93bd-dc580746dd58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:38.258938 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818d779-ce90-4b39-93bd-dc580746dd58 service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:38.283139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1243/2497] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:41.584253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09ee4e-a602-4183-9c69-b34d064fde12 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:41.584727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09ee4e-a602-4183-9c69-b34d064fde12 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:41.584843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09ee4e-a602-4183-9c69-b34d064fde12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:41.604169 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-fa09ee4e-a602-4183-9c69-b34d064fde12 None None] MFA Rules not processed for user `88cd06365efb4911b40d8aa0c721c32f`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:41.605384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fa09ee4e-a602-4183-9c69-b34d064fde12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:41.612414 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1255/2498] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:38:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:41.911787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818d779-ce90-4b39-93bd-dc580746dd58 service nova] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:41.913199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b818d779-ce90-4b39-93bd-dc580746dd58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:41.924356 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818d779-ce90-4b39-93bd-dc580746dd58 service nova] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:41.927865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07354f5-100b-4379-b1c6-24dffca86dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:41.928451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07354f5-100b-4379-b1c6-24dffca86dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:41.928728 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07354f5-100b-4379-b1c6-24dffca86dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:41.928993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07354f5-100b-4379-b1c6-24dffca86dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:41.930662 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a07354f5-100b-4379-b1c6-24dffca86dc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:41.940092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07354f5-100b-4379-b1c6-24dffca86dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:41.941521 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07354f5-100b-4379-b1c6-24dffca86dc4 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:41.949302 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1244/2499] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:42.258944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09ee4e-a602-4183-9c69-b34d064fde12 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:42.260409 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fa09ee4e-a602-4183-9c69-b34d064fde12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:42.329196 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09ee4e-a602-4183-9c69-b34d064fde12 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:42.334133 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d3f05-e504-4aea-a5e9-09217d2b7d1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae8db0856ed44088f0bd3cb93701de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:42.334844 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d3f05-e504-4aea-a5e9-09217d2b7d1c service placement] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:42.335148 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d3f05-e504-4aea-a5e9-09217d2b7d1c service placement] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:42.335429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d3f05-e504-4aea-a5e9-09217d2b7d1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:42.337135 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-800d3f05-e504-4aea-a5e9-09217d2b7d1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:42.348147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d3f05-e504-4aea-a5e9-09217d2b7d1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:42.349689 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d3f05-e504-4aea-a5e9-09217d2b7d1c service placement] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:42.359767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1256/2500] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:44.453279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07354f5-100b-4379-b1c6-24dffca86dc4 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:44.470590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07354f5-100b-4379-b1c6-24dffca86dc4 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:44.477418 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e656fc-58b9-4c96-8e63-5f7ac6ea45d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:44.478638 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e656fc-58b9-4c96-8e63-5f7ac6ea45d4 service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:44.479100 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e656fc-58b9-4c96-8e63-5f7ac6ea45d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:44.479549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e656fc-58b9-4c96-8e63-5f7ac6ea45d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:44.481614 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-76e656fc-58b9-4c96-8e63-5f7ac6ea45d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:44.501725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e656fc-58b9-4c96-8e63-5f7ac6ea45d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:44.503602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e656fc-58b9-4c96-8e63-5f7ac6ea45d4 service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:44.522929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1245/2501] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:38:51.428530 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d3f05-e504-4aea-a5e9-09217d2b7d1c service placement] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:51.442605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d3f05-e504-4aea-a5e9-09217d2b7d1c service placement] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:51.448712 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d9f57-de30-456f-8c8d-1487a76dfe72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:51.449372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d9f57-de30-456f-8c8d-1487a76dfe72 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:51.449658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d9f57-de30-456f-8c8d-1487a76dfe72 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:51.449935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d9f57-de30-456f-8c8d-1487a76dfe72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:51.452263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-757d9f57-de30-456f-8c8d-1487a76dfe72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:51.466451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d9f57-de30-456f-8c8d-1487a76dfe72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:51.468610 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d9f57-de30-456f-8c8d-1487a76dfe72 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:51.480675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1257/2502] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:54.510563 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=18 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:57.394221 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e656fc-58b9-4c96-8e63-5f7ac6ea45d4 service nova] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:57.405452 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e656fc-58b9-4c96-8e63-5f7ac6ea45d4 service nova] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:57.411534 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d50a4-1675-4f03-945e-4fc06a7c5e6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:57.412144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d50a4-1675-4f03-945e-4fc06a7c5e6d service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:57.412424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d50a4-1675-4f03-945e-4fc06a7c5e6d service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:57.412701 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d50a4-1675-4f03-945e-4fc06a7c5e6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:57.414590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5c2d50a4-1675-4f03-945e-4fc06a7c5e6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:57.474718 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d50a4-1675-4f03-945e-4fc06a7c5e6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:57.476291 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d50a4-1675-4f03-945e-4fc06a7c5e6d service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:57.485800 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1246/2503] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:57.731080 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd0752-0d93-4894-b3c9-13e067eafeec None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:57.731585 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd0752-0d93-4894-b3c9-13e067eafeec None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:57.731787 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd0752-0d93-4894-b3c9-13e067eafeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:57.751590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f3dd0752-0d93-4894-b3c9-13e067eafeec None None] MFA Rules not processed for user `cd0dbb2c140946f69c3f508b4184e998`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:57.752805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f3dd0752-0d93-4894-b3c9-13e067eafeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:57.807697 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1258/2504] 10.222.0.71 () {58 vars in 967 bytes} [Thu Sep 1 16:38:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:57.857292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d50a4-1675-4f03-945e-4fc06a7c5e6d service nova] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:57.858896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5c2d50a4-1675-4f03-945e-4fc06a7c5e6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:57.940398 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d50a4-1675-4f03-945e-4fc06a7c5e6d service nova] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:57.945373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc089231-fa0a-4954-8853-cd9498b27f79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f7afa63815643f580c91df4e4c3bafc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:57.945975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc089231-fa0a-4954-8853-cd9498b27f79 service swift] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:57.946249 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc089231-fa0a-4954-8853-cd9498b27f79 service swift] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:57.946517 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc089231-fa0a-4954-8853-cd9498b27f79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:57.955338 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc089231-fa0a-4954-8853-cd9498b27f79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:57.957201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc089231-fa0a-4954-8853-cd9498b27f79 service swift] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:57.965063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1247/2505] 10.222.0.71 () {60 vars in 1384 bytes} [Thu Sep 1 16:38:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:38:58.333282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd0752-0d93-4894-b3c9-13e067eafeec None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:58.338343 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:58.345970 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd0752-0d93-4894-b3c9-13e067eafeec None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:58.350822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32841da-7b84-4efa-a8cf-12a8918d61a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:58.351455 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32841da-7b84-4efa-a8cf-12a8918d61a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:58.351731 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32841da-7b84-4efa-a8cf-12a8918d61a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:58.351996 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32841da-7b84-4efa-a8cf-12a8918d61a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:58.353744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b32841da-7b84-4efa-a8cf-12a8918d61a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:58.427031 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32841da-7b84-4efa-a8cf-12a8918d61a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:58.428465 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32841da-7b84-4efa-a8cf-12a8918d61a4 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:58.438939 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1259/2506] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:01.598738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc089231-fa0a-4954-8853-cd9498b27f79 service swift] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:01.600268 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-cc089231-fa0a-4954-8853-cd9498b27f79 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:01.620937 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc089231-fa0a-4954-8853-cd9498b27f79 service swift] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:01.629016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b40734-1e9f-422a-9d7d-506f75c03678 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae8db0856ed44088f0bd3cb93701de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:01.629630 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b40734-1e9f-422a-9d7d-506f75c03678 service placement] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:01.629907 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b40734-1e9f-422a-9d7d-506f75c03678 service placement] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:01.630207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b40734-1e9f-422a-9d7d-506f75c03678 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:01.631981 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-77b40734-1e9f-422a-9d7d-506f75c03678 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:01.644867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b40734-1e9f-422a-9d7d-506f75c03678 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:01.646465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b40734-1e9f-422a-9d7d-506f75c03678 service placement] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:01.662193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1248/2507] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:04.799560 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32841da-7b84-4efa-a8cf-12a8918d61a4 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:04.802852 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b32841da-7b84-4efa-a8cf-12a8918d61a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:04.816925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32841da-7b84-4efa-a8cf-12a8918d61a4 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:04.821253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a17f1c-8b21-4878-baca-1c7203c86599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:04.821920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a17f1c-8b21-4878-baca-1c7203c86599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:04.822202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a17f1c-8b21-4878-baca-1c7203c86599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:04.822476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a17f1c-8b21-4878-baca-1c7203c86599 admin admin] PATH_INFO: `/v3/users/cb41ddb096a549e486c8484bc0420736` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:04.823659 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a17f1c-8b21-4878-baca-1c7203c86599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb41ddb096a549e486c8484bc0420736)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:04.825602 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a17f1c-8b21-4878-baca-1c7203c86599 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:04.872027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c7a17f1c-8b21-4878-baca-1c7203c86599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb41ddb096a549e486c8484bc0420736'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:04.873240 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c7a17f1c-8b21-4878-baca-1c7203c86599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb41ddb096a549e486c8484bc0420736'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:04.881425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c7a17f1c-8b21-4878-baca-1c7203c86599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb41ddb096a549e486c8484bc0420736'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:04.893121 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c7a17f1c-8b21-4878-baca-1c7203c86599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb41ddb096a549e486c8484bc0420736'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:04.899840 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c7a17f1c-8b21-4878-baca-1c7203c86599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb41ddb096a549e486c8484bc0420736'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:04.905782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1260/2508] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:39:04 2022] DELETE /identity/v3/users/cb41ddb096a549e486c8484bc0420736 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:05.081599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b40734-1e9f-422a-9d7d-506f75c03678 service placement] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:05.093210 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b40734-1e9f-422a-9d7d-506f75c03678 service placement] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:05.159529 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:05.160162 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:05.160440 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:05.160714 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87 admin admin] PATH_INFO: `/v3/projects/635fc0ed62b04e4fbffb9d766c2e1d74` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:05.161837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=635fc0ed62b04e4fbffb9d766c2e1d74)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:05.163861 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:05.181371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:05.212847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '635fc0ed62b04e4fbffb9d766c2e1d74', 'request_id': 'req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:05.221068 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '635fc0ed62b04e4fbffb9d766c2e1d74', 'request_id': 'req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:05.229072 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '635fc0ed62b04e4fbffb9d766c2e1d74', 'request_id': 'req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:05.240262 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87 admin admin] The token cache is being invalidate because project 635fc0ed62b04e4fbffb9d766c2e1d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:39:05.240551 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:05.241199 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:05.242787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1249/2509] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:39:05 2022] DELETE /identity/v3/projects/635fc0ed62b04e4fbffb9d766c2e1d74 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:05.246716 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a17f1c-8b21-4878-baca-1c7203c86599 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:05.248181 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c7a17f1c-8b21-4878-baca-1c7203c86599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:05.261117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a17f1c-8b21-4878-baca-1c7203c86599 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:05.317457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6da93-aeb4-46d0-a102-a6f222a98c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:05.318078 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6da93-aeb4-46d0-a102-a6f222a98c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:05.318357 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6da93-aeb4-46d0-a102-a6f222a98c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:05.318656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6da93-aeb4-46d0-a102-a6f222a98c65 admin admin] PATH_INFO: `/v3/users/e179fdedb9944725a73c71b6af995832` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:05.319788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6da93-aeb4-46d0-a102-a6f222a98c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e179fdedb9944725a73c71b6af995832)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:05.321700 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6da93-aeb4-46d0-a102-a6f222a98c65 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:05.333243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:05.369413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-17d6da93-aeb4-46d0-a102-a6f222a98c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e179fdedb9944725a73c71b6af995832'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:05.370047 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-17d6da93-aeb4-46d0-a102-a6f222a98c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e179fdedb9944725a73c71b6af995832'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:05.377287 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-17d6da93-aeb4-46d0-a102-a6f222a98c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e179fdedb9944725a73c71b6af995832'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:05.390013 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-17d6da93-aeb4-46d0-a102-a6f222a98c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e179fdedb9944725a73c71b6af995832'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:05.396677 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-17d6da93-aeb4-46d0-a102-a6f222a98c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e179fdedb9944725a73c71b6af995832'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:05.402487 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1261/2510] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:39:05 2022] DELETE /identity/v3/users/e179fdedb9944725a73c71b6af995832 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:05.575926 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:05.577343 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:05.590536 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1007a-9829-4b69-ae7f-2a06ec32bb87 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:05.658311 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa526da1-3c31-49e7-a006-ae14145190f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:05.658972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa526da1-3c31-49e7-a006-ae14145190f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:05.659252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa526da1-3c31-49e7-a006-ae14145190f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:05.659527 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa526da1-3c31-49e7-a006-ae14145190f7 admin admin] PATH_INFO: `/v3/projects/dab8ce9b60034ddf87f7119a34597d01` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:05.660653 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa526da1-3c31-49e7-a006-ae14145190f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab8ce9b60034ddf87f7119a34597d01)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:05.662528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa526da1-3c31-49e7-a006-ae14145190f7 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:05.707769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-fa526da1-3c31-49e7-a006-ae14145190f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab8ce9b60034ddf87f7119a34597d01', 'request_id': 'req-fa526da1-3c31-49e7-a006-ae14145190f7'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:05.715015 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-fa526da1-3c31-49e7-a006-ae14145190f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab8ce9b60034ddf87f7119a34597d01', 'request_id': 'req-fa526da1-3c31-49e7-a006-ae14145190f7'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:05.721892 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-fa526da1-3c31-49e7-a006-ae14145190f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab8ce9b60034ddf87f7119a34597d01', 'request_id': 'req-fa526da1-3c31-49e7-a006-ae14145190f7'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:05.732848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-fa526da1-3c31-49e7-a006-ae14145190f7 admin admin] The token cache is being invalidate because project dab8ce9b60034ddf87f7119a34597d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:39:05.733131 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-fa526da1-3c31-49e7-a006-ae14145190f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:05.733767 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-fa526da1-3c31-49e7-a006-ae14145190f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:05.735257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1250/2511] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:39:05 2022] DELETE /identity/v3/projects/dab8ce9b60034ddf87f7119a34597d01 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:39:15.399163 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:DELETE=10,keystone:SELECT=22,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:15.729280 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:27.570109 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56eedd-6692-42ab-ac49-b5db21fe6792 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:27.570571 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56eedd-6692-42ab-ac49-b5db21fe6792 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:27.570825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56eedd-6692-42ab-ac49-b5db21fe6792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:27.591421 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-0d56eedd-6692-42ab-ac49-b5db21fe6792 None None] MFA Rules not processed for user `6912413cfb474eb68e31c250531dfcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:27.592938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0d56eedd-6692-42ab-ac49-b5db21fe6792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:27.654749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1262/2512] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:39:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:37.646857 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=25 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:41.501616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa526da1-3c31-49e7-a006-ae14145190f7 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:41.503124 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-fa526da1-3c31-49e7-a006-ae14145190f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:41.560852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa526da1-3c31-49e7-a006-ae14145190f7 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:41.564443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d01d3-4d21-4d00-91e2-fd83d3b69aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:41.565050 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d01d3-4d21-4d00-91e2-fd83d3b69aaf service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:41.565322 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d01d3-4d21-4d00-91e2-fd83d3b69aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:41.565592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d01d3-4d21-4d00-91e2-fd83d3b69aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:41.568689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-612d01d3-4d21-4d00-91e2-fd83d3b69aaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:41.633345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d01d3-4d21-4d00-91e2-fd83d3b69aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:41.634828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d01d3-4d21-4d00-91e2-fd83d3b69aaf service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:41.644517 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1251/2513] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:44.991602 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56eedd-6692-42ab-ac49-b5db21fe6792 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:44.993078 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0d56eedd-6692-42ab-ac49-b5db21fe6792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:45.007173 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56eedd-6692-42ab-ac49-b5db21fe6792 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:45.012169 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59802daf-5fe1-4ace-b7f7-740c402211c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:45.013318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59802daf-5fe1-4ace-b7f7-740c402211c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:45.013603 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59802daf-5fe1-4ace-b7f7-740c402211c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:45.013875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59802daf-5fe1-4ace-b7f7-740c402211c9 admin admin] PATH_INFO: `/v3/users/08d87dbdb5e8475ebee33fd65e62b3d6` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:45.020393 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59802daf-5fe1-4ace-b7f7-740c402211c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d87dbdb5e8475ebee33fd65e62b3d6)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:45.022359 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59802daf-5fe1-4ace-b7f7-740c402211c9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:45.075799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-59802daf-5fe1-4ace-b7f7-740c402211c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d87dbdb5e8475ebee33fd65e62b3d6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:45.076447 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-59802daf-5fe1-4ace-b7f7-740c402211c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d87dbdb5e8475ebee33fd65e62b3d6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:45.083947 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-59802daf-5fe1-4ace-b7f7-740c402211c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d87dbdb5e8475ebee33fd65e62b3d6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:45.095915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-59802daf-5fe1-4ace-b7f7-740c402211c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d87dbdb5e8475ebee33fd65e62b3d6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:45.102800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-59802daf-5fe1-4ace-b7f7-740c402211c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d87dbdb5e8475ebee33fd65e62b3d6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:45.109183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1263/2514] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:39:44 2022] DELETE /identity/v3/users/08d87dbdb5e8475ebee33fd65e62b3d6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:45.297552 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d01d3-4d21-4d00-91e2-fd83d3b69aaf service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:45.308135 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d01d3-4d21-4d00-91e2-fd83d3b69aaf service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:45.366095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76675ae9-5071-430a-a539-9f8115f193ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:45.366653 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76675ae9-5071-430a-a539-9f8115f193ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:45.366932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76675ae9-5071-430a-a539-9f8115f193ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:45.367200 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76675ae9-5071-430a-a539-9f8115f193ea admin admin] PATH_INFO: `/v3/projects/7985d0b24b174e90acb7cc7046876910` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:45.368314 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76675ae9-5071-430a-a539-9f8115f193ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7985d0b24b174e90acb7cc7046876910)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:45.370198 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76675ae9-5071-430a-a539-9f8115f193ea admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:45.415630 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-76675ae9-5071-430a-a539-9f8115f193ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7985d0b24b174e90acb7cc7046876910', 'request_id': 'req-76675ae9-5071-430a-a539-9f8115f193ea'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:45.418164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:45.423104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-76675ae9-5071-430a-a539-9f8115f193ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7985d0b24b174e90acb7cc7046876910', 'request_id': 'req-76675ae9-5071-430a-a539-9f8115f193ea'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:45.430689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-76675ae9-5071-430a-a539-9f8115f193ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7985d0b24b174e90acb7cc7046876910', 'request_id': 'req-76675ae9-5071-430a-a539-9f8115f193ea'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:45.441982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-76675ae9-5071-430a-a539-9f8115f193ea admin admin] The token cache is being invalidate because project 7985d0b24b174e90acb7cc7046876910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:39:45.442269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-76675ae9-5071-430a-a539-9f8115f193ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:45.442942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-76675ae9-5071-430a-a539-9f8115f193ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:45.444430 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1252/2515] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:39:45 2022] DELETE /identity/v3/projects/7985d0b24b174e90acb7cc7046876910 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:45.449333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d493b0-b80f-4b3d-be04-8d890c71aab9 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:45.449690 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d493b0-b80f-4b3d-be04-8d890c71aab9 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:45.450489 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d493b0-b80f-4b3d-be04-8d890c71aab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:45.471210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-30d493b0-b80f-4b3d-be04-8d890c71aab9 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:45.472438 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-30d493b0-b80f-4b3d-be04-8d890c71aab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:45.532558 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1264/2516] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:45.540446 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29e3b9-3edb-43e0-ba91-aad275d4492b None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:45.540734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29e3b9-3edb-43e0-ba91-aad275d4492b None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:45.541011 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29e3b9-3edb-43e0-ba91-aad275d4492b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:45.562873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-1f29e3b9-3edb-43e0-ba91-aad275d4492b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:45.564071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1f29e3b9-3edb-43e0-ba91-aad275d4492b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:45.571806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1253/2517] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:45.576544 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d493b0-b80f-4b3d-be04-8d890c71aab9 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:45.586571 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d493b0-b80f-4b3d-be04-8d890c71aab9 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:45.591230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e25817-8ddb-4036-bc9b-98e1e2d3e0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:45.591861 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e25817-8ddb-4036-bc9b-98e1e2d3e0fe admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:45.592139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e25817-8ddb-4036-bc9b-98e1e2d3e0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:45.592409 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e25817-8ddb-4036-bc9b-98e1e2d3e0fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:45.593089 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e25817-8ddb-4036-bc9b-98e1e2d3e0fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:39:45.593391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e25817-8ddb-4036-bc9b-98e1e2d3e0fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:45.596854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e25817-8ddb-4036-bc9b-98e1e2d3e0fe admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:45.608322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1265/2518] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:39:45.612994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29e3b9-3edb-43e0-ba91-aad275d4492b None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:45.622692 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29e3b9-3edb-43e0-ba91-aad275d4492b None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:45.627347 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be2170-89cd-44d1-be2c-35a48193b209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:45.627933 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be2170-89cd-44d1-be2c-35a48193b209 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:45.628203 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be2170-89cd-44d1-be2c-35a48193b209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:45.628467 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be2170-89cd-44d1-be2c-35a48193b209 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:45.629095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be2170-89cd-44d1-be2c-35a48193b209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:45.631037 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be2170-89cd-44d1-be2c-35a48193b209 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:45.657622 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1254/2519] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:39:45 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:45.661849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e25817-8ddb-4036-bc9b-98e1e2d3e0fe admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:45.671743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e25817-8ddb-4036-bc9b-98e1e2d3e0fe admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:45.726198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c7865-264c-4626-bf87-e22f7e324088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:45.726999 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c7865-264c-4626-bf87-e22f7e324088 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:45.727328 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c7865-264c-4626-bf87-e22f7e324088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:45.727435 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c7865-264c-4626-bf87-e22f7e324088 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:45.728034 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c7865-264c-4626-bf87-e22f7e324088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:45.729929 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c7865-264c-4626-bf87-e22f7e324088 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:45.737890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:45.753676 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1266/2520] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:39:45 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:45.757818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be2170-89cd-44d1-be2c-35a48193b209 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:45.768328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be2170-89cd-44d1-be2c-35a48193b209 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:45.772811 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31d9e3-00d3-4c9c-8025-c33d4dc361bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:45.773385 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31d9e3-00d3-4c9c-8025-c33d4dc361bb admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:45.773657 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31d9e3-00d3-4c9c-8025-c33d4dc361bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:45.773925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31d9e3-00d3-4c9c-8025-c33d4dc361bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:45.774551 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31d9e3-00d3-4c9c-8025-c33d4dc361bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:45.776146 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31d9e3-00d3-4c9c-8025-c33d4dc361bb admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:45.786179 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1255/2521] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:45.789913 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c7865-264c-4626-bf87-e22f7e324088 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:45.800411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c7865-264c-4626-bf87-e22f7e324088 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:45.805010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70991d-6614-4656-ae13-3f1a34aa7666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:45.805600 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70991d-6614-4656-ae13-3f1a34aa7666 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:45.805880 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70991d-6614-4656-ae13-3f1a34aa7666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:45.806156 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70991d-6614-4656-ae13-3f1a34aa7666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:45.806832 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70991d-6614-4656-ae13-3f1a34aa7666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:45.808400 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70991d-6614-4656-ae13-3f1a34aa7666 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:45.819297 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1267/2522] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:45.823493 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31d9e3-00d3-4c9c-8025-c33d4dc361bb admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:45.833661 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31d9e3-00d3-4c9c-8025-c33d4dc361bb admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:45.838169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55d1b2-c9d4-4f3b-80f6-fe46a785d6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:45.838839 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55d1b2-c9d4-4f3b-80f6-fe46a785d6da admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:45.839110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55d1b2-c9d4-4f3b-80f6-fe46a785d6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:45.839374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55d1b2-c9d4-4f3b-80f6-fe46a785d6da admin admin] PATH_INFO: `/v3/projects/e3a093993a984c6194a2c75a0253eb37/users/2657ea2e5cc64a9181877428d18bdda6/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:45.853324 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55d1b2-c9d4-4f3b-80f6-fe46a785d6da admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a093993a984c6194a2c75a0253eb37, user_id=2657ea2e5cc64a9181877428d18bdda6, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:45.856499 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55d1b2-c9d4-4f3b-80f6-fe46a785d6da admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:45.868678 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1256/2523] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:39:45 2022] PUT /identity/v3/projects/e3a093993a984c6194a2c75a0253eb37/users/2657ea2e5cc64a9181877428d18bdda6/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:45.880579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5fdeb-6fbd-4e52-8a35-22558656d87b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:45.880790 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5fdeb-6fbd-4e52-8a35-22558656d87b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:45.881057 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5fdeb-6fbd-4e52-8a35-22558656d87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:45.908300 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-e8a5fdeb-6fbd-4e52-8a35-22558656d87b None None] MFA Rules not processed for user `2657ea2e5cc64a9181877428d18bdda6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:45.909517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e8a5fdeb-6fbd-4e52-8a35-22558656d87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:45.976983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1268/2524] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:45.982008 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55d1b2-c9d4-4f3b-80f6-fe46a785d6da admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:46.042461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55d1b2-c9d4-4f3b-80f6-fe46a785d6da admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:46.047847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb697e66-8bfc-480b-8227-a977add28696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:46.048450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb697e66-8bfc-480b-8227-a977add28696 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:46.048727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb697e66-8bfc-480b-8227-a977add28696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:46.049000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb697e66-8bfc-480b-8227-a977add28696 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:46.049644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb697e66-8bfc-480b-8227-a977add28696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:46.051628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb697e66-8bfc-480b-8227-a977add28696 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:46.079412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1257/2525] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:39:45 2022] POST /identity/v3/projects => generated 361 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:46.083434 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5fdeb-6fbd-4e52-8a35-22558656d87b None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:46.094404 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5fdeb-6fbd-4e52-8a35-22558656d87b None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:46.151241 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c22027-ba8c-4813-8a45-7afdfe403a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:46.151824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c22027-ba8c-4813-8a45-7afdfe403a2f admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:46.152098 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c22027-ba8c-4813-8a45-7afdfe403a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:46.152361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c22027-ba8c-4813-8a45-7afdfe403a2f admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:46.153005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c22027-ba8c-4813-8a45-7afdfe403a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:46.154909 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c22027-ba8c-4813-8a45-7afdfe403a2f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:46.180379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1269/2526] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:39:46 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:39:46.181546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb697e66-8bfc-480b-8227-a977add28696 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:46.192679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb697e66-8bfc-480b-8227-a977add28696 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:46.197841 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fadc6-6bec-4c40-ad93-0e569c514410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:46.198533 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fadc6-6bec-4c40-ad93-0e569c514410 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:46.198917 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fadc6-6bec-4c40-ad93-0e569c514410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:46.199312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fadc6-6bec-4c40-ad93-0e569c514410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:46.200095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fadc6-6bec-4c40-ad93-0e569c514410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:46.201734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fadc6-6bec-4c40-ad93-0e569c514410 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:46.215828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1258/2527] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:46.217159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c22027-ba8c-4813-8a45-7afdfe403a2f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:46.227306 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c22027-ba8c-4813-8a45-7afdfe403a2f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:46.233058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276cff5-0833-4ac0-b242-b52d95c33633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:46.233727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276cff5-0833-4ac0-b242-b52d95c33633 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:46.234003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276cff5-0833-4ac0-b242-b52d95c33633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:46.234280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276cff5-0833-4ac0-b242-b52d95c33633 admin admin] PATH_INFO: `/v3/projects/ee446e8afd82424b99b4ee573c5a240d/users/4c2b37f8a6e349b7a355859f31d9a67b/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:46.255263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276cff5-0833-4ac0-b242-b52d95c33633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee446e8afd82424b99b4ee573c5a240d, user_id=4c2b37f8a6e349b7a355859f31d9a67b, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:46.257901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276cff5-0833-4ac0-b242-b52d95c33633 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:46.271044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1270/2528] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:39:46 2022] PUT /identity/v3/projects/ee446e8afd82424b99b4ee573c5a240d/users/4c2b37f8a6e349b7a355859f31d9a67b/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:46.275045 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fadc6-6bec-4c40-ad93-0e569c514410 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:46.284877 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fadc6-6bec-4c40-ad93-0e569c514410 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:46.332924 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:46.345445 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c515b-8e34-4969-9670-79e29966904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:46.346167 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c515b-8e34-4969-9670-79e29966904d admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:46.346451 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c515b-8e34-4969-9670-79e29966904d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:46.346754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c515b-8e34-4969-9670-79e29966904d admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:46.347453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c515b-8e34-4969-9670-79e29966904d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:46.349055 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c515b-8e34-4969-9670-79e29966904d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:46.359865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1259/2529] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:46.363843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276cff5-0833-4ac0-b242-b52d95c33633 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:46.374561 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276cff5-0833-4ac0-b242-b52d95c33633 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:46.379223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48503d2e-8409-46f5-b067-0d7960c9d414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:46.379868 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503d2e-8409-46f5-b067-0d7960c9d414 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:46.380148 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503d2e-8409-46f5-b067-0d7960c9d414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:46.380423 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503d2e-8409-46f5-b067-0d7960c9d414 admin admin] PATH_INFO: `/v3/projects/ee446e8afd82424b99b4ee573c5a240d/users/4c2b37f8a6e349b7a355859f31d9a67b/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:46.382362 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48503d2e-8409-46f5-b067-0d7960c9d414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee446e8afd82424b99b4ee573c5a240d, user_id=4c2b37f8a6e349b7a355859f31d9a67b, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:46.385005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48503d2e-8409-46f5-b067-0d7960c9d414 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:46.397480 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1271/2530] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:39:46 2022] PUT /identity/v3/projects/ee446e8afd82424b99b4ee573c5a240d/users/4c2b37f8a6e349b7a355859f31d9a67b/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:46.407818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ce0d8-cb43-471c-9959-1e27cb5b0eba None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:46.408104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ce0d8-cb43-471c-9959-1e27cb5b0eba None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:46.408379 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ce0d8-cb43-471c-9959-1e27cb5b0eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:46.437565 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-8a5ce0d8-cb43-471c-9959-1e27cb5b0eba None None] MFA Rules not processed for user `4c2b37f8a6e349b7a355859f31d9a67b`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:46.438836 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-8a5ce0d8-cb43-471c-9959-1e27cb5b0eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:46.505894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1260/2531] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:39:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:46.517144 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48503d2e-8409-46f5-b067-0d7960c9d414 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:46.518891 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-48503d2e-8409-46f5-b067-0d7960c9d414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:46.541359 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:46.579251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48503d2e-8409-46f5-b067-0d7960c9d414 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:46.583010 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503020e3-9da7-425d-bc48-c609f9d88175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:46.583611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503020e3-9da7-425d-bc48-c609f9d88175 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:46.583889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503020e3-9da7-425d-bc48-c609f9d88175 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:46.584161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503020e3-9da7-425d-bc48-c609f9d88175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:46.593861 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503020e3-9da7-425d-bc48-c609f9d88175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:46.595386 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503020e3-9da7-425d-bc48-c609f9d88175 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:46.604936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1272/2532] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:46.683439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ce0d8-cb43-471c-9959-1e27cb5b0eba None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:46.692922 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ce0d8-cb43-471c-9959-1e27cb5b0eba None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:46.696507 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77fb47-4878-4326-8b10-fcb726b3770d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:46.697096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77fb47-4878-4326-8b10-fcb726b3770d service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:46.697373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77fb47-4878-4326-8b10-fcb726b3770d service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:46.697643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77fb47-4878-4326-8b10-fcb726b3770d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:46.756043 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77fb47-4878-4326-8b10-fcb726b3770d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:46.757500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77fb47-4878-4326-8b10-fcb726b3770d service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:46.766634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1261/2533] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:49.512343 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503020e3-9da7-425d-bc48-c609f9d88175 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:49.571842 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503020e3-9da7-425d-bc48-c609f9d88175 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:49.576366 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3556d7-91b9-44f5-838a-dc546bdd2d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:49.576974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3556d7-91b9-44f5-838a-dc546bdd2d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:49.577492 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3556d7-91b9-44f5-838a-dc546bdd2d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:49.577768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3556d7-91b9-44f5-838a-dc546bdd2d59 admin admin] PATH_INFO: `/v3/users/2657ea2e5cc64a9181877428d18bdda6` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:49.578900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3556d7-91b9-44f5-838a-dc546bdd2d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2657ea2e5cc64a9181877428d18bdda6)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:49.580780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3556d7-91b9-44f5-838a-dc546bdd2d59 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:49.628599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eb3556d7-91b9-44f5-838a-dc546bdd2d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2657ea2e5cc64a9181877428d18bdda6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:49.628907 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eb3556d7-91b9-44f5-838a-dc546bdd2d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2657ea2e5cc64a9181877428d18bdda6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:49.636135 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eb3556d7-91b9-44f5-838a-dc546bdd2d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2657ea2e5cc64a9181877428d18bdda6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:49.648044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eb3556d7-91b9-44f5-838a-dc546bdd2d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2657ea2e5cc64a9181877428d18bdda6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:49.655312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eb3556d7-91b9-44f5-838a-dc546bdd2d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2657ea2e5cc64a9181877428d18bdda6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:49.661158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1273/2534] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:39:49 2022] DELETE /identity/v3/users/2657ea2e5cc64a9181877428d18bdda6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:49.665612 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f43147-7063-4848-b03c-7f16f7017a74 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:49.666080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f43147-7063-4848-b03c-7f16f7017a74 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:49.666178 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f43147-7063-4848-b03c-7f16f7017a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:49.685440 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-18f43147-7063-4848-b03c-7f16f7017a74 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:49.686634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-18f43147-7063-4848-b03c-7f16f7017a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:49.744825 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1262/2535] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:49.754511 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3556d7-91b9-44f5-838a-dc546bdd2d59 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:49.756045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-eb3556d7-91b9-44f5-838a-dc546bdd2d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:49.800225 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:49.812407 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3556d7-91b9-44f5-838a-dc546bdd2d59 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:49.816070 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5391880-e793-4661-8822-c8d12a4f9a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:49.816659 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5391880-e793-4661-8822-c8d12a4f9a76 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:49.816938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5391880-e793-4661-8822-c8d12a4f9a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:49.817203 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5391880-e793-4661-8822-c8d12a4f9a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:49.826060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5391880-e793-4661-8822-c8d12a4f9a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:49.827747 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5391880-e793-4661-8822-c8d12a4f9a76 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:49.836802 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1274/2536] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:50.103894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f43147-7063-4848-b03c-7f16f7017a74 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:50.105339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-18f43147-7063-4848-b03c-7f16f7017a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:50.117364 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f43147-7063-4848-b03c-7f16f7017a74 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:50.122119 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:50.122914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:50.123191 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:50.123460 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b admin admin] PATH_INFO: `/v3/projects/e3a093993a984c6194a2c75a0253eb37` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:50.124609 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a093993a984c6194a2c75a0253eb37)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:50.126493 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:50.133590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:50.173397 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a093993a984c6194a2c75a0253eb37', 'request_id': 'req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.179850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a093993a984c6194a2c75a0253eb37', 'request_id': 'req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.186288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a093993a984c6194a2c75a0253eb37', 'request_id': 'req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.196641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b admin admin] The token cache is being invalidate because project e3a093993a984c6194a2c75a0253eb37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:39:50.196928 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.197570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.199067 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1263/2537] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:39:50 2022] DELETE /identity/v3/projects/e3a093993a984c6194a2c75a0253eb37 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:50.203783 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5391880-e793-4661-8822-c8d12a4f9a76 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:50.213201 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5391880-e793-4661-8822-c8d12a4f9a76 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:50.268604 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b06d6f-0d9e-48c6-917c-75da33883031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:50.269251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b06d6f-0d9e-48c6-917c-75da33883031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:50.269533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b06d6f-0d9e-48c6-917c-75da33883031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:50.269806 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b06d6f-0d9e-48c6-917c-75da33883031 admin admin] PATH_INFO: `/v3/users/4c2b37f8a6e349b7a355859f31d9a67b` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:50.270958 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b06d6f-0d9e-48c6-917c-75da33883031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c2b37f8a6e349b7a355859f31d9a67b)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:50.272883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b06d6f-0d9e-48c6-917c-75da33883031 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:50.324055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a3b06d6f-0d9e-48c6-917c-75da33883031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c2b37f8a6e349b7a355859f31d9a67b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.325268 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a3b06d6f-0d9e-48c6-917c-75da33883031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c2b37f8a6e349b7a355859f31d9a67b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.332798 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a3b06d6f-0d9e-48c6-917c-75da33883031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c2b37f8a6e349b7a355859f31d9a67b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.344839 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a3b06d6f-0d9e-48c6-917c-75da33883031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c2b37f8a6e349b7a355859f31d9a67b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.351567 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a3b06d6f-0d9e-48c6-917c-75da33883031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c2b37f8a6e349b7a355859f31d9a67b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.357360 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1275/2538] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:39:50 2022] DELETE /identity/v3/users/4c2b37f8a6e349b7a355859f31d9a67b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:50.630525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:50.632075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:50.647016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ad3ba-4bb1-4c46-9124-e74ec0ee951b admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:50.705648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a084ed0-25c2-4b00-b687-4fa1f6c3be9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:50.706382 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a084ed0-25c2-4b00-b687-4fa1f6c3be9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:50.706522 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a084ed0-25c2-4b00-b687-4fa1f6c3be9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:50.706829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a084ed0-25c2-4b00-b687-4fa1f6c3be9a admin admin] PATH_INFO: `/v3/projects/ee446e8afd82424b99b4ee573c5a240d` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:50.707968 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a084ed0-25c2-4b00-b687-4fa1f6c3be9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee446e8afd82424b99b4ee573c5a240d)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:50.709860 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a084ed0-25c2-4b00-b687-4fa1f6c3be9a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:50.754862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-4a084ed0-25c2-4b00-b687-4fa1f6c3be9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee446e8afd82424b99b4ee573c5a240d', 'request_id': 'req-4a084ed0-25c2-4b00-b687-4fa1f6c3be9a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.762484 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-4a084ed0-25c2-4b00-b687-4fa1f6c3be9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee446e8afd82424b99b4ee573c5a240d', 'request_id': 'req-4a084ed0-25c2-4b00-b687-4fa1f6c3be9a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.768526 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-4a084ed0-25c2-4b00-b687-4fa1f6c3be9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee446e8afd82424b99b4ee573c5a240d', 'request_id': 'req-4a084ed0-25c2-4b00-b687-4fa1f6c3be9a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.778471 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-4a084ed0-25c2-4b00-b687-4fa1f6c3be9a admin admin] The token cache is being invalidate because project ee446e8afd82424b99b4ee573c5a240d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:39:50.778786 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-4a084ed0-25c2-4b00-b687-4fa1f6c3be9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.779409 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-4a084ed0-25c2-4b00-b687-4fa1f6c3be9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.780858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1264/2539] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:39:50 2022] DELETE /identity/v3/projects/ee446e8afd82424b99b4ee573c5a240d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:50.786977 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54247de8-5023-444f-bee2-6fc6a8c42020 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:50.787464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54247de8-5023-444f-bee2-6fc6a8c42020 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:50.787586 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54247de8-5023-444f-bee2-6fc6a8c42020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:50.807151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-54247de8-5023-444f-bee2-6fc6a8c42020 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:50.808342 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-54247de8-5023-444f-bee2-6fc6a8c42020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:50.866029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1276/2540] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:50.874268 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b58bc8-4c9c-4982-8aa8-c003c31b1233 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:50.874555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b58bc8-4c9c-4982-8aa8-c003c31b1233 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:50.874933 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b58bc8-4c9c-4982-8aa8-c003c31b1233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:50.893961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-35b58bc8-4c9c-4982-8aa8-c003c31b1233 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:50.895184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-35b58bc8-4c9c-4982-8aa8-c003c31b1233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:50.902956 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1265/2541] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:50.907158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54247de8-5023-444f-bee2-6fc6a8c42020 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:50.913136 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:50.917347 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54247de8-5023-444f-bee2-6fc6a8c42020 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:50.923968 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31aef47-3beb-4ee3-a2ee-6f583f38d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:50.924702 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aef47-3beb-4ee3-a2ee-6f583f38d948 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:50.925185 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aef47-3beb-4ee3-a2ee-6f583f38d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:50.925459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aef47-3beb-4ee3-a2ee-6f583f38d948 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:50.926125 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31aef47-3beb-4ee3-a2ee-6f583f38d948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:39:50.926416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31aef47-3beb-4ee3-a2ee-6f583f38d948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:50.928080 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31aef47-3beb-4ee3-a2ee-6f583f38d948 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:50.940029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1277/2542] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:39:50.944325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b58bc8-4c9c-4982-8aa8-c003c31b1233 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:50.953737 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b58bc8-4c9c-4982-8aa8-c003c31b1233 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:50.958388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f4c43-648f-4037-b565-796d9e61f937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:50.958971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f4c43-648f-4037-b565-796d9e61f937 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:50.959242 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f4c43-648f-4037-b565-796d9e61f937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:50.959506 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f4c43-648f-4037-b565-796d9e61f937 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:50.960120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f4c43-648f-4037-b565-796d9e61f937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:50.961990 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f4c43-648f-4037-b565-796d9e61f937 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:50.977389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:50.990895 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1266/2543] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:39:50 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:50.994937 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31aef47-3beb-4ee3-a2ee-6f583f38d948 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:51.005379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31aef47-3beb-4ee3-a2ee-6f583f38d948 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:51.060460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658b7e4-6e42-4859-9c8b-fe3fa173b422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:51.061050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658b7e4-6e42-4859-9c8b-fe3fa173b422 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.061327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658b7e4-6e42-4859-9c8b-fe3fa173b422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.061595 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658b7e4-6e42-4859-9c8b-fe3fa173b422 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.062223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658b7e4-6e42-4859-9c8b-fe3fa173b422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:51.064151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658b7e4-6e42-4859-9c8b-fe3fa173b422 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.085893 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1278/2544] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:39:50 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:51.090514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f4c43-648f-4037-b565-796d9e61f937 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:51.100579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f4c43-648f-4037-b565-796d9e61f937 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:51.105131 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575f859-06f6-489d-869c-529663e6c87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:51.106322 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575f859-06f6-489d-869c-529663e6c87a admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.106593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575f859-06f6-489d-869c-529663e6c87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.106886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575f859-06f6-489d-869c-529663e6c87a admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.107514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575f859-06f6-489d-869c-529663e6c87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:51.109098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575f859-06f6-489d-869c-529663e6c87a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.118888 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1267/2545] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:51.122911 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658b7e4-6e42-4859-9c8b-fe3fa173b422 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:51.132692 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658b7e4-6e42-4859-9c8b-fe3fa173b422 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:51.137254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e26d44-98bc-4fac-b8fe-16cac220878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:51.137838 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e26d44-98bc-4fac-b8fe-16cac220878e admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.138111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e26d44-98bc-4fac-b8fe-16cac220878e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.138377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e26d44-98bc-4fac-b8fe-16cac220878e admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.139039 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e26d44-98bc-4fac-b8fe-16cac220878e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:51.140608 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e26d44-98bc-4fac-b8fe-16cac220878e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.150831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1279/2546] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:51.155439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575f859-06f6-489d-869c-529663e6c87a admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:51.165222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575f859-06f6-489d-869c-529663e6c87a admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:51.170384 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3a181-57ca-4209-8be8-4ad16089f4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:51.171047 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3a181-57ca-4209-8be8-4ad16089f4c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.171327 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3a181-57ca-4209-8be8-4ad16089f4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.171596 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3a181-57ca-4209-8be8-4ad16089f4c3 admin admin] PATH_INFO: `/v3/projects/77d47293acac4de78183d948a411d989/users/d87416c92848443aa89b48196af1fd0d/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.186066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3a181-57ca-4209-8be8-4ad16089f4c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d47293acac4de78183d948a411d989, user_id=d87416c92848443aa89b48196af1fd0d, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:51.188720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3a181-57ca-4209-8be8-4ad16089f4c3 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.201126 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1268/2547] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:39:51 2022] PUT /identity/v3/projects/77d47293acac4de78183d948a411d989/users/d87416c92848443aa89b48196af1fd0d/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:51.212684 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296a2b7-ffc8-4cc5-ab67-4a1738a89a42 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.212911 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296a2b7-ffc8-4cc5-ab67-4a1738a89a42 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.213190 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296a2b7-ffc8-4cc5-ab67-4a1738a89a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.242203 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-3296a2b7-ffc8-4cc5-ab67-4a1738a89a42 None None] MFA Rules not processed for user `d87416c92848443aa89b48196af1fd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:51.243466 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3296a2b7-ffc8-4cc5-ab67-4a1738a89a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:51.305534 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1280/2548] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:39:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:51.310138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3a181-57ca-4209-8be8-4ad16089f4c3 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:51.373654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3a181-57ca-4209-8be8-4ad16089f4c3 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:51.378236 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1ca4d-24ab-4544-8cd4-24e015c9122f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:51.378853 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1ca4d-24ab-4544-8cd4-24e015c9122f admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.379135 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1ca4d-24ab-4544-8cd4-24e015c9122f admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.379411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1ca4d-24ab-4544-8cd4-24e015c9122f admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.380046 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1ca4d-24ab-4544-8cd4-24e015c9122f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:51.381925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1ca4d-24ab-4544-8cd4-24e015c9122f admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.408078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1269/2549] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:39:51 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:51.412431 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296a2b7-ffc8-4cc5-ab67-4a1738a89a42 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:51.423663 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296a2b7-ffc8-4cc5-ab67-4a1738a89a42 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:51.480409 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36c29d-5e64-4318-b1e6-e974833d9e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:51.480942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36c29d-5e64-4318-b1e6-e974833d9e46 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.481222 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36c29d-5e64-4318-b1e6-e974833d9e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.481494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36c29d-5e64-4318-b1e6-e974833d9e46 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.482153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36c29d-5e64-4318-b1e6-e974833d9e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:51.484073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36c29d-5e64-4318-b1e6-e974833d9e46 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.491987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:51.506707 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1281/2550] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:39:51 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:51.510963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1ca4d-24ab-4544-8cd4-24e015c9122f admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:51.521629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1ca4d-24ab-4544-8cd4-24e015c9122f admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:51.526164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f95c6-1dbc-4ba6-961d-33249692231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:51.526791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f95c6-1dbc-4ba6-961d-33249692231e admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.527081 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f95c6-1dbc-4ba6-961d-33249692231e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.527994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f95c6-1dbc-4ba6-961d-33249692231e admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.528648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f95c6-1dbc-4ba6-961d-33249692231e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:51.530333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f95c6-1dbc-4ba6-961d-33249692231e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.540731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1270/2551] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:51.544756 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36c29d-5e64-4318-b1e6-e974833d9e46 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:51.554469 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36c29d-5e64-4318-b1e6-e974833d9e46 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:51.559128 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2be486-0ed4-4dce-82bd-f357c8ff24f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:51.559754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2be486-0ed4-4dce-82bd-f357c8ff24f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.560028 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2be486-0ed4-4dce-82bd-f357c8ff24f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.560296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2be486-0ed4-4dce-82bd-f357c8ff24f6 admin admin] PATH_INFO: `/v3/projects/81f3ec0f10834cd796fbab493cee27f4/users/6d13ef55f8114dd0815f994ee5c659ff/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.574762 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2be486-0ed4-4dce-82bd-f357c8ff24f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81f3ec0f10834cd796fbab493cee27f4, user_id=6d13ef55f8114dd0815f994ee5c659ff, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:51.577623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2be486-0ed4-4dce-82bd-f357c8ff24f6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.589567 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1282/2552] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:39:51 2022] PUT /identity/v3/projects/81f3ec0f10834cd796fbab493cee27f4/users/6d13ef55f8114dd0815f994ee5c659ff/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:51.593975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f95c6-1dbc-4ba6-961d-33249692231e admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:51.603886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f95c6-1dbc-4ba6-961d-33249692231e admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:51.661513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1ecad-2289-497f-810b-59bfe6beafba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:51.662117 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1ecad-2289-497f-810b-59bfe6beafba admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.662398 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1ecad-2289-497f-810b-59bfe6beafba admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.662703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1ecad-2289-497f-810b-59bfe6beafba admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.663339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1ecad-2289-497f-810b-59bfe6beafba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:51.664919 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1ecad-2289-497f-810b-59bfe6beafba admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.674347 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1271/2553] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:51.678469 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2be486-0ed4-4dce-82bd-f357c8ff24f6 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:51.688885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2be486-0ed4-4dce-82bd-f357c8ff24f6 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:51.693937 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4d556-0b93-4df7-9464-d968bbe1cec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:51.694635 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4d556-0b93-4df7-9464-d968bbe1cec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.694920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4d556-0b93-4df7-9464-d968bbe1cec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.695191 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4d556-0b93-4df7-9464-d968bbe1cec3 admin admin] PATH_INFO: `/v3/projects/81f3ec0f10834cd796fbab493cee27f4/users/6d13ef55f8114dd0815f994ee5c659ff/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.697113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4d556-0b93-4df7-9464-d968bbe1cec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81f3ec0f10834cd796fbab493cee27f4, user_id=6d13ef55f8114dd0815f994ee5c659ff, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:51.700300 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4d556-0b93-4df7-9464-d968bbe1cec3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.710800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1283/2554] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:39:51 2022] PUT /identity/v3/projects/81f3ec0f10834cd796fbab493cee27f4/users/6d13ef55f8114dd0815f994ee5c659ff/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:51.721529 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d365ea9-2e43-40c6-8f95-b059d9cf7ce7 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.722037 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d365ea9-2e43-40c6-8f95-b059d9cf7ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.722148 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d365ea9-2e43-40c6-8f95-b059d9cf7ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.749273 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-9d365ea9-2e43-40c6-8f95-b059d9cf7ce7 None None] MFA Rules not processed for user `6d13ef55f8114dd0815f994ee5c659ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:51.750408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-9d365ea9-2e43-40c6-8f95-b059d9cf7ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:51.769546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:51.819482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1272/2555] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:39:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:51.830959 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4d556-0b93-4df7-9464-d968bbe1cec3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:51.832627 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-45a4d556-0b93-4df7-9464-d968bbe1cec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:51.888086 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4d556-0b93-4df7-9464-d968bbe1cec3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:51.891680 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96033c-6524-4b39-8c22-2eb8ea984a1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:51.892262 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96033c-6524-4b39-8c22-2eb8ea984a1e service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.892538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96033c-6524-4b39-8c22-2eb8ea984a1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.892803 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96033c-6524-4b39-8c22-2eb8ea984a1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.946446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96033c-6524-4b39-8c22-2eb8ea984a1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:51.947900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96033c-6524-4b39-8c22-2eb8ea984a1e service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.957864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1284/2556] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:54.518628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d365ea9-2e43-40c6-8f95-b059d9cf7ce7 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:54.528118 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d365ea9-2e43-40c6-8f95-b059d9cf7ce7 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:54.531677 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c513c-9bd0-434b-8ff2-3c0f87e46a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:54.532290 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c513c-9bd0-434b-8ff2-3c0f87e46a8f service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:54.532562 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c513c-9bd0-434b-8ff2-3c0f87e46a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:54.532828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c513c-9bd0-434b-8ff2-3c0f87e46a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:54.545131 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c513c-9bd0-434b-8ff2-3c0f87e46a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:54.546313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c513c-9bd0-434b-8ff2-3c0f87e46a8f service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:54.555814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1273/2557] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:01.953498 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:INSERT=5,keystone:SELECT=65 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:04.551635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=26 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:06.982409 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96033c-6524-4b39-8c22-2eb8ea984a1e service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:07.043146 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96033c-6524-4b39-8c22-2eb8ea984a1e service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:07.047696 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5d4c3-2d06-46fb-a19b-ae2c9bdc6a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:07.048309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5d4c3-2d06-46fb-a19b-ae2c9bdc6a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:07.048590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5d4c3-2d06-46fb-a19b-ae2c9bdc6a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:07.048865 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5d4c3-2d06-46fb-a19b-ae2c9bdc6a79 admin admin] PATH_INFO: `/v3/users/d87416c92848443aa89b48196af1fd0d` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:07.049983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5d4c3-2d06-46fb-a19b-ae2c9bdc6a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87416c92848443aa89b48196af1fd0d)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:07.051913 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5d4c3-2d06-46fb-a19b-ae2c9bdc6a79 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:07.098910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-90e5d4c3-2d06-46fb-a19b-ae2c9bdc6a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87416c92848443aa89b48196af1fd0d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:07.099578 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-90e5d4c3-2d06-46fb-a19b-ae2c9bdc6a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87416c92848443aa89b48196af1fd0d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:07.106901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-90e5d4c3-2d06-46fb-a19b-ae2c9bdc6a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87416c92848443aa89b48196af1fd0d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:07.118737 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-90e5d4c3-2d06-46fb-a19b-ae2c9bdc6a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87416c92848443aa89b48196af1fd0d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:07.126126 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-90e5d4c3-2d06-46fb-a19b-ae2c9bdc6a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87416c92848443aa89b48196af1fd0d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:07.131993 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1285/2558] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:40:06 2022] DELETE /identity/v3/users/d87416c92848443aa89b48196af1fd0d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:07.136940 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24ed2f-27e0-4298-a728-06ec67c114a2 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:07.137416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24ed2f-27e0-4298-a728-06ec67c114a2 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:07.137533 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24ed2f-27e0-4298-a728-06ec67c114a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:07.156617 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-cd24ed2f-27e0-4298-a728-06ec67c114a2 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:07.157813 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-cd24ed2f-27e0-4298-a728-06ec67c114a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:07.216803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1274/2559] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:07.226349 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5d4c3-2d06-46fb-a19b-ae2c9bdc6a79 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:07.227803 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-90e5d4c3-2d06-46fb-a19b-ae2c9bdc6a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:07.283424 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5d4c3-2d06-46fb-a19b-ae2c9bdc6a79 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:07.287086 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572ef02-731a-48a1-9540-6914c02d68a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:07.287679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572ef02-731a-48a1-9540-6914c02d68a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:07.287956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572ef02-731a-48a1-9540-6914c02d68a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:07.288226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572ef02-731a-48a1-9540-6914c02d68a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:07.297478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572ef02-731a-48a1-9540-6914c02d68a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:07.298920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572ef02-731a-48a1-9540-6914c02d68a9 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:07.308102 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1286/2560] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:07.588802 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24ed2f-27e0-4298-a728-06ec67c114a2 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:07.593270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-cd24ed2f-27e0-4298-a728-06ec67c114a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:07.607089 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24ed2f-27e0-4298-a728-06ec67c114a2 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:07.612171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:07.612823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:07.613097 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:07.613362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4 admin admin] PATH_INFO: `/v3/projects/77d47293acac4de78183d948a411d989` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:07.614506 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d47293acac4de78183d948a411d989)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:07.616383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:07.665747 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d47293acac4de78183d948a411d989', 'request_id': 'req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:07.673684 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d47293acac4de78183d948a411d989', 'request_id': 'req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:07.679996 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d47293acac4de78183d948a411d989', 'request_id': 'req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:07.692002 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4 admin admin] The token cache is being invalidate because project 77d47293acac4de78183d948a411d989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:40:07.692288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:07.692921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:07.694415 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1275/2561] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:40:07 2022] DELETE /identity/v3/projects/77d47293acac4de78183d948a411d989 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:07.702269 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572ef02-731a-48a1-9540-6914c02d68a9 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:07.712095 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572ef02-731a-48a1-9540-6914c02d68a9 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:07.732531 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:07.775283 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b2dd1-3d08-46b0-8ed8-273455ada664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:07.775836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b2dd1-3d08-46b0-8ed8-273455ada664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:07.776114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b2dd1-3d08-46b0-8ed8-273455ada664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:07.776385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b2dd1-3d08-46b0-8ed8-273455ada664 admin admin] PATH_INFO: `/v3/users/6d13ef55f8114dd0815f994ee5c659ff` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:07.777517 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b2dd1-3d08-46b0-8ed8-273455ada664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d13ef55f8114dd0815f994ee5c659ff)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:07.780091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b2dd1-3d08-46b0-8ed8-273455ada664 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:07.824675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9e2b2dd1-3d08-46b0-8ed8-273455ada664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d13ef55f8114dd0815f994ee5c659ff'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:07.825346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9e2b2dd1-3d08-46b0-8ed8-273455ada664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d13ef55f8114dd0815f994ee5c659ff'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:07.834161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9e2b2dd1-3d08-46b0-8ed8-273455ada664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d13ef55f8114dd0815f994ee5c659ff'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:07.846460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9e2b2dd1-3d08-46b0-8ed8-273455ada664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d13ef55f8114dd0815f994ee5c659ff'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:07.853679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9e2b2dd1-3d08-46b0-8ed8-273455ada664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d13ef55f8114dd0815f994ee5c659ff'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:07.860351 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1287/2562] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:40:07 2022] DELETE /identity/v3/users/6d13ef55f8114dd0815f994ee5c659ff => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:08.148245 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:08.150285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:08.165896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72bca1-bf39-4ccc-931e-e4ee2a0989e4 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:08.225209 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9586bc0-0c2c-475b-a780-ad03b77720c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:08.226204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9586bc0-0c2c-475b-a780-ad03b77720c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:08.226521 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9586bc0-0c2c-475b-a780-ad03b77720c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:08.226827 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9586bc0-0c2c-475b-a780-ad03b77720c5 admin admin] PATH_INFO: `/v3/projects/81f3ec0f10834cd796fbab493cee27f4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:08.227951 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9586bc0-0c2c-475b-a780-ad03b77720c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81f3ec0f10834cd796fbab493cee27f4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:08.229824 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9586bc0-0c2c-475b-a780-ad03b77720c5 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:08.262590 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:08.290647 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f9586bc0-0c2c-475b-a780-ad03b77720c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81f3ec0f10834cd796fbab493cee27f4', 'request_id': 'req-f9586bc0-0c2c-475b-a780-ad03b77720c5'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:08.297803 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f9586bc0-0c2c-475b-a780-ad03b77720c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81f3ec0f10834cd796fbab493cee27f4', 'request_id': 'req-f9586bc0-0c2c-475b-a780-ad03b77720c5'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:08.304194 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f9586bc0-0c2c-475b-a780-ad03b77720c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81f3ec0f10834cd796fbab493cee27f4', 'request_id': 'req-f9586bc0-0c2c-475b-a780-ad03b77720c5'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:08.319383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f9586bc0-0c2c-475b-a780-ad03b77720c5 admin admin] The token cache is being invalidate because project 81f3ec0f10834cd796fbab493cee27f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:40:08.319598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f9586bc0-0c2c-475b-a780-ad03b77720c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:08.320248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f9586bc0-0c2c-475b-a780-ad03b77720c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:08.321783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1276/2563] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:40:08 2022] DELETE /identity/v3/projects/81f3ec0f10834cd796fbab493cee27f4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:08.328304 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12bd14-ca75-401c-bd46-3a36bab17a27 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:08.328786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12bd14-ca75-401c-bd46-3a36bab17a27 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:08.329104 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12bd14-ca75-401c-bd46-3a36bab17a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:08.350771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-bd12bd14-ca75-401c-bd46-3a36bab17a27 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:08.351987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bd12bd14-ca75-401c-bd46-3a36bab17a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:08.413739 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1288/2564] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:08.422711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd60bd4-dc67-49d4-b767-442644b71256 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:08.423086 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd60bd4-dc67-49d4-b767-442644b71256 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:08.423555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd60bd4-dc67-49d4-b767-442644b71256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:08.444341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-7fd60bd4-dc67-49d4-b767-442644b71256 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:08.445529 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7fd60bd4-dc67-49d4-b767-442644b71256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:08.454235 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1277/2565] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:08.459023 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12bd14-ca75-401c-bd46-3a36bab17a27 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:08.468551 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12bd14-ca75-401c-bd46-3a36bab17a27 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:08.473177 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189beec7-cdca-497b-860c-b077f0847169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:08.473761 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189beec7-cdca-497b-860c-b077f0847169 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:08.474031 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189beec7-cdca-497b-860c-b077f0847169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:08.474293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189beec7-cdca-497b-860c-b077f0847169 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:08.474963 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189beec7-cdca-497b-860c-b077f0847169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:40:08.475259 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189beec7-cdca-497b-860c-b077f0847169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:08.476819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189beec7-cdca-497b-860c-b077f0847169 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:08.488045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1289/2566] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:40:08.492313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd60bd4-dc67-49d4-b767-442644b71256 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:08.501703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd60bd4-dc67-49d4-b767-442644b71256 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:08.506189 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699fc1c-53a7-4ee9-ad29-a783f8a5b632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:08.506805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699fc1c-53a7-4ee9-ad29-a783f8a5b632 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:08.507078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699fc1c-53a7-4ee9-ad29-a783f8a5b632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:08.507340 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699fc1c-53a7-4ee9-ad29-a783f8a5b632 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:08.507966 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699fc1c-53a7-4ee9-ad29-a783f8a5b632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:08.509805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699fc1c-53a7-4ee9-ad29-a783f8a5b632 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:08.536341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1278/2567] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:40:08 2022] POST /identity/v3/projects => generated 407 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:40:08.540558 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189beec7-cdca-497b-860c-b077f0847169 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:08.550225 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189beec7-cdca-497b-860c-b077f0847169 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:08.576004 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:08.606869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2715c8d-4f8e-4983-8009-edc46c54fd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:08.607467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2715c8d-4f8e-4983-8009-edc46c54fd17 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:08.607744 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2715c8d-4f8e-4983-8009-edc46c54fd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:08.608012 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2715c8d-4f8e-4983-8009-edc46c54fd17 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:08.608637 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2715c8d-4f8e-4983-8009-edc46c54fd17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:08.610538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2715c8d-4f8e-4983-8009-edc46c54fd17 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:08.632032 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1290/2568] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:40:08 2022] POST /identity/v3/users => generated 304 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:40:08.636853 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699fc1c-53a7-4ee9-ad29-a783f8a5b632 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:08.647286 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699fc1c-53a7-4ee9-ad29-a783f8a5b632 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:08.651881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b330db-17a6-42ba-98d6-e6cecf4553ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:08.652466 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b330db-17a6-42ba-98d6-e6cecf4553ae admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:08.652739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b330db-17a6-42ba-98d6-e6cecf4553ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:08.653003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b330db-17a6-42ba-98d6-e6cecf4553ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:08.653635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b330db-17a6-42ba-98d6-e6cecf4553ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:08.655269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b330db-17a6-42ba-98d6-e6cecf4553ae admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:08.665126 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1279/2569] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:40:08.669359 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2715c8d-4f8e-4983-8009-edc46c54fd17 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:08.679128 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2715c8d-4f8e-4983-8009-edc46c54fd17 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:08.684328 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255a45d-1c53-46da-8408-24ef3878a5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:08.684910 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255a45d-1c53-46da-8408-24ef3878a5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:08.685189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255a45d-1c53-46da-8408-24ef3878a5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:08.685462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255a45d-1c53-46da-8408-24ef3878a5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:08.686095 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255a45d-1c53-46da-8408-24ef3878a5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:08.687709 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255a45d-1c53-46da-8408-24ef3878a5b1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:08.698016 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1291/2570] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:40:08.702308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b330db-17a6-42ba-98d6-e6cecf4553ae admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:08.712257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b330db-17a6-42ba-98d6-e6cecf4553ae admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:08.716875 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5fbe6-ecd6-412b-ad2e-b6254444205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:08.717528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5fbe6-ecd6-412b-ad2e-b6254444205d admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:08.717808 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5fbe6-ecd6-412b-ad2e-b6254444205d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:08.718078 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5fbe6-ecd6-412b-ad2e-b6254444205d admin admin] PATH_INFO: `/v3/projects/812682f88245451ca355bce43910da9c/users/b6e3dbe6280c40049c15d2e06262d6cc/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:08.733102 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5fbe6-ecd6-412b-ad2e-b6254444205d admin admin] RBAC: Authorizing `identity:create_grant(project_id=812682f88245451ca355bce43910da9c, user_id=b6e3dbe6280c40049c15d2e06262d6cc, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:08.735795 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5fbe6-ecd6-412b-ad2e-b6254444205d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:08.748748 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1280/2571] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:40:08 2022] PUT /identity/v3/projects/812682f88245451ca355bce43910da9c/users/b6e3dbe6280c40049c15d2e06262d6cc/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:08.759171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836ca54-faa1-4331-bbb1-d7eca188944b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:08.759457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836ca54-faa1-4331-bbb1-d7eca188944b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:08.759748 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836ca54-faa1-4331-bbb1-d7eca188944b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:08.787388 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7836ca54-faa1-4331-bbb1-d7eca188944b None None] MFA Rules not processed for user `b6e3dbe6280c40049c15d2e06262d6cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:08.788591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7836ca54-faa1-4331-bbb1-d7eca188944b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:08.850590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1292/2572] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:40:08 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:08.855618 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5fbe6-ecd6-412b-ad2e-b6254444205d admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:08.915779 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5fbe6-ecd6-412b-ad2e-b6254444205d admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:08.921009 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dae736-b546-49cb-ae04-6a6c7e5b8cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:08.921597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dae736-b546-49cb-ae04-6a6c7e5b8cfe admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:08.921878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dae736-b546-49cb-ae04-6a6c7e5b8cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:08.922150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dae736-b546-49cb-ae04-6a6c7e5b8cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:08.922814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dae736-b546-49cb-ae04-6a6c7e5b8cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:08.924687 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dae736-b546-49cb-ae04-6a6c7e5b8cfe admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:08.950869 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1281/2573] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:40:08 2022] POST /identity/v3/projects => generated 407 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:40:08.955428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836ca54-faa1-4331-bbb1-d7eca188944b None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:08.965832 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836ca54-faa1-4331-bbb1-d7eca188944b None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:09.020069 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7f0d2-44fb-42b7-9095-66fe3d17f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:09.020664 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7f0d2-44fb-42b7-9095-66fe3d17f106 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:09.020944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7f0d2-44fb-42b7-9095-66fe3d17f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:09.021232 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7f0d2-44fb-42b7-9095-66fe3d17f106 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:09.021849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7f0d2-44fb-42b7-9095-66fe3d17f106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:09.023820 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7f0d2-44fb-42b7-9095-66fe3d17f106 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:09.045151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1293/2574] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:40:08 2022] POST /identity/v3/users => generated 310 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:40:09.049195 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dae736-b546-49cb-ae04-6a6c7e5b8cfe admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:09.059948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dae736-b546-49cb-ae04-6a6c7e5b8cfe admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:09.064470 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9bc9f-a1a3-44f3-b1cf-3fee647ecd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:09.065057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9bc9f-a1a3-44f3-b1cf-3fee647ecd23 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:09.065336 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9bc9f-a1a3-44f3-b1cf-3fee647ecd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:09.065606 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9bc9f-a1a3-44f3-b1cf-3fee647ecd23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:09.066270 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9bc9f-a1a3-44f3-b1cf-3fee647ecd23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:09.067879 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9bc9f-a1a3-44f3-b1cf-3fee647ecd23 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:09.078953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1282/2575] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:40:09.083206 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7f0d2-44fb-42b7-9095-66fe3d17f106 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:09.093429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7f0d2-44fb-42b7-9095-66fe3d17f106 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:09.097920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4ac8c-9966-4af1-9c2c-43f20fc68b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:09.098554 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4ac8c-9966-4af1-9c2c-43f20fc68b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:09.098858 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4ac8c-9966-4af1-9c2c-43f20fc68b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:09.099128 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4ac8c-9966-4af1-9c2c-43f20fc68b96 admin admin] PATH_INFO: `/v3/projects/8dcad64daf734c4e9fe10adb6fe7a46d/users/292db929e9a44035b0928d28c5e4c8d6/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:09.113512 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4ac8c-9966-4af1-9c2c-43f20fc68b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dcad64daf734c4e9fe10adb6fe7a46d, user_id=292db929e9a44035b0928d28c5e4c8d6, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:09.116083 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4ac8c-9966-4af1-9c2c-43f20fc68b96 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:09.129570 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1294/2576] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:40:09 2022] PUT /identity/v3/projects/8dcad64daf734c4e9fe10adb6fe7a46d/users/292db929e9a44035b0928d28c5e4c8d6/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:40:09.133623 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9bc9f-a1a3-44f3-b1cf-3fee647ecd23 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:09.143454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9bc9f-a1a3-44f3-b1cf-3fee647ecd23 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:09.163654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:09.200570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782772f-ab83-42ab-9dcd-903a8397b790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:09.201167 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782772f-ab83-42ab-9dcd-903a8397b790 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:09.201440 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782772f-ab83-42ab-9dcd-903a8397b790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:09.201707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782772f-ab83-42ab-9dcd-903a8397b790 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:09.202588 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782772f-ab83-42ab-9dcd-903a8397b790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:09.204171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782772f-ab83-42ab-9dcd-903a8397b790 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:09.213528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1283/2577] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:40:09.218242 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4ac8c-9966-4af1-9c2c-43f20fc68b96 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:09.223551 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:09.230469 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4ac8c-9966-4af1-9c2c-43f20fc68b96 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:09.235343 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621587d-c7d4-48fa-893b-543ad9893b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:09.235973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621587d-c7d4-48fa-893b-543ad9893b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:09.236245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621587d-c7d4-48fa-893b-543ad9893b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:09.236513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621587d-c7d4-48fa-893b-543ad9893b9d admin admin] PATH_INFO: `/v3/projects/8dcad64daf734c4e9fe10adb6fe7a46d/users/292db929e9a44035b0928d28c5e4c8d6/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:09.238370 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621587d-c7d4-48fa-893b-543ad9893b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dcad64daf734c4e9fe10adb6fe7a46d, user_id=292db929e9a44035b0928d28c5e4c8d6, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:09.240973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621587d-c7d4-48fa-893b-543ad9893b9d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:09.250761 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1295/2578] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:40:09 2022] PUT /identity/v3/projects/8dcad64daf734c4e9fe10adb6fe7a46d/users/292db929e9a44035b0928d28c5e4c8d6/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:09.261509 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6db50c-6272-4bf9-9e3d-882766207da6 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:09.261789 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6db50c-6272-4bf9-9e3d-882766207da6 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:09.262056 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6db50c-6272-4bf9-9e3d-882766207da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:09.289202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-4f6db50c-6272-4bf9-9e3d-882766207da6 None None] MFA Rules not processed for user `292db929e9a44035b0928d28c5e4c8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:09.290383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4f6db50c-6272-4bf9-9e3d-882766207da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:09.355542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1284/2579] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:40:09 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:09.365903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621587d-c7d4-48fa-893b-543ad9893b9d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:09.367599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0621587d-c7d4-48fa-893b-543ad9893b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:09.423878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621587d-c7d4-48fa-893b-543ad9893b9d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:09.428045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0050b5-51bf-4d93-ba4d-d07914514940 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:09.428677 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0050b5-51bf-4d93-ba4d-d07914514940 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:09.428952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0050b5-51bf-4d93-ba4d-d07914514940 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:09.429218 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0050b5-51bf-4d93-ba4d-d07914514940 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:09.438999 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0050b5-51bf-4d93-ba4d-d07914514940 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:09.440426 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0050b5-51bf-4d93-ba4d-d07914514940 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:09.450536 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1296/2580] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:09 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:09.598148 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6db50c-6272-4bf9-9e3d-882766207da6 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:09.607549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6db50c-6272-4bf9-9e3d-882766207da6 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:09.611131 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e2c28-72bb-4658-bd57-ef607eb12faf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:09.611728 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e2c28-72bb-4658-bd57-ef607eb12faf service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:09.612001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e2c28-72bb-4658-bd57-ef607eb12faf service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:09.612268 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e2c28-72bb-4658-bd57-ef607eb12faf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:09.669973 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e2c28-72bb-4658-bd57-ef607eb12faf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:09.671468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e2c28-72bb-4658-bd57-ef607eb12faf service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:09.680410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1285/2581] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:09 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:14.895551 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0050b5-51bf-4d93-ba4d-d07914514940 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:14.956350 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0050b5-51bf-4d93-ba4d-d07914514940 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:14.960845 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58341b4-fc41-47bf-a649-5256e009e172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:14.961455 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58341b4-fc41-47bf-a649-5256e009e172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:14.961730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58341b4-fc41-47bf-a649-5256e009e172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:14.962019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58341b4-fc41-47bf-a649-5256e009e172 admin admin] PATH_INFO: `/v3/users/b6e3dbe6280c40049c15d2e06262d6cc` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:14.963151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58341b4-fc41-47bf-a649-5256e009e172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6e3dbe6280c40049c15d2e06262d6cc)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:14.965070 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58341b4-fc41-47bf-a649-5256e009e172 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:15.009042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b58341b4-fc41-47bf-a649-5256e009e172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6e3dbe6280c40049c15d2e06262d6cc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:15.009679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b58341b4-fc41-47bf-a649-5256e009e172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6e3dbe6280c40049c15d2e06262d6cc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:15.017057 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b58341b4-fc41-47bf-a649-5256e009e172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6e3dbe6280c40049c15d2e06262d6cc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:15.029349 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b58341b4-fc41-47bf-a649-5256e009e172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6e3dbe6280c40049c15d2e06262d6cc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:15.037546 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b58341b4-fc41-47bf-a649-5256e009e172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6e3dbe6280c40049c15d2e06262d6cc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:15.044233 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1297/2582] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:40:14 2022] DELETE /identity/v3/users/b6e3dbe6280c40049c15d2e06262d6cc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:15.048652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab3c62-662b-44ba-a5df-37efae591a6d None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:15.049105 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab3c62-662b-44ba-a5df-37efae591a6d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:15.049230 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab3c62-662b-44ba-a5df-37efae591a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:15.069238 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-74ab3c62-662b-44ba-a5df-37efae591a6d None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:15.070509 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-74ab3c62-662b-44ba-a5df-37efae591a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:15.111542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:15.130266 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1286/2583] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:15.139941 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58341b4-fc41-47bf-a649-5256e009e172 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:15.141262 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b58341b4-fc41-47bf-a649-5256e009e172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:15.154979 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:15.201200 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58341b4-fc41-47bf-a649-5256e009e172 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:15.205139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdff98-c9ef-44c0-adcc-dec427e4b3d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:15.205743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdff98-c9ef-44c0-adcc-dec427e4b3d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:15.206019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdff98-c9ef-44c0-adcc-dec427e4b3d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:15.206287 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdff98-c9ef-44c0-adcc-dec427e4b3d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:15.215562 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdff98-c9ef-44c0-adcc-dec427e4b3d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:15.216976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdff98-c9ef-44c0-adcc-dec427e4b3d0 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:15.226161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1298/2584] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:15.487680 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab3c62-662b-44ba-a5df-37efae591a6d None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:15.489185 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-74ab3c62-662b-44ba-a5df-37efae591a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:15.500937 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab3c62-662b-44ba-a5df-37efae591a6d None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:15.505504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:15.506130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:15.506403 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:15.506704 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98 admin admin] PATH_INFO: `/v3/projects/812682f88245451ca355bce43910da9c` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:15.507870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=812682f88245451ca355bce43910da9c)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:15.509739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:15.554558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '812682f88245451ca355bce43910da9c', 'request_id': 'req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:15.561882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '812682f88245451ca355bce43910da9c', 'request_id': 'req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:15.568058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '812682f88245451ca355bce43910da9c', 'request_id': 'req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:15.578813 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98 admin admin] The token cache is being invalidate because project 812682f88245451ca355bce43910da9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:40:15.579094 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:15.579714 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:15.581162 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1287/2585] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:40:15 2022] DELETE /identity/v3/projects/812682f88245451ca355bce43910da9c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:15.585111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdff98-c9ef-44c0-adcc-dec427e4b3d0 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:15.595764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdff98-c9ef-44c0-adcc-dec427e4b3d0 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:15.651198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cc6c0-821c-43bb-9b1f-29d72f893bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:15.652476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc6c0-821c-43bb-9b1f-29d72f893bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:15.652756 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc6c0-821c-43bb-9b1f-29d72f893bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:15.653029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc6c0-821c-43bb-9b1f-29d72f893bd3 admin admin] PATH_INFO: `/v3/users/292db929e9a44035b0928d28c5e4c8d6` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:15.654153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cc6c0-821c-43bb-9b1f-29d72f893bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=292db929e9a44035b0928d28c5e4c8d6)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:15.656114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cc6c0-821c-43bb-9b1f-29d72f893bd3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:15.702211 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f18cc6c0-821c-43bb-9b1f-29d72f893bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '292db929e9a44035b0928d28c5e4c8d6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:15.702841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f18cc6c0-821c-43bb-9b1f-29d72f893bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '292db929e9a44035b0928d28c5e4c8d6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:15.710168 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f18cc6c0-821c-43bb-9b1f-29d72f893bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '292db929e9a44035b0928d28c5e4c8d6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:15.722591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f18cc6c0-821c-43bb-9b1f-29d72f893bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '292db929e9a44035b0928d28c5e4c8d6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:15.729202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f18cc6c0-821c-43bb-9b1f-29d72f893bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '292db929e9a44035b0928d28c5e4c8d6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:15.735071 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1299/2586] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:40:15 2022] DELETE /identity/v3/users/292db929e9a44035b0928d28c5e4c8d6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:16.006341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:16.007845 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:16.021907 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a1fbc-13ae-46dd-b5bf-0aca89493b98 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:16.079786 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21732c39-0bb8-4d71-9392-7a4750e93de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:16.080495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21732c39-0bb8-4d71-9392-7a4750e93de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:16.080676 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21732c39-0bb8-4d71-9392-7a4750e93de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:16.080941 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21732c39-0bb8-4d71-9392-7a4750e93de0 admin admin] PATH_INFO: `/v3/projects/8dcad64daf734c4e9fe10adb6fe7a46d` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:16.082050 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21732c39-0bb8-4d71-9392-7a4750e93de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dcad64daf734c4e9fe10adb6fe7a46d)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:16.083993 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21732c39-0bb8-4d71-9392-7a4750e93de0 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:16.127918 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-21732c39-0bb8-4d71-9392-7a4750e93de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dcad64daf734c4e9fe10adb6fe7a46d', 'request_id': 'req-21732c39-0bb8-4d71-9392-7a4750e93de0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:16.134936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-21732c39-0bb8-4d71-9392-7a4750e93de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dcad64daf734c4e9fe10adb6fe7a46d', 'request_id': 'req-21732c39-0bb8-4d71-9392-7a4750e93de0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:16.141516 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-21732c39-0bb8-4d71-9392-7a4750e93de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dcad64daf734c4e9fe10adb6fe7a46d', 'request_id': 'req-21732c39-0bb8-4d71-9392-7a4750e93de0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:16.147768 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:16.152609 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-21732c39-0bb8-4d71-9392-7a4750e93de0 admin admin] The token cache is being invalidate because project 8dcad64daf734c4e9fe10adb6fe7a46d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:40:16.153117 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-21732c39-0bb8-4d71-9392-7a4750e93de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:16.154227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-21732c39-0bb8-4d71-9392-7a4750e93de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:16.155804 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1288/2587] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:40:16 2022] DELETE /identity/v3/projects/8dcad64daf734c4e9fe10adb6fe7a46d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:16.160729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dbeb5-fe0f-4d3d-9c6e-13d6469f4d9e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:16.161214 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dbeb5-fe0f-4d3d-9c6e-13d6469f4d9e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:16.161335 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dbeb5-fe0f-4d3d-9c6e-13d6469f4d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:16.180750 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4c8dbeb5-fe0f-4d3d-9c6e-13d6469f4d9e None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:16.181930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4c8dbeb5-fe0f-4d3d-9c6e-13d6469f4d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:16.210197 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:16.240843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1300/2588] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:16.249318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddf969-ddb9-44cd-bbe8-bbca35ec134c None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:16.249604 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddf969-ddb9-44cd-bbe8-bbca35ec134c None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:16.249881 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddf969-ddb9-44cd-bbe8-bbca35ec134c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:16.269128 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-adddf969-ddb9-44cd-bbe8-bbca35ec134c None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:16.270330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-adddf969-ddb9-44cd-bbe8-bbca35ec134c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:16.278148 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1289/2589] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:16.282247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8dbeb5-fe0f-4d3d-9c6e-13d6469f4d9e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:16.292371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8dbeb5-fe0f-4d3d-9c6e-13d6469f4d9e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:16.296968 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871ceea-6c67-4704-b97f-d110bb8a7ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:16.297555 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871ceea-6c67-4704-b97f-d110bb8a7ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:16.297834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871ceea-6c67-4704-b97f-d110bb8a7ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:16.298106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871ceea-6c67-4704-b97f-d110bb8a7ca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:16.298801 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871ceea-6c67-4704-b97f-d110bb8a7ca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:40:16.299110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871ceea-6c67-4704-b97f-d110bb8a7ca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:16.300682 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871ceea-6c67-4704-b97f-d110bb8a7ca3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:16.312594 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1301/2590] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:40:16.316712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddf969-ddb9-44cd-bbe8-bbca35ec134c None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:16.325780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddf969-ddb9-44cd-bbe8-bbca35ec134c None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:16.330632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c24ab0-e92c-4913-b9ff-c49aca51f5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:16.331219 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c24ab0-e92c-4913-b9ff-c49aca51f5cf admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:16.331493 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c24ab0-e92c-4913-b9ff-c49aca51f5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:16.331760 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c24ab0-e92c-4913-b9ff-c49aca51f5cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:16.332389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c24ab0-e92c-4913-b9ff-c49aca51f5cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:16.334232 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c24ab0-e92c-4913-b9ff-c49aca51f5cf admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:16.361175 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1290/2591] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:40:16 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:40:16.365532 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871ceea-6c67-4704-b97f-d110bb8a7ca3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:16.376064 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871ceea-6c67-4704-b97f-d110bb8a7ca3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:16.430368 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc19db5-c4fa-40b8-ba81-e931d2df2d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:16.430992 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc19db5-c4fa-40b8-ba81-e931d2df2d06 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:16.431283 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc19db5-c4fa-40b8-ba81-e931d2df2d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:16.431579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc19db5-c4fa-40b8-ba81-e931d2df2d06 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:16.432211 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc19db5-c4fa-40b8-ba81-e931d2df2d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:16.434754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc19db5-c4fa-40b8-ba81-e931d2df2d06 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:16.456176 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1302/2592] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:40:16 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:40:16.460631 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c24ab0-e92c-4913-b9ff-c49aca51f5cf admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:16.471002 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c24ab0-e92c-4913-b9ff-c49aca51f5cf admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:16.476479 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09fd59-3adf-4c4b-b0a6-e2c82372aed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:16.477444 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09fd59-3adf-4c4b-b0a6-e2c82372aed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:16.477891 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09fd59-3adf-4c4b-b0a6-e2c82372aed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:16.478348 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09fd59-3adf-4c4b-b0a6-e2c82372aed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:16.479989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09fd59-3adf-4c4b-b0a6-e2c82372aed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:16.481840 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09fd59-3adf-4c4b-b0a6-e2c82372aed3 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:16.491769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1291/2593] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:40:16.496421 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc19db5-c4fa-40b8-ba81-e931d2df2d06 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:16.506270 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc19db5-c4fa-40b8-ba81-e931d2df2d06 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:16.510885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c45a26-2e18-49d9-8851-3b0723decfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:16.511477 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c45a26-2e18-49d9-8851-3b0723decfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:16.511758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c45a26-2e18-49d9-8851-3b0723decfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:16.512029 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c45a26-2e18-49d9-8851-3b0723decfb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:16.512666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c45a26-2e18-49d9-8851-3b0723decfb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:16.514238 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c45a26-2e18-49d9-8851-3b0723decfb3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:16.524527 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1303/2594] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:40:16.528901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09fd59-3adf-4c4b-b0a6-e2c82372aed3 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:16.538450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09fd59-3adf-4c4b-b0a6-e2c82372aed3 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:16.543566 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e374afb-fd61-4e42-9e0f-60d54a106563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:16.544192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e374afb-fd61-4e42-9e0f-60d54a106563 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:16.544465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e374afb-fd61-4e42-9e0f-60d54a106563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:16.544736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e374afb-fd61-4e42-9e0f-60d54a106563 admin admin] PATH_INFO: `/v3/projects/70a94515407b4f6f9f7f354003f34bab/users/ed4c25adc2cc4d80809acd14ff29fb94/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:16.558645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e374afb-fd61-4e42-9e0f-60d54a106563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a94515407b4f6f9f7f354003f34bab, user_id=ed4c25adc2cc4d80809acd14ff29fb94, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:16.561226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e374afb-fd61-4e42-9e0f-60d54a106563 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:16.573401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1292/2595] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:40:16 2022] PUT /identity/v3/projects/70a94515407b4f6f9f7f354003f34bab/users/ed4c25adc2cc4d80809acd14ff29fb94/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:16.578794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81452cec-67a2-401f-960d-96e437355596 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:16.579082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81452cec-67a2-401f-960d-96e437355596 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:16.579359 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81452cec-67a2-401f-960d-96e437355596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:16.598184 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-81452cec-67a2-401f-960d-96e437355596 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:16.599408 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-81452cec-67a2-401f-960d-96e437355596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:16.657070 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1304/2596] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:16.666517 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e374afb-fd61-4e42-9e0f-60d54a106563 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:16.668921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-3e374afb-fd61-4e42-9e0f-60d54a106563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:16.723489 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e374afb-fd61-4e42-9e0f-60d54a106563 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:16.726979 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0f9b5-c928-404c-993c-0bda71c2b092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:16.727568 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0f9b5-c928-404c-993c-0bda71c2b092 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:16.727843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0f9b5-c928-404c-993c-0bda71c2b092 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:16.728108 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0f9b5-c928-404c-993c-0bda71c2b092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:16.737441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0f9b5-c928-404c-993c-0bda71c2b092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:16.738873 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0f9b5-c928-404c-993c-0bda71c2b092 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:16.747947 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1293/2597] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:17.366640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d581fb-f03c-4a6f-a77e-08e5920ac783 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:17.367189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d581fb-f03c-4a6f-a77e-08e5920ac783 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:17.367189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d581fb-f03c-4a6f-a77e-08e5920ac783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:17.396749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d7d581fb-f03c-4a6f-a77e-08e5920ac783 None None] MFA Rules not processed for user `ed4c25adc2cc4d80809acd14ff29fb94`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:17.397952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d7d581fb-f03c-4a6f-a77e-08e5920ac783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:17.426548 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:17.464590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1305/2598] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:17.469244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0f9b5-c928-404c-993c-0bda71c2b092 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:17.481106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0f9b5-c928-404c-993c-0bda71c2b092 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:17.487124 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f708d-c90f-4967-859c-4254d5e0a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:17.487722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f708d-c90f-4967-859c-4254d5e0a6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:17.488000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f708d-c90f-4967-859c-4254d5e0a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:17.488289 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f708d-c90f-4967-859c-4254d5e0a6b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:17.488916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f708d-c90f-4967-859c-4254d5e0a6b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:17.490812 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f708d-c90f-4967-859c-4254d5e0a6b6 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:17.518442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1294/2599] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:40:17 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:40:17.522601 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d581fb-f03c-4a6f-a77e-08e5920ac783 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:17.533323 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d581fb-f03c-4a6f-a77e-08e5920ac783 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:17.592082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f51e71-0446-4cb3-aa67-2b272e2ef42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:17.592607 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f51e71-0446-4cb3-aa67-2b272e2ef42e admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:17.592882 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f51e71-0446-4cb3-aa67-2b272e2ef42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:17.593149 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f51e71-0446-4cb3-aa67-2b272e2ef42e admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:17.593767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f51e71-0446-4cb3-aa67-2b272e2ef42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:17.595707 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f51e71-0446-4cb3-aa67-2b272e2ef42e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:17.616590 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1306/2600] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:40:17 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:40:17.621178 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f708d-c90f-4967-859c-4254d5e0a6b6 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:17.632711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f708d-c90f-4967-859c-4254d5e0a6b6 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:17.637930 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db168f69-0374-45fd-9c56-a00099038ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:17.638523 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db168f69-0374-45fd-9c56-a00099038ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:17.638832 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db168f69-0374-45fd-9c56-a00099038ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:17.639102 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db168f69-0374-45fd-9c56-a00099038ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:17.639735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db168f69-0374-45fd-9c56-a00099038ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:17.641295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db168f69-0374-45fd-9c56-a00099038ac0 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:17.651935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1295/2601] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:40:17.656113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f51e71-0446-4cb3-aa67-2b272e2ef42e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:17.666157 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f51e71-0446-4cb3-aa67-2b272e2ef42e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:17.671629 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcd7e1-012f-4276-942f-9377d5109241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:17.672329 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcd7e1-012f-4276-942f-9377d5109241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:17.672611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcd7e1-012f-4276-942f-9377d5109241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:17.672888 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcd7e1-012f-4276-942f-9377d5109241 admin admin] PATH_INFO: `/v3/projects/02cf888cc8574d9b87e65f038d299bbb/users/fddeb77fc76744e692c29f43e8b4badc/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:17.689014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcd7e1-012f-4276-942f-9377d5109241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02cf888cc8574d9b87e65f038d299bbb, user_id=fddeb77fc76744e692c29f43e8b4badc, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:17.691686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcd7e1-012f-4276-942f-9377d5109241 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:17.704783 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1307/2602] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:40:17 2022] PUT /identity/v3/projects/02cf888cc8574d9b87e65f038d299bbb/users/fddeb77fc76744e692c29f43e8b4badc/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:17.708702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db168f69-0374-45fd-9c56-a00099038ac0 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:17.720290 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db168f69-0374-45fd-9c56-a00099038ac0 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:17.776543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932b42e-fd35-4c07-b43c-64033998983e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:17.777142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932b42e-fd35-4c07-b43c-64033998983e admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:17.777419 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932b42e-fd35-4c07-b43c-64033998983e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:17.777692 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932b42e-fd35-4c07-b43c-64033998983e admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:17.778328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932b42e-fd35-4c07-b43c-64033998983e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:17.779939 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932b42e-fd35-4c07-b43c-64033998983e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:17.784897 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:17.790679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1296/2603] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:40:17.795502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcd7e1-012f-4276-942f-9377d5109241 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:17.805662 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcd7e1-012f-4276-942f-9377d5109241 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:17.810926 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f942f51-42f1-474d-ac74-2e9c9c5e0594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:17.811559 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f942f51-42f1-474d-ac74-2e9c9c5e0594 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:17.811837 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f942f51-42f1-474d-ac74-2e9c9c5e0594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:17.812109 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f942f51-42f1-474d-ac74-2e9c9c5e0594 admin admin] PATH_INFO: `/v3/projects/02cf888cc8574d9b87e65f038d299bbb/users/fddeb77fc76744e692c29f43e8b4badc/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:17.814009 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f942f51-42f1-474d-ac74-2e9c9c5e0594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02cf888cc8574d9b87e65f038d299bbb, user_id=fddeb77fc76744e692c29f43e8b4badc, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:17.816933 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f942f51-42f1-474d-ac74-2e9c9c5e0594 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:17.827645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1308/2604] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:40:17 2022] PUT /identity/v3/projects/02cf888cc8574d9b87e65f038d299bbb/users/fddeb77fc76744e692c29f43e8b4badc/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:40:18.472084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6e0cd-4a93-49ac-96da-11b114f619e0 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:18.472666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6e0cd-4a93-49ac-96da-11b114f619e0 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:18.472666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6e0cd-4a93-49ac-96da-11b114f619e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:18.506953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-ada6e0cd-4a93-49ac-96da-11b114f619e0 None None] MFA Rules not processed for user `fddeb77fc76744e692c29f43e8b4badc`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:18.508512 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ada6e0cd-4a93-49ac-96da-11b114f619e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:18.592026 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1297/2605] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:40:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:18.602404 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf24eed-7816-4f40-8eda-26f849a38764 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:18.602950 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf24eed-7816-4f40-8eda-26f849a38764 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:18.603052 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf24eed-7816-4f40-8eda-26f849a38764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:18.622330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-cdf24eed-7816-4f40-8eda-26f849a38764 None None] MFA Rules not processed for user `ed4c25adc2cc4d80809acd14ff29fb94`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:18.623584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cdf24eed-7816-4f40-8eda-26f849a38764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:18.678775 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1309/2606] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:40:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:18.692305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6e0cd-4a93-49ac-96da-11b114f619e0 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:18.694079 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ada6e0cd-4a93-49ac-96da-11b114f619e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:18.767092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6e0cd-4a93-49ac-96da-11b114f619e0 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:18.772576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d88e70-7823-438f-b49b-6d2732ed1bd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:18.773170 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d88e70-7823-438f-b49b-6d2732ed1bd7 service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:18.773449 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d88e70-7823-438f-b49b-6d2732ed1bd7 service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:18.773724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d88e70-7823-438f-b49b-6d2732ed1bd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:18.781985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d88e70-7823-438f-b49b-6d2732ed1bd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:18.783571 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d88e70-7823-438f-b49b-6d2732ed1bd7 service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:18.792128 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1298/2607] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:19.018843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf24eed-7816-4f40-8eda-26f849a38764 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:19.020237 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cdf24eed-7816-4f40-8eda-26f849a38764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:19.049694 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:19.077154 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf24eed-7816-4f40-8eda-26f849a38764 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:19.080732 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630e79d-5e5f-43a4-a29e-14b6f14be18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:19.081328 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630e79d-5e5f-43a4-a29e-14b6f14be18c service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:19.081605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630e79d-5e5f-43a4-a29e-14b6f14be18c service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:19.081875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630e79d-5e5f-43a4-a29e-14b6f14be18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:19.083630 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f630e79d-5e5f-43a4-a29e-14b6f14be18c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:19.092993 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630e79d-5e5f-43a4-a29e-14b6f14be18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:19.094394 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630e79d-5e5f-43a4-a29e-14b6f14be18c service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:19.102246 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1310/2608] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:28.788222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=68 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:29.098691 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=14 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:32.770079 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d88e70-7823-438f-b49b-6d2732ed1bd7 service nova] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:32.771597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-26d88e70-7823-438f-b49b-6d2732ed1bd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:32.854336 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d88e70-7823-438f-b49b-6d2732ed1bd7 service nova] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:32.857910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a404de-3596-482e-8743-b84b965f00cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:32.858501 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a404de-3596-482e-8743-b84b965f00cb service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:32.858834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a404de-3596-482e-8743-b84b965f00cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:32.859105 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a404de-3596-482e-8743-b84b965f00cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:32.888500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a404de-3596-482e-8743-b84b965f00cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:32.889876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a404de-3596-482e-8743-b84b965f00cb service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:32.899185 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1299/2609] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:42.895065 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=48 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:52.092883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630e79d-5e5f-43a4-a29e-14b6f14be18c service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:52.094335 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f630e79d-5e5f-43a4-a29e-14b6f14be18c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:52.236842 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630e79d-5e5f-43a4-a29e-14b6f14be18c service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:52.242229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f180011-1343-4cf7-a95e-c1959f97efde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae8db0856ed44088f0bd3cb93701de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:52.242853 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f180011-1343-4cf7-a95e-c1959f97efde service placement] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:52.243131 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f180011-1343-4cf7-a95e-c1959f97efde service placement] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:52.243398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f180011-1343-4cf7-a95e-c1959f97efde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:52.245906 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0f180011-1343-4cf7-a95e-c1959f97efde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:52.257648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f180011-1343-4cf7-a95e-c1959f97efde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:52.259263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f180011-1343-4cf7-a95e-c1959f97efde service placement] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:52.269542 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1311/2610] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:52.666224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a404de-3596-482e-8743-b84b965f00cb service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:52.750923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a404de-3596-482e-8743-b84b965f00cb service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:52.755478 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb5e38-c495-4d8e-9947-3927cfb10de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:52.756091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb5e38-c495-4d8e-9947-3927cfb10de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:52.756362 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb5e38-c495-4d8e-9947-3927cfb10de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:52.756625 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb5e38-c495-4d8e-9947-3927cfb10de5 admin admin] PATH_INFO: `/v3/users/ed4c25adc2cc4d80809acd14ff29fb94` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:52.757724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb5e38-c495-4d8e-9947-3927cfb10de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed4c25adc2cc4d80809acd14ff29fb94)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:52.759646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb5e38-c495-4d8e-9947-3927cfb10de5 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:52.805352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-bbcb5e38-c495-4d8e-9947-3927cfb10de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed4c25adc2cc4d80809acd14ff29fb94'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:52.805938 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-bbcb5e38-c495-4d8e-9947-3927cfb10de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed4c25adc2cc4d80809acd14ff29fb94'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:52.818117 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-bbcb5e38-c495-4d8e-9947-3927cfb10de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed4c25adc2cc4d80809acd14ff29fb94'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:52.826786 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-bbcb5e38-c495-4d8e-9947-3927cfb10de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed4c25adc2cc4d80809acd14ff29fb94'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:52.833559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-bbcb5e38-c495-4d8e-9947-3927cfb10de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed4c25adc2cc4d80809acd14ff29fb94'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:52.839294 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1300/2611] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:40:52 2022] DELETE /identity/v3/users/ed4c25adc2cc4d80809acd14ff29fb94 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:53.005658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f180011-1343-4cf7-a95e-c1959f97efde service placement] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:53.020369 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f180011-1343-4cf7-a95e-c1959f97efde service placement] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:53.075519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d589a6-863b-44a9-afd7-18e90281f647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:53.076310 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d589a6-863b-44a9-afd7-18e90281f647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:53.076582 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d589a6-863b-44a9-afd7-18e90281f647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:53.076847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d589a6-863b-44a9-afd7-18e90281f647 admin admin] PATH_INFO: `/v3/projects/70a94515407b4f6f9f7f354003f34bab` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:53.077943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d589a6-863b-44a9-afd7-18e90281f647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a94515407b4f6f9f7f354003f34bab)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:53.079842 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d589a6-863b-44a9-afd7-18e90281f647 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:53.122575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:53.126982 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c4d589a6-863b-44a9-afd7-18e90281f647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a94515407b4f6f9f7f354003f34bab', 'request_id': 'req-c4d589a6-863b-44a9-afd7-18e90281f647'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:53.133261 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c4d589a6-863b-44a9-afd7-18e90281f647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a94515407b4f6f9f7f354003f34bab', 'request_id': 'req-c4d589a6-863b-44a9-afd7-18e90281f647'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:53.138796 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c4d589a6-863b-44a9-afd7-18e90281f647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a94515407b4f6f9f7f354003f34bab', 'request_id': 'req-c4d589a6-863b-44a9-afd7-18e90281f647'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:53.162631 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c4d589a6-863b-44a9-afd7-18e90281f647 admin admin] The token cache is being invalidate because project 70a94515407b4f6f9f7f354003f34bab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:40:53.162930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c4d589a6-863b-44a9-afd7-18e90281f647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:53.163552 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c4d589a6-863b-44a9-afd7-18e90281f647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:53.165026 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1312/2612] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:40:53 2022] DELETE /identity/v3/projects/70a94515407b4f6f9f7f354003f34bab => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:53.169486 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb5e38-c495-4d8e-9947-3927cfb10de5 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:53.170958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-bbcb5e38-c495-4d8e-9947-3927cfb10de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:53.183589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb5e38-c495-4d8e-9947-3927cfb10de5 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:53.238573 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e167b36-ec73-426c-a300-c76ed643d5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:53.239225 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e167b36-ec73-426c-a300-c76ed643d5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:53.239502 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e167b36-ec73-426c-a300-c76ed643d5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:53.239772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e167b36-ec73-426c-a300-c76ed643d5d3 admin admin] PATH_INFO: `/v3/users/fddeb77fc76744e692c29f43e8b4badc` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:53.240900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e167b36-ec73-426c-a300-c76ed643d5d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fddeb77fc76744e692c29f43e8b4badc)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:53.242814 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e167b36-ec73-426c-a300-c76ed643d5d3 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:53.245530 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:53.289110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1e167b36-ec73-426c-a300-c76ed643d5d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fddeb77fc76744e692c29f43e8b4badc'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:53.289743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1e167b36-ec73-426c-a300-c76ed643d5d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fddeb77fc76744e692c29f43e8b4badc'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:53.301641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1e167b36-ec73-426c-a300-c76ed643d5d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fddeb77fc76744e692c29f43e8b4badc'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:53.309478 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1e167b36-ec73-426c-a300-c76ed643d5d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fddeb77fc76744e692c29f43e8b4badc'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:53.316556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1e167b36-ec73-426c-a300-c76ed643d5d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fddeb77fc76744e692c29f43e8b4badc'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:53.322342 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1301/2613] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:40:53 2022] DELETE /identity/v3/users/fddeb77fc76744e692c29f43e8b4badc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:53.493874 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d589a6-863b-44a9-afd7-18e90281f647 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:53.495885 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c4d589a6-863b-44a9-afd7-18e90281f647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:53.513093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d589a6-863b-44a9-afd7-18e90281f647 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:53.569220 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae8c5c-3211-4296-9490-358062f5c2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:53.569841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae8c5c-3211-4296-9490-358062f5c2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:53.570121 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae8c5c-3211-4296-9490-358062f5c2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:53.570396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae8c5c-3211-4296-9490-358062f5c2d5 admin admin] PATH_INFO: `/v3/projects/02cf888cc8574d9b87e65f038d299bbb` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:53.571530 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae8c5c-3211-4296-9490-358062f5c2d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02cf888cc8574d9b87e65f038d299bbb)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:53.573963 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae8c5c-3211-4296-9490-358062f5c2d5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:53.619057 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a9ae8c5c-3211-4296-9490-358062f5c2d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02cf888cc8574d9b87e65f038d299bbb', 'request_id': 'req-a9ae8c5c-3211-4296-9490-358062f5c2d5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:53.626639 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a9ae8c5c-3211-4296-9490-358062f5c2d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02cf888cc8574d9b87e65f038d299bbb', 'request_id': 'req-a9ae8c5c-3211-4296-9490-358062f5c2d5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:53.632114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a9ae8c5c-3211-4296-9490-358062f5c2d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02cf888cc8574d9b87e65f038d299bbb', 'request_id': 'req-a9ae8c5c-3211-4296-9490-358062f5c2d5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:53.644848 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a9ae8c5c-3211-4296-9490-358062f5c2d5 admin admin] The token cache is being invalidate because project 02cf888cc8574d9b87e65f038d299bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:40:53.645140 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a9ae8c5c-3211-4296-9490-358062f5c2d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:53.645755 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a9ae8c5c-3211-4296-9490-358062f5c2d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:53.647272 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1313/2614] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:40:53 2022] DELETE /identity/v3/projects/02cf888cc8574d9b87e65f038d299bbb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:53.652062 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1add0b7-5d11-4301-81f4-b605f49df0bb None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:53.652355 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1add0b7-5d11-4301-81f4-b605f49df0bb None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:53.652632 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1add0b7-5d11-4301-81f4-b605f49df0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:53.708991 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-c1add0b7-5d11-4301-81f4-b605f49df0bb None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:53.710200 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c1add0b7-5d11-4301-81f4-b605f49df0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:53.769189 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1302/2615] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:53.833173 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6a92a-03d8-49e5-b873-68186fed9908 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:53.833455 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6a92a-03d8-49e5-b873-68186fed9908 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:53.833729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6a92a-03d8-49e5-b873-68186fed9908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:53.853500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-66a6a92a-03d8-49e5-b873-68186fed9908 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:53.855418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-66a6a92a-03d8-49e5-b873-68186fed9908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:53.863150 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1314/2616] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:53.867367 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1add0b7-5d11-4301-81f4-b605f49df0bb None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:53.877960 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1add0b7-5d11-4301-81f4-b605f49df0bb None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:53.882635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d611f5-b187-488d-91be-f8e856268b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:53.883425 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d611f5-b187-488d-91be-f8e856268b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:53.883705 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d611f5-b187-488d-91be-f8e856268b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:53.883975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d611f5-b187-488d-91be-f8e856268b22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:53.884628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d611f5-b187-488d-91be-f8e856268b22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:40:53.884928 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d611f5-b187-488d-91be-f8e856268b22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:53.886507 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d611f5-b187-488d-91be-f8e856268b22 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:53.898468 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1303/2617] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:40:53.902798 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6a92a-03d8-49e5-b873-68186fed9908 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:53.912334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6a92a-03d8-49e5-b873-68186fed9908 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:53.917556 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cfe9f-c427-495f-808e-78d5e3a872f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:53.918155 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cfe9f-c427-495f-808e-78d5e3a872f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:53.918434 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cfe9f-c427-495f-808e-78d5e3a872f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:53.918736 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cfe9f-c427-495f-808e-78d5e3a872f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:53.919389 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cfe9f-c427-495f-808e-78d5e3a872f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:53.921322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cfe9f-c427-495f-808e-78d5e3a872f1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:53.954472 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1315/2618] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:40:53 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:40:53.955975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d611f5-b187-488d-91be-f8e856268b22 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:53.966157 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d611f5-b187-488d-91be-f8e856268b22 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:53.999141 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:54.023313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1ee66-2376-474f-a658-0091e9e5c3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:54.023902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1ee66-2376-474f-a658-0091e9e5c3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:54.024175 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1ee66-2376-474f-a658-0091e9e5c3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:54.024443 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1ee66-2376-474f-a658-0091e9e5c3a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:54.025056 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1ee66-2376-474f-a658-0091e9e5c3a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:54.027477 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1ee66-2376-474f-a658-0091e9e5c3a9 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:54.048127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1304/2619] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:40:53 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:40:54.052210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cfe9f-c427-495f-808e-78d5e3a872f1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:54.062392 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cfe9f-c427-495f-808e-78d5e3a872f1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:54.067129 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee71b7-4270-4905-b03d-ac16f715ceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:54.067723 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee71b7-4270-4905-b03d-ac16f715ceae admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:54.067988 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee71b7-4270-4905-b03d-ac16f715ceae admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:54.068256 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee71b7-4270-4905-b03d-ac16f715ceae admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:54.068914 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee71b7-4270-4905-b03d-ac16f715ceae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:54.070483 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee71b7-4270-4905-b03d-ac16f715ceae admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:54.082928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1316/2620] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:40:54.086816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1ee66-2376-474f-a658-0091e9e5c3a9 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:54.098040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1ee66-2376-474f-a658-0091e9e5c3a9 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:54.102591 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65536230-e169-4755-a4b0-243a57e85eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:54.103346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65536230-e169-4755-a4b0-243a57e85eee admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:54.103626 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65536230-e169-4755-a4b0-243a57e85eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:54.104435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65536230-e169-4755-a4b0-243a57e85eee admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:54.105091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65536230-e169-4755-a4b0-243a57e85eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:54.106678 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65536230-e169-4755-a4b0-243a57e85eee admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:54.116335 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1305/2621] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:40:54.120878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee71b7-4270-4905-b03d-ac16f715ceae admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:54.130876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee71b7-4270-4905-b03d-ac16f715ceae admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:54.136085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c0adb-ce7d-4e6b-8eb5-628f5b4e633b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:54.137111 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c0adb-ce7d-4e6b-8eb5-628f5b4e633b admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:54.137632 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c0adb-ce7d-4e6b-8eb5-628f5b4e633b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:54.138091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c0adb-ce7d-4e6b-8eb5-628f5b4e633b admin admin] PATH_INFO: `/v3/projects/cdbb36f5e30d44968004139dfed7e466/users/5e4577328f1241258b6f4c9a24a43fc2/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:54.148561 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:54.156515 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c0adb-ce7d-4e6b-8eb5-628f5b4e633b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdbb36f5e30d44968004139dfed7e466, user_id=5e4577328f1241258b6f4c9a24a43fc2, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:54.159235 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c0adb-ce7d-4e6b-8eb5-628f5b4e633b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:54.172260 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1317/2622] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:40:54 2022] PUT /identity/v3/projects/cdbb36f5e30d44968004139dfed7e466/users/5e4577328f1241258b6f4c9a24a43fc2/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:54.182664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ef85b-8402-4f60-9f66-36ab765bedb8 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:54.182970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ef85b-8402-4f60-9f66-36ab765bedb8 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:54.183234 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ef85b-8402-4f60-9f66-36ab765bedb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:54.210846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-890ef85b-8402-4f60-9f66-36ab765bedb8 None None] MFA Rules not processed for user `5e4577328f1241258b6f4c9a24a43fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:54.212034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-890ef85b-8402-4f60-9f66-36ab765bedb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:54.273357 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1306/2623] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:40:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:54.284376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c0adb-ce7d-4e6b-8eb5-628f5b4e633b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:54.286077 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d49c0adb-ce7d-4e6b-8eb5-628f5b4e633b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:54.364705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c0adb-ce7d-4e6b-8eb5-628f5b4e633b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:54.368379 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea8890-11be-49cd-8ab4-662ff81b9a07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:54.368975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8890-11be-49cd-8ab4-662ff81b9a07 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:54.369254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8890-11be-49cd-8ab4-662ff81b9a07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:54.370079 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8890-11be-49cd-8ab4-662ff81b9a07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:54.378143 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea8890-11be-49cd-8ab4-662ff81b9a07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:54.379578 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea8890-11be-49cd-8ab4-662ff81b9a07 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:54.392373 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1318/2624] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:55.612936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b1696-726f-445b-b4df-df68b942b660 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:55.613460 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b1696-726f-445b-b4df-df68b942b660 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:55.613460 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b1696-726f-445b-b4df-df68b942b660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:55.644280 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-c81b1696-726f-445b-b4df-df68b942b660 None None] MFA Rules not processed for user `cd0dbb2c140946f69c3f508b4184e998`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:55.645489 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c81b1696-726f-445b-b4df-df68b942b660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:55.707528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1307/2625] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Sep 1 16:40:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:55.756943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea8890-11be-49cd-8ab4-662ff81b9a07 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:55.758581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-11ea8890-11be-49cd-8ab4-662ff81b9a07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:55.833753 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea8890-11be-49cd-8ab4-662ff81b9a07 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:55.839495 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f0577-5ff9-48fd-9e61-926a09f95e7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f7afa63815643f580c91df4e4c3bafc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:55.840097 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f0577-5ff9-48fd-9e61-926a09f95e7b service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:55.840374 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f0577-5ff9-48fd-9e61-926a09f95e7b service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:55.840640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f0577-5ff9-48fd-9e61-926a09f95e7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:55.848992 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f0577-5ff9-48fd-9e61-926a09f95e7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:55.850574 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f0577-5ff9-48fd-9e61-926a09f95e7b service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:55.859556 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1319/2626] 10.222.0.71 () {60 vars in 1384 bytes} [Thu Sep 1 16:40:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:05.700278 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:05.856068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=72,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:08.129107 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b1696-726f-445b-b4df-df68b942b660 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:08.206381 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b1696-726f-445b-b4df-df68b942b660 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:08.213026 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d48de-ecd1-4a49-8042-0bf25de6884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:08.214036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d48de-ecd1-4a49-8042-0bf25de6884a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:08.214036 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d48de-ecd1-4a49-8042-0bf25de6884a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:08.214441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d48de-ecd1-4a49-8042-0bf25de6884a admin admin] PATH_INFO: `/v3/users/5e4577328f1241258b6f4c9a24a43fc2` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:08.216367 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d48de-ecd1-4a49-8042-0bf25de6884a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e4577328f1241258b6f4c9a24a43fc2)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:08.218948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d48de-ecd1-4a49-8042-0bf25de6884a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:08.296406 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-866d48de-ecd1-4a49-8042-0bf25de6884a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e4577328f1241258b6f4c9a24a43fc2'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:08.297433 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-866d48de-ecd1-4a49-8042-0bf25de6884a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e4577328f1241258b6f4c9a24a43fc2'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:08.312150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-866d48de-ecd1-4a49-8042-0bf25de6884a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e4577328f1241258b6f4c9a24a43fc2'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:08.321201 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-866d48de-ecd1-4a49-8042-0bf25de6884a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e4577328f1241258b6f4c9a24a43fc2'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:08.331934 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-866d48de-ecd1-4a49-8042-0bf25de6884a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e4577328f1241258b6f4c9a24a43fc2'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:08.343928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f467a-9b2a-4e4f-9b2a-a156d51672ac None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:08.344488 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f467a-9b2a-4e4f-9b2a-a156d51672ac None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:08.344714 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f467a-9b2a-4e4f-9b2a-a156d51672ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:08.347615 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1308/2627] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:41:08 2022] DELETE /identity/v3/users/5e4577328f1241258b6f4c9a24a43fc2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:08.366267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-738f467a-9b2a-4e4f-9b2a-a156d51672ac None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:08.367650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-738f467a-9b2a-4e4f-9b2a-a156d51672ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:08.451777 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1320/2628] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:08.462983 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d48de-ecd1-4a49-8042-0bf25de6884a admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:08.465127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-866d48de-ecd1-4a49-8042-0bf25de6884a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:08.567027 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d48de-ecd1-4a49-8042-0bf25de6884a admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:08.571209 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf780de5-9ed7-4f8d-9f6f-1d1d4d5d9010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:08.571987 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf780de5-9ed7-4f8d-9f6f-1d1d4d5d9010 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:08.572275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf780de5-9ed7-4f8d-9f6f-1d1d4d5d9010 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:08.572616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf780de5-9ed7-4f8d-9f6f-1d1d4d5d9010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:08.583867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf780de5-9ed7-4f8d-9f6f-1d1d4d5d9010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:08.585379 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf780de5-9ed7-4f8d-9f6f-1d1d4d5d9010 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:08.596758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1309/2629] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:08.898364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f467a-9b2a-4e4f-9b2a-a156d51672ac None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:08.900398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-738f467a-9b2a-4e4f-9b2a-a156d51672ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:08.922088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f467a-9b2a-4e4f-9b2a-a156d51672ac None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:08.927153 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5553f2e-fcec-4d29-aad2-95c905d33a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:08.927697 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5553f2e-fcec-4d29-aad2-95c905d33a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:08.927978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5553f2e-fcec-4d29-aad2-95c905d33a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:08.928260 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5553f2e-fcec-4d29-aad2-95c905d33a0e admin admin] PATH_INFO: `/v3/projects/cdbb36f5e30d44968004139dfed7e466` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:08.931443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5553f2e-fcec-4d29-aad2-95c905d33a0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdbb36f5e30d44968004139dfed7e466)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:08.934394 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5553f2e-fcec-4d29-aad2-95c905d33a0e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:08.996605 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b5553f2e-fcec-4d29-aad2-95c905d33a0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdbb36f5e30d44968004139dfed7e466', 'request_id': 'req-b5553f2e-fcec-4d29-aad2-95c905d33a0e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:09.007316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b5553f2e-fcec-4d29-aad2-95c905d33a0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdbb36f5e30d44968004139dfed7e466', 'request_id': 'req-b5553f2e-fcec-4d29-aad2-95c905d33a0e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:09.015003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b5553f2e-fcec-4d29-aad2-95c905d33a0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdbb36f5e30d44968004139dfed7e466', 'request_id': 'req-b5553f2e-fcec-4d29-aad2-95c905d33a0e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:09.031254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b5553f2e-fcec-4d29-aad2-95c905d33a0e admin admin] The token cache is being invalidate because project cdbb36f5e30d44968004139dfed7e466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:41:09.031564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b5553f2e-fcec-4d29-aad2-95c905d33a0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:09.032322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b5553f2e-fcec-4d29-aad2-95c905d33a0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:09.035592 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1321/2630] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:41:08 2022] DELETE /identity/v3/projects/cdbb36f5e30d44968004139dfed7e466 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:09.038974 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d597c0c-1800-44f6-bd18-40b1476e4085 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:09.039260 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d597c0c-1800-44f6-bd18-40b1476e4085 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:09.039536 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d597c0c-1800-44f6-bd18-40b1476e4085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:09.047893 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:09.062769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-5d597c0c-1800-44f6-bd18-40b1476e4085 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:09.064046 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5d597c0c-1800-44f6-bd18-40b1476e4085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:09.142433 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1310/2631] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:41:09.153089 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1aae6-e46b-4b07-ad93-154bab51ed56 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:09.153290 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1aae6-e46b-4b07-ad93-154bab51ed56 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:09.153562 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1aae6-e46b-4b07-ad93-154bab51ed56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:09.175584 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-07b1aae6-e46b-4b07-ad93-154bab51ed56 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:09.176809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-07b1aae6-e46b-4b07-ad93-154bab51ed56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:09.184939 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1322/2632] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:09.190987 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d597c0c-1800-44f6-bd18-40b1476e4085 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:09.201465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d597c0c-1800-44f6-bd18-40b1476e4085 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:09.206738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e61121-67fd-46fc-bfea-2b183cc90f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:09.207340 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e61121-67fd-46fc-bfea-2b183cc90f63 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:09.207616 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e61121-67fd-46fc-bfea-2b183cc90f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:09.207903 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e61121-67fd-46fc-bfea-2b183cc90f63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:09.208668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e61121-67fd-46fc-bfea-2b183cc90f63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:41:09.208982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e61121-67fd-46fc-bfea-2b183cc90f63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:09.210546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e61121-67fd-46fc-bfea-2b183cc90f63 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:09.223534 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1311/2633] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:41:09.227551 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1aae6-e46b-4b07-ad93-154bab51ed56 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:09.238768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1aae6-e46b-4b07-ad93-154bab51ed56 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:09.243656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ab2c9-1a6f-4f39-828d-c12583bcb5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:09.244255 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab2c9-1a6f-4f39-828d-c12583bcb5ec admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:09.244559 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab2c9-1a6f-4f39-828d-c12583bcb5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:09.244828 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab2c9-1a6f-4f39-828d-c12583bcb5ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:09.245494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ab2c9-1a6f-4f39-828d-c12583bcb5ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:09.247490 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ab2c9-1a6f-4f39-828d-c12583bcb5ec admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:09.276172 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1323/2634] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:41:09 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:09.280217 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e61121-67fd-46fc-bfea-2b183cc90f63 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:09.293550 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e61121-67fd-46fc-bfea-2b183cc90f63 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:09.354849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a51076-b2c2-4695-825f-4377709318e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:09.355454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a51076-b2c2-4695-825f-4377709318e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:09.355728 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a51076-b2c2-4695-825f-4377709318e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:09.355991 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a51076-b2c2-4695-825f-4377709318e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:09.356617 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a51076-b2c2-4695-825f-4377709318e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:09.358500 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a51076-b2c2-4695-825f-4377709318e6 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:09.385801 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1312/2635] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:41:09 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:41:09.389991 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ab2c9-1a6f-4f39-828d-c12583bcb5ec admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:09.402031 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ab2c9-1a6f-4f39-828d-c12583bcb5ec admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:09.406836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1d152-3cf6-4379-a992-a7335d8ea2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:09.407513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d152-3cf6-4379-a992-a7335d8ea2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:09.407861 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d152-3cf6-4379-a992-a7335d8ea2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:09.408198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d152-3cf6-4379-a992-a7335d8ea2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:09.408845 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1d152-3cf6-4379-a992-a7335d8ea2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:09.410425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1d152-3cf6-4379-a992-a7335d8ea2c3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:09.421268 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1324/2636] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:09.425785 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a51076-b2c2-4695-825f-4377709318e6 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:09.436557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a51076-b2c2-4695-825f-4377709318e6 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:09.442712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ee6d2-6855-485f-a4ad-128c84aefb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:09.443485 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ee6d2-6855-485f-a4ad-128c84aefb5d admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:09.443961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ee6d2-6855-485f-a4ad-128c84aefb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:09.444137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ee6d2-6855-485f-a4ad-128c84aefb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:09.445143 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ee6d2-6855-485f-a4ad-128c84aefb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:09.446850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ee6d2-6855-485f-a4ad-128c84aefb5d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:09.459991 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1313/2637] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:09.464775 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1d152-3cf6-4379-a992-a7335d8ea2c3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:09.476592 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1d152-3cf6-4379-a992-a7335d8ea2c3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:09.481549 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a2298-45ac-4758-b620-0d3118e858e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:09.482197 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a2298-45ac-4758-b620-0d3118e858e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:09.482818 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a2298-45ac-4758-b620-0d3118e858e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:09.483099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a2298-45ac-4758-b620-0d3118e858e5 admin admin] PATH_INFO: `/v3/projects/015bfb50fde54a179f4ef6a383d88d40/users/d0ce5b6a56e040c6a80523987c637d92/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:09.499467 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a2298-45ac-4758-b620-0d3118e858e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=015bfb50fde54a179f4ef6a383d88d40, user_id=d0ce5b6a56e040c6a80523987c637d92, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:09.502383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a2298-45ac-4758-b620-0d3118e858e5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:09.517845 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1325/2638] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:41:09 2022] PUT /identity/v3/projects/015bfb50fde54a179f4ef6a383d88d40/users/d0ce5b6a56e040c6a80523987c637d92/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:09.529556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c89b1-8c07-49b5-90dd-fa5cb433baf5 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:09.529663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c89b1-8c07-49b5-90dd-fa5cb433baf5 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:09.529899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c89b1-8c07-49b5-90dd-fa5cb433baf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:09.560151 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-512c89b1-8c07-49b5-90dd-fa5cb433baf5 None None] MFA Rules not processed for user `d0ce5b6a56e040c6a80523987c637d92`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:09.561367 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-512c89b1-8c07-49b5-90dd-fa5cb433baf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:09.621034 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:09.627721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1314/2639] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:41:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:09.638907 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a2298-45ac-4758-b620-0d3118e858e5 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:09.640566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2d1a2298-45ac-4758-b620-0d3118e858e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:09.662463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:09.697974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a2298-45ac-4758-b620-0d3118e858e5 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:09.702047 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b13261-69a5-4911-bbc9-b5efec75b8a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:09.702698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b13261-69a5-4911-bbc9-b5efec75b8a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:09.702977 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b13261-69a5-4911-bbc9-b5efec75b8a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:09.703249 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b13261-69a5-4911-bbc9-b5efec75b8a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:09.711423 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b13261-69a5-4911-bbc9-b5efec75b8a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:09.712825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b13261-69a5-4911-bbc9-b5efec75b8a1 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:09.722080 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1326/2640] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:12.854251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c89b1-8c07-49b5-90dd-fa5cb433baf5 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:12.855744 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-512c89b1-8c07-49b5-90dd-fa5cb433baf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:12.925475 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c89b1-8c07-49b5-90dd-fa5cb433baf5 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:12.930692 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8910917-b5d3-4259-9c6b-42a0d1b2965e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae8db0856ed44088f0bd3cb93701de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:12.931295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8910917-b5d3-4259-9c6b-42a0d1b2965e service placement] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:12.931575 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8910917-b5d3-4259-9c6b-42a0d1b2965e service placement] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:12.932346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8910917-b5d3-4259-9c6b-42a0d1b2965e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:12.934148 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f8910917-b5d3-4259-9c6b-42a0d1b2965e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:12.945675 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8910917-b5d3-4259-9c6b-42a0d1b2965e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:12.947285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8910917-b5d3-4259-9c6b-42a0d1b2965e service placement] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:12.957855 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1315/2641] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:17.248202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700390d6-6047-4f73-96d1-71743d7d0119 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:17.248673 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700390d6-6047-4f73-96d1-71743d7d0119 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:17.248673 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700390d6-6047-4f73-96d1-71743d7d0119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:17.267496 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-700390d6-6047-4f73-96d1-71743d7d0119 None None] MFA Rules not processed for user `cd0dbb2c140946f69c3f508b4184e998`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:17.268753 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-700390d6-6047-4f73-96d1-71743d7d0119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:17.324185 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1327/2642] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Sep 1 16:41:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:17.336051 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8910917-b5d3-4259-9c6b-42a0d1b2965e service placement] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:17.337445 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f8910917-b5d3-4259-9c6b-42a0d1b2965e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:17.404505 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8910917-b5d3-4259-9c6b-42a0d1b2965e service placement] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:17.409417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb2f5e-37a5-4382-8dc7-320126067605 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f7afa63815643f580c91df4e4c3bafc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:17.410008 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb2f5e-37a5-4382-8dc7-320126067605 service swift] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:17.410286 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb2f5e-37a5-4382-8dc7-320126067605 service swift] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:17.410556 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb2f5e-37a5-4382-8dc7-320126067605 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:17.418903 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb2f5e-37a5-4382-8dc7-320126067605 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:17.420453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb2f5e-37a5-4382-8dc7-320126067605 service swift] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:17.428274 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1316/2643] 10.222.0.71 () {60 vars in 1384 bytes} [Thu Sep 1 16:41:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:19.995813 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700390d6-6047-4f73-96d1-71743d7d0119 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:20.071663 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700390d6-6047-4f73-96d1-71743d7d0119 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:20.077759 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a27fa-0945-4b4f-8b5b-cde364b82684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:20.078743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a27fa-0945-4b4f-8b5b-cde364b82684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:20.078743 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a27fa-0945-4b4f-8b5b-cde364b82684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:20.078988 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a27fa-0945-4b4f-8b5b-cde364b82684 admin admin] PATH_INFO: `/v3/users/d0ce5b6a56e040c6a80523987c637d92` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:20.080225 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a27fa-0945-4b4f-8b5b-cde364b82684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ce5b6a56e040c6a80523987c637d92)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:20.082129 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a27fa-0945-4b4f-8b5b-cde364b82684 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:20.144931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-850a27fa-0945-4b4f-8b5b-cde364b82684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ce5b6a56e040c6a80523987c637d92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:20.145330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-850a27fa-0945-4b4f-8b5b-cde364b82684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ce5b6a56e040c6a80523987c637d92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:20.154882 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-850a27fa-0945-4b4f-8b5b-cde364b82684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ce5b6a56e040c6a80523987c637d92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:20.168034 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:20.169560 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-850a27fa-0945-4b4f-8b5b-cde364b82684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ce5b6a56e040c6a80523987c637d92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:20.180771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-850a27fa-0945-4b4f-8b5b-cde364b82684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ce5b6a56e040c6a80523987c637d92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:20.190525 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1328/2644] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:41:19 2022] DELETE /identity/v3/users/d0ce5b6a56e040c6a80523987c637d92 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:20.194640 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada5213-2934-495a-8f9f-1d61b851edd1 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:20.195040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada5213-2934-495a-8f9f-1d61b851edd1 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:20.195152 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada5213-2934-495a-8f9f-1d61b851edd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:20.232053 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-2ada5213-2934-495a-8f9f-1d61b851edd1 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:20.233714 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2ada5213-2934-495a-8f9f-1d61b851edd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:20.311295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1317/2645] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:20.321309 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a27fa-0945-4b4f-8b5b-cde364b82684 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:20.323014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-850a27fa-0945-4b4f-8b5b-cde364b82684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:20.387863 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a27fa-0945-4b4f-8b5b-cde364b82684 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:20.391626 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3154c25-423e-479e-99e1-ee2bb53f3548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:20.392234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3154c25-423e-479e-99e1-ee2bb53f3548 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:20.392514 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3154c25-423e-479e-99e1-ee2bb53f3548 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:20.392788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3154c25-423e-479e-99e1-ee2bb53f3548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:20.404303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3154c25-423e-479e-99e1-ee2bb53f3548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:20.406717 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3154c25-423e-479e-99e1-ee2bb53f3548 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:20.418178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1329/2646] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:20.715024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada5213-2934-495a-8f9f-1d61b851edd1 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:20.716448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-2ada5213-2934-495a-8f9f-1d61b851edd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:20.729047 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada5213-2934-495a-8f9f-1d61b851edd1 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:20.737972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5564ca-c8ea-4cd6-bef7-ff3c37e4db94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:20.738649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5564ca-c8ea-4cd6-bef7-ff3c37e4db94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:20.738961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5564ca-c8ea-4cd6-bef7-ff3c37e4db94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:20.739206 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5564ca-c8ea-4cd6-bef7-ff3c37e4db94 admin admin] PATH_INFO: `/v3/projects/015bfb50fde54a179f4ef6a383d88d40` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:20.740487 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5564ca-c8ea-4cd6-bef7-ff3c37e4db94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=015bfb50fde54a179f4ef6a383d88d40)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:20.742476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5564ca-c8ea-4cd6-bef7-ff3c37e4db94 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:20.760591 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:20.805353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-cf5564ca-c8ea-4cd6-bef7-ff3c37e4db94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '015bfb50fde54a179f4ef6a383d88d40', 'request_id': 'req-cf5564ca-c8ea-4cd6-bef7-ff3c37e4db94'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:20.813449 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-cf5564ca-c8ea-4cd6-bef7-ff3c37e4db94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '015bfb50fde54a179f4ef6a383d88d40', 'request_id': 'req-cf5564ca-c8ea-4cd6-bef7-ff3c37e4db94'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:20.820805 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-cf5564ca-c8ea-4cd6-bef7-ff3c37e4db94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '015bfb50fde54a179f4ef6a383d88d40', 'request_id': 'req-cf5564ca-c8ea-4cd6-bef7-ff3c37e4db94'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:20.835485 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-cf5564ca-c8ea-4cd6-bef7-ff3c37e4db94 admin admin] The token cache is being invalidate because project 015bfb50fde54a179f4ef6a383d88d40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:41:20.835869 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-cf5564ca-c8ea-4cd6-bef7-ff3c37e4db94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:20.836544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-cf5564ca-c8ea-4cd6-bef7-ff3c37e4db94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:20.839344 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1318/2647] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:41:20 2022] DELETE /identity/v3/projects/015bfb50fde54a179f4ef6a383d88d40 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:20.844869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a8d11-f79a-4953-adb8-09eb91b0c326 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:20.845182 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a8d11-f79a-4953-adb8-09eb91b0c326 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:20.845456 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a8d11-f79a-4953-adb8-09eb91b0c326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:20.867418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-da6a8d11-f79a-4953-adb8-09eb91b0c326 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:20.868662 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-da6a8d11-f79a-4953-adb8-09eb91b0c326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:20.933123 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1330/2648] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:20.941008 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fc599-12e6-4950-a560-2d8fd5592abc None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:20.941291 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fc599-12e6-4950-a560-2d8fd5592abc None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:20.941560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fc599-12e6-4950-a560-2d8fd5592abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:20.963649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-685fc599-12e6-4950-a560-2d8fd5592abc None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:20.964902 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-685fc599-12e6-4950-a560-2d8fd5592abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:20.973177 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1319/2649] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:20.977519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a8d11-f79a-4953-adb8-09eb91b0c326 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:20.987260 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a8d11-f79a-4953-adb8-09eb91b0c326 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:20.991835 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd7042-4173-4306-b276-f5799491ce0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:20.992428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd7042-4173-4306-b276-f5799491ce0d admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:20.992706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd7042-4173-4306-b276-f5799491ce0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:20.992975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd7042-4173-4306-b276-f5799491ce0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:20.994142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd7042-4173-4306-b276-f5799491ce0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:41:20.994484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd7042-4173-4306-b276-f5799491ce0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:20.996090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd7042-4173-4306-b276-f5799491ce0d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:21.007391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1331/2650] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:41:21.012334 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fc599-12e6-4950-a560-2d8fd5592abc None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:21.022927 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fc599-12e6-4950-a560-2d8fd5592abc None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:21.029125 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b7233-cfd9-4929-b3e9-bf27abda0942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:21.030214 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b7233-cfd9-4929-b3e9-bf27abda0942 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:21.030790 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b7233-cfd9-4929-b3e9-bf27abda0942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:21.031219 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b7233-cfd9-4929-b3e9-bf27abda0942 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:21.032341 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b7233-cfd9-4929-b3e9-bf27abda0942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:21.034880 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b7233-cfd9-4929-b3e9-bf27abda0942 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:21.070945 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1320/2651] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:41:21 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:21.072765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd7042-4173-4306-b276-f5799491ce0d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:21.083367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd7042-4173-4306-b276-f5799491ce0d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:21.141800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eafb9a-4081-4187-8491-1c560cd9eb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:21.142411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eafb9a-4081-4187-8491-1c560cd9eb22 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:21.142720 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eafb9a-4081-4187-8491-1c560cd9eb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:21.142993 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eafb9a-4081-4187-8491-1c560cd9eb22 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:21.143627 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eafb9a-4081-4187-8491-1c560cd9eb22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:21.145533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eafb9a-4081-4187-8491-1c560cd9eb22 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:21.169839 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1332/2652] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:41:21 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:21.173978 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b7233-cfd9-4929-b3e9-bf27abda0942 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:21.185292 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b7233-cfd9-4929-b3e9-bf27abda0942 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:21.189917 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66b618-7e2c-4c18-8c8e-6afafe2bdae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:21.190528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66b618-7e2c-4c18-8c8e-6afafe2bdae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:21.190949 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66b618-7e2c-4c18-8c8e-6afafe2bdae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:21.191226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66b618-7e2c-4c18-8c8e-6afafe2bdae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:21.191874 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66b618-7e2c-4c18-8c8e-6afafe2bdae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:21.193498 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66b618-7e2c-4c18-8c8e-6afafe2bdae1 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:21.208379 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1321/2653] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:21.209580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eafb9a-4081-4187-8491-1c560cd9eb22 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:21.220197 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eafb9a-4081-4187-8491-1c560cd9eb22 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:21.225182 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91162175-c34e-492a-ac29-11cc8fe9544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:21.225775 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162175-c34e-492a-ac29-11cc8fe9544d admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:21.226050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162175-c34e-492a-ac29-11cc8fe9544d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:21.226318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162175-c34e-492a-ac29-11cc8fe9544d admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:21.226983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91162175-c34e-492a-ac29-11cc8fe9544d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:21.228554 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91162175-c34e-492a-ac29-11cc8fe9544d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:21.229867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:21.240531 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1333/2654] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:21.245339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66b618-7e2c-4c18-8c8e-6afafe2bdae1 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:21.256864 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66b618-7e2c-4c18-8c8e-6afafe2bdae1 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:21.263203 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c33bc1-9c49-4bfb-a703-8dd95d46ac1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:21.263865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c33bc1-9c49-4bfb-a703-8dd95d46ac1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:21.264171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c33bc1-9c49-4bfb-a703-8dd95d46ac1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:21.264492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c33bc1-9c49-4bfb-a703-8dd95d46ac1a admin admin] PATH_INFO: `/v3/projects/bd5dbe2bf7164b9298d647670c7917be/users/ec3abd787d824c1880da28f9751f46d3/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:21.304513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c33bc1-9c49-4bfb-a703-8dd95d46ac1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5dbe2bf7164b9298d647670c7917be, user_id=ec3abd787d824c1880da28f9751f46d3, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:21.307776 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c33bc1-9c49-4bfb-a703-8dd95d46ac1a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:21.321650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1322/2655] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:41:21 2022] PUT /identity/v3/projects/bd5dbe2bf7164b9298d647670c7917be/users/ec3abd787d824c1880da28f9751f46d3/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:41:21.327708 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e27ee-64a2-4764-a8e4-261d956657c2 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:21.328174 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e27ee-64a2-4764-a8e4-261d956657c2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:21.328493 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e27ee-64a2-4764-a8e4-261d956657c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:21.364464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5b0e27ee-64a2-4764-a8e4-261d956657c2 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:21.365737 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5b0e27ee-64a2-4764-a8e4-261d956657c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:21.443774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1334/2656] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:21.450733 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c33bc1-9c49-4bfb-a703-8dd95d46ac1a admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:21.452458 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-77c33bc1-9c49-4bfb-a703-8dd95d46ac1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:21.525978 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c33bc1-9c49-4bfb-a703-8dd95d46ac1a admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:21.529647 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ec22d-35c8-4056-82b1-3fa0099c87df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:21.530250 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ec22d-35c8-4056-82b1-3fa0099c87df service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:21.530527 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ec22d-35c8-4056-82b1-3fa0099c87df service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:21.530830 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ec22d-35c8-4056-82b1-3fa0099c87df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:21.540082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ec22d-35c8-4056-82b1-3fa0099c87df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:21.542042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ec22d-35c8-4056-82b1-3fa0099c87df service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:21.551792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1323/2657] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:26.653257 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236daf51-4e85-4d21-be40-ba26cc3c812b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:26.653764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236daf51-4e85-4d21-be40-ba26cc3c812b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:26.653764 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236daf51-4e85-4d21-be40-ba26cc3c812b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:26.707402 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-236daf51-4e85-4d21-be40-ba26cc3c812b None None] MFA Rules not processed for user `ec3abd787d824c1880da28f9751f46d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:26.708663 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-236daf51-4e85-4d21-be40-ba26cc3c812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:26.785307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1335/2658] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:41:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:26.789850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ec22d-35c8-4056-82b1-3fa0099c87df service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:26.800702 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ec22d-35c8-4056-82b1-3fa0099c87df service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:26.814503 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101543b-13b1-4259-b7fd-7b7ce2cb3461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:26.815177 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101543b-13b1-4259-b7fd-7b7ce2cb3461 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:26.815461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101543b-13b1-4259-b7fd-7b7ce2cb3461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:26.815831 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101543b-13b1-4259-b7fd-7b7ce2cb3461 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:26.816494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101543b-13b1-4259-b7fd-7b7ce2cb3461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:26.818598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101543b-13b1-4259-b7fd-7b7ce2cb3461 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:26.880807 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1324/2659] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:41:26 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:26.885012 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236daf51-4e85-4d21-be40-ba26cc3c812b None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:26.901032 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236daf51-4e85-4d21-be40-ba26cc3c812b None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:26.966290 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ce194-cbdd-429d-891b-5e0550ad8420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:26.967119 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ce194-cbdd-429d-891b-5e0550ad8420 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:26.967494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ce194-cbdd-429d-891b-5e0550ad8420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:26.967862 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ce194-cbdd-429d-891b-5e0550ad8420 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:26.968586 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ce194-cbdd-429d-891b-5e0550ad8420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:26.970758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ce194-cbdd-429d-891b-5e0550ad8420 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:26.996576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1336/2660] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:41:26 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:27.000827 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101543b-13b1-4259-b7fd-7b7ce2cb3461 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:27.015087 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101543b-13b1-4259-b7fd-7b7ce2cb3461 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:27.019910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c75ddf-b52b-45e1-821c-ef581d5104a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:27.020528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c75ddf-b52b-45e1-821c-ef581d5104a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:27.020809 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c75ddf-b52b-45e1-821c-ef581d5104a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:27.021082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c75ddf-b52b-45e1-821c-ef581d5104a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:27.021763 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c75ddf-b52b-45e1-821c-ef581d5104a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:27.023416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c75ddf-b52b-45e1-821c-ef581d5104a5 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:27.035835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1325/2661] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:27.039849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ce194-cbdd-429d-891b-5e0550ad8420 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:27.051347 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ce194-cbdd-429d-891b-5e0550ad8420 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:27.056924 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bdb77-aa9f-43b7-8f10-7ee59e01d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:27.057705 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bdb77-aa9f-43b7-8f10-7ee59e01d1a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:27.058107 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bdb77-aa9f-43b7-8f10-7ee59e01d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:27.058380 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bdb77-aa9f-43b7-8f10-7ee59e01d1a3 admin admin] PATH_INFO: `/v3/projects/2c5849999c724340b89ca91c2a90993a/users/a5ee71ce72324929a1de73aad528826d/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:27.072860 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:27.077751 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83bdb77-aa9f-43b7-8f10-7ee59e01d1a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5849999c724340b89ca91c2a90993a, user_id=a5ee71ce72324929a1de73aad528826d, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:27.080801 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83bdb77-aa9f-43b7-8f10-7ee59e01d1a3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:27.097838 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1337/2662] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:41:27 2022] PUT /identity/v3/projects/2c5849999c724340b89ca91c2a90993a/users/a5ee71ce72324929a1de73aad528826d/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:41:27.101706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c75ddf-b52b-45e1-821c-ef581d5104a5 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:27.113717 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c75ddf-b52b-45e1-821c-ef581d5104a5 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:27.117880 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:27.176935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f039079-9101-4cbf-9de2-438827ae0ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:27.177759 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f039079-9101-4cbf-9de2-438827ae0ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:27.178020 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f039079-9101-4cbf-9de2-438827ae0ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:27.178441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f039079-9101-4cbf-9de2-438827ae0ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:27.179238 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f039079-9101-4cbf-9de2-438827ae0ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:27.180985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f039079-9101-4cbf-9de2-438827ae0ca5 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:27.192789 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1326/2663] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:27.196829 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bdb77-aa9f-43b7-8f10-7ee59e01d1a3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:27.207997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bdb77-aa9f-43b7-8f10-7ee59e01d1a3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:27.213792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4dc59-4b8e-4f35-b15e-363edd18342d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:27.214472 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4dc59-4b8e-4f35-b15e-363edd18342d admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:27.214805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4dc59-4b8e-4f35-b15e-363edd18342d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:27.215082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4dc59-4b8e-4f35-b15e-363edd18342d admin admin] PATH_INFO: `/v3/projects/2c5849999c724340b89ca91c2a90993a/users/a5ee71ce72324929a1de73aad528826d/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:27.217075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4dc59-4b8e-4f35-b15e-363edd18342d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5849999c724340b89ca91c2a90993a, user_id=a5ee71ce72324929a1de73aad528826d, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:27.219767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4dc59-4b8e-4f35-b15e-363edd18342d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:27.232117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1338/2664] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:41:27 2022] PUT /identity/v3/projects/2c5849999c724340b89ca91c2a90993a/users/a5ee71ce72324929a1de73aad528826d/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:31.839764 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16ebfe-edb2-4435-b8a2-4bbc15dadd69 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:31.840218 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16ebfe-edb2-4435-b8a2-4bbc15dadd69 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:31.840321 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16ebfe-edb2-4435-b8a2-4bbc15dadd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:31.869851 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-be16ebfe-edb2-4435-b8a2-4bbc15dadd69 None None] MFA Rules not processed for user `a5ee71ce72324929a1de73aad528826d`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:31.871466 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-be16ebfe-edb2-4435-b8a2-4bbc15dadd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:32.009367 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1327/2665] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:41:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:32.046355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4dc59-4b8e-4f35-b15e-363edd18342d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:32.049325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b3e4dc59-4b8e-4f35-b15e-363edd18342d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:32.188324 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4dc59-4b8e-4f35-b15e-363edd18342d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:32.202556 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2e432-c1d6-4bc6-b080-c1660f7bf892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:32.203217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2e432-c1d6-4bc6-b080-c1660f7bf892 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:32.203493 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2e432-c1d6-4bc6-b080-c1660f7bf892 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:32.203765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2e432-c1d6-4bc6-b080-c1660f7bf892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:32.280566 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2e432-c1d6-4bc6-b080-c1660f7bf892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:32.282136 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2e432-c1d6-4bc6-b080-c1660f7bf892 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:32.294720 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1339/2666] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:33.350291 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef48f-f43d-4fb7-b437-8384249c9e35 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:33.350831 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef48f-f43d-4fb7-b437-8384249c9e35 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:33.350941 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef48f-f43d-4fb7-b437-8384249c9e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:33.372339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-292ef48f-f43d-4fb7-b437-8384249c9e35 None None] MFA Rules not processed for user `ec3abd787d824c1880da28f9751f46d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:33.373543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-292ef48f-f43d-4fb7-b437-8384249c9e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:33.380549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1328/2667] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:41:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:41.261417 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b021b8-4e47-40a3-b28f-1818826d7adb None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:41.261919 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b021b8-4e47-40a3-b28f-1818826d7adb None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:41.262391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b021b8-4e47-40a3-b28f-1818826d7adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:41.283601 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-81b021b8-4e47-40a3-b28f-1818826d7adb None None] MFA Rules not processed for user `cd0dbb2c140946f69c3f508b4184e998`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:41.284860 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-81b021b8-4e47-40a3-b28f-1818826d7adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:41.334925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:41.343695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1340/2668] 10.222.0.71 () {58 vars in 967 bytes} [Thu Sep 1 16:41:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:41.356476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ef48f-f43d-4fb7-b437-8384249c9e35 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:41.357870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-292ef48f-f43d-4fb7-b437-8384249c9e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:41.430953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ef48f-f43d-4fb7-b437-8384249c9e35 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:41.435933 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df27183-a542-48f1-8f34-25598d8f25a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f7afa63815643f580c91df4e4c3bafc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:41.436538 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df27183-a542-48f1-8f34-25598d8f25a0 service swift] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:41.436819 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df27183-a542-48f1-8f34-25598d8f25a0 service swift] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:41.437091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df27183-a542-48f1-8f34-25598d8f25a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:41.445464 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df27183-a542-48f1-8f34-25598d8f25a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:41.447142 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df27183-a542-48f1-8f34-25598d8f25a0 service swift] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:41.455828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1329/2669] 10.222.0.71 () {60 vars in 1384 bytes} [Thu Sep 1 16:41:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:51.452595 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=95 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:56.786239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b021b8-4e47-40a3-b28f-1818826d7adb None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:56.839998 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b021b8-4e47-40a3-b28f-1818826d7adb None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:56.843453 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b76de-a10b-45a3-88d7-2d55eac46127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:56.844042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b76de-a10b-45a3-88d7-2d55eac46127 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:56.844318 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b76de-a10b-45a3-88d7-2d55eac46127 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:56.844591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b76de-a10b-45a3-88d7-2d55eac46127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:56.846298 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-322b76de-a10b-45a3-88d7-2d55eac46127 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:56.914386 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b76de-a10b-45a3-88d7-2d55eac46127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:56.915849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b76de-a10b-45a3-88d7-2d55eac46127 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:56.925395 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1341/2670] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:01.505792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df27183-a542-48f1-8f34-25598d8f25a0 service swift] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:01.507400 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7df27183-a542-48f1-8f34-25598d8f25a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:01.521961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df27183-a542-48f1-8f34-25598d8f25a0 service swift] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:01.527221 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb093c2-362f-4c0b-a22a-09e7a6c34e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:01.527801 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb093c2-362f-4c0b-a22a-09e7a6c34e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:01.528084 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb093c2-362f-4c0b-a22a-09e7a6c34e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:01.528360 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb093c2-362f-4c0b-a22a-09e7a6c34e26 admin admin] PATH_INFO: `/v3/users/6912413cfb474eb68e31c250531dfcd0` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:01.529477 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb093c2-362f-4c0b-a22a-09e7a6c34e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6912413cfb474eb68e31c250531dfcd0)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:01.531395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb093c2-362f-4c0b-a22a-09e7a6c34e26 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:01.583300 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-cdb093c2-362f-4c0b-a22a-09e7a6c34e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6912413cfb474eb68e31c250531dfcd0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.583961 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-cdb093c2-362f-4c0b-a22a-09e7a6c34e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6912413cfb474eb68e31c250531dfcd0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.599704 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-cdb093c2-362f-4c0b-a22a-09e7a6c34e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6912413cfb474eb68e31c250531dfcd0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.611794 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-cdb093c2-362f-4c0b-a22a-09e7a6c34e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6912413cfb474eb68e31c250531dfcd0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.625188 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-cdb093c2-362f-4c0b-a22a-09e7a6c34e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6912413cfb474eb68e31c250531dfcd0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.631488 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1330/2671] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:01 2022] DELETE /identity/v3/users/6912413cfb474eb68e31c250531dfcd0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:01.805716 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b76de-a10b-45a3-88d7-2d55eac46127 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:01.816159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b76de-a10b-45a3-88d7-2d55eac46127 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:01.880213 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b1212-84a3-48ae-823e-cd8f339e1f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:01.880865 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b1212-84a3-48ae-823e-cd8f339e1f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:01.881147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b1212-84a3-48ae-823e-cd8f339e1f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:01.881437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b1212-84a3-48ae-823e-cd8f339e1f2b admin admin] PATH_INFO: `/v3/projects/f612c01c5bca47d58b94ed343c8af7b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:01.882568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b1212-84a3-48ae-823e-cd8f339e1f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f612c01c5bca47d58b94ed343c8af7b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:01.884850 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b1212-84a3-48ae-823e-cd8f339e1f2b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:01.929961 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-d89b1212-84a3-48ae-823e-cd8f339e1f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f612c01c5bca47d58b94ed343c8af7b0', 'request_id': 'req-d89b1212-84a3-48ae-823e-cd8f339e1f2b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.931796 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:01.936250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-d89b1212-84a3-48ae-823e-cd8f339e1f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f612c01c5bca47d58b94ed343c8af7b0', 'request_id': 'req-d89b1212-84a3-48ae-823e-cd8f339e1f2b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.942261 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-d89b1212-84a3-48ae-823e-cd8f339e1f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f612c01c5bca47d58b94ed343c8af7b0', 'request_id': 'req-d89b1212-84a3-48ae-823e-cd8f339e1f2b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.954345 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-d89b1212-84a3-48ae-823e-cd8f339e1f2b admin admin] The token cache is being invalidate because project f612c01c5bca47d58b94ed343c8af7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:01.954653 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-d89b1212-84a3-48ae-823e-cd8f339e1f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.955278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-d89b1212-84a3-48ae-823e-cd8f339e1f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.956760 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1342/2672] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:01 2022] DELETE /identity/v3/projects/f612c01c5bca47d58b94ed343c8af7b0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:01.961832 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c660c2-8371-4aeb-9a60-c3e048f018b3 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:01.962123 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c660c2-8371-4aeb-9a60-c3e048f018b3 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:01.962403 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c660c2-8371-4aeb-9a60-c3e048f018b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:01.982194 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-b8c660c2-8371-4aeb-9a60-c3e048f018b3 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:01.983434 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b8c660c2-8371-4aeb-9a60-c3e048f018b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:02.041868 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1331/2673] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:02.050862 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a0afc-0423-4122-88a2-0fcaa4d9e7d5 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:02.051082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a0afc-0423-4122-88a2-0fcaa4d9e7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:02.051357 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a0afc-0423-4122-88a2-0fcaa4d9e7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:02.071392 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-cd1a0afc-0423-4122-88a2-0fcaa4d9e7d5 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:02.072592 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cd1a0afc-0423-4122-88a2-0fcaa4d9e7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:02.080730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1343/2674] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:02.084963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c660c2-8371-4aeb-9a60-c3e048f018b3 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:02.095941 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c660c2-8371-4aeb-9a60-c3e048f018b3 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:02.101399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c01f7-de4a-4793-982d-3fd29052c41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:02.101999 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c01f7-de4a-4793-982d-3fd29052c41a admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:02.102279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c01f7-de4a-4793-982d-3fd29052c41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:02.102551 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c01f7-de4a-4793-982d-3fd29052c41a admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:02.103233 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c01f7-de4a-4793-982d-3fd29052c41a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:02.103536 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c01f7-de4a-4793-982d-3fd29052c41a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:02.105110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c01f7-de4a-4793-982d-3fd29052c41a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:02.116772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1332/2675] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:42:02.121000 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a0afc-0423-4122-88a2-0fcaa4d9e7d5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:02.130201 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a0afc-0423-4122-88a2-0fcaa4d9e7d5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:02.135355 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdfde5-728f-4b5a-b6e3-5f5380ce14e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:02.135939 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdfde5-728f-4b5a-b6e3-5f5380ce14e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:02.136219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdfde5-728f-4b5a-b6e3-5f5380ce14e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:02.136489 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdfde5-728f-4b5a-b6e3-5f5380ce14e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:02.137106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdfde5-728f-4b5a-b6e3-5f5380ce14e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:02.139113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdfde5-728f-4b5a-b6e3-5f5380ce14e3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:02.166706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1344/2676] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:02 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:02.170885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c01f7-de4a-4793-982d-3fd29052c41a admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:02.180652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c01f7-de4a-4793-982d-3fd29052c41a admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:02.242588 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51a10a-d3ca-4199-aaa5-1a6560a8a972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:02.243222 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a10a-d3ca-4199-aaa5-1a6560a8a972 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:02.243506 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a10a-d3ca-4199-aaa5-1a6560a8a972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:02.243778 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a10a-d3ca-4199-aaa5-1a6560a8a972 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:02.244403 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51a10a-d3ca-4199-aaa5-1a6560a8a972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:02.246286 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51a10a-d3ca-4199-aaa5-1a6560a8a972 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:02.254133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:02.269428 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1333/2677] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:02 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:02.273593 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdfde5-728f-4b5a-b6e3-5f5380ce14e3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:02.283734 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdfde5-728f-4b5a-b6e3-5f5380ce14e3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:02.288303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603509a-6aad-4141-9972-3669b380848b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:02.288889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603509a-6aad-4141-9972-3669b380848b admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:02.289164 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603509a-6aad-4141-9972-3669b380848b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:02.289450 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603509a-6aad-4141-9972-3669b380848b admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:02.290071 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603509a-6aad-4141-9972-3669b380848b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:02.291683 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603509a-6aad-4141-9972-3669b380848b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:02.301422 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1345/2678] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:02.305923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51a10a-d3ca-4199-aaa5-1a6560a8a972 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:02.316050 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51a10a-d3ca-4199-aaa5-1a6560a8a972 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:02.320689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd9021-c567-4caa-b877-e90c721e45f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:02.321279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd9021-c567-4caa-b877-e90c721e45f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:02.321558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd9021-c567-4caa-b877-e90c721e45f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:02.321828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd9021-c567-4caa-b877-e90c721e45f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:02.322458 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd9021-c567-4caa-b877-e90c721e45f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:02.324335 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd9021-c567-4caa-b877-e90c721e45f7 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:02.337295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1334/2679] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:02.339367 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603509a-6aad-4141-9972-3669b380848b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:02.349118 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603509a-6aad-4141-9972-3669b380848b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:02.354299 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c968279-e568-430d-ae19-cf0b7bcbeaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:02.354964 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c968279-e568-430d-ae19-cf0b7bcbeaee admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:02.355244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c968279-e568-430d-ae19-cf0b7bcbeaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:02.355519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c968279-e568-430d-ae19-cf0b7bcbeaee admin admin] PATH_INFO: `/v3/projects/807fe1a229f04ad98d535f7612dd4b66/users/e802392df090479abdd241f103f45dd8/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:02.369516 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c968279-e568-430d-ae19-cf0b7bcbeaee admin admin] RBAC: Authorizing `identity:create_grant(project_id=807fe1a229f04ad98d535f7612dd4b66, user_id=e802392df090479abdd241f103f45dd8, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:02.372162 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c968279-e568-430d-ae19-cf0b7bcbeaee admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:02.384761 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1346/2680] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:02 2022] PUT /identity/v3/projects/807fe1a229f04ad98d535f7612dd4b66/users/e802392df090479abdd241f103f45dd8/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:02.389838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61084ee8-7180-4406-8fc4-0e89829f4807 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:02.390126 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61084ee8-7180-4406-8fc4-0e89829f4807 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:02.390426 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61084ee8-7180-4406-8fc4-0e89829f4807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:02.409721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-61084ee8-7180-4406-8fc4-0e89829f4807 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:02.411239 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-61084ee8-7180-4406-8fc4-0e89829f4807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:02.469693 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1335/2681] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:02.479375 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c968279-e568-430d-ae19-cf0b7bcbeaee admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:02.481048 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5c968279-e568-430d-ae19-cf0b7bcbeaee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:02.536383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c968279-e568-430d-ae19-cf0b7bcbeaee admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:02.540003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a0f3b-ec37-4fc7-b4c2-43949a7777ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:02.540596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a0f3b-ec37-4fc7-b4c2-43949a7777ac service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:02.540873 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a0f3b-ec37-4fc7-b4c2-43949a7777ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:02.541145 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a0f3b-ec37-4fc7-b4c2-43949a7777ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:02.549878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a0f3b-ec37-4fc7-b4c2-43949a7777ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:02.551322 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a0f3b-ec37-4fc7-b4c2-43949a7777ac service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:02.561189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1347/2682] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:07.046521 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27416df9-e99a-458e-8f4f-a16e716404ec None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:07.047395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27416df9-e99a-458e-8f4f-a16e716404ec None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:07.047845 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27416df9-e99a-458e-8f4f-a16e716404ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:07.082052 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-27416df9-e99a-458e-8f4f-a16e716404ec None None] MFA Rules not processed for user `e802392df090479abdd241f103f45dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:07.083416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-27416df9-e99a-458e-8f4f-a16e716404ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:07.166782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1336/2683] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:42:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:07.179470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a0f3b-ec37-4fc7-b4c2-43949a7777ac service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:07.183468 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-320a0f3b-ec37-4fc7-b4c2-43949a7777ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:07.270878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a0f3b-ec37-4fc7-b4c2-43949a7777ac service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:07.277656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d19bad-d328-4799-a939-d6ce264bb11f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:07.278413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d19bad-d328-4799-a939-d6ce264bb11f service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:07.279234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d19bad-d328-4799-a939-d6ce264bb11f service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:07.279816 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d19bad-d328-4799-a939-d6ce264bb11f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:07.289802 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d19bad-d328-4799-a939-d6ce264bb11f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:07.291623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d19bad-d328-4799-a939-d6ce264bb11f service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:07.302058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1348/2684] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:08.704102 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49e6f7-d434-4517-9f25-2383f89641c7 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:08.704566 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49e6f7-d434-4517-9f25-2383f89641c7 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:08.704868 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49e6f7-d434-4517-9f25-2383f89641c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:08.727226 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-6d49e6f7-d434-4517-9f25-2383f89641c7 None None] MFA Rules not processed for user `e802392df090479abdd241f103f45dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:08.728448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6d49e6f7-d434-4517-9f25-2383f89641c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:08.736828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1337/2685] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:42:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:10.536984 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d19bad-d328-4799-a939-d6ce264bb11f service nova] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:10.539306 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-37d19bad-d328-4799-a939-d6ce264bb11f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:10.548392 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:10.552532 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d19bad-d328-4799-a939-d6ce264bb11f service nova] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:10.558344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe817fea-9075-4b32-8403-f138e69428c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:10.560219 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe817fea-9075-4b32-8403-f138e69428c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:10.560800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe817fea-9075-4b32-8403-f138e69428c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:10.561226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe817fea-9075-4b32-8403-f138e69428c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:10.563533 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fe817fea-9075-4b32-8403-f138e69428c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:10.646845 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe817fea-9075-4b32-8403-f138e69428c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:10.649515 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe817fea-9075-4b32-8403-f138e69428c0 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:10.663982 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1349/2686] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:18.720704 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:20.657442 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=28 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:51.434187 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49e6f7-d434-4517-9f25-2383f89641c7 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:51.444622 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49e6f7-d434-4517-9f25-2383f89641c7 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:51.448886 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd716f9c-50c9-4879-b5a5-301636ee7dd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:51.449518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd716f9c-50c9-4879-b5a5-301636ee7dd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:51.449797 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd716f9c-50c9-4879-b5a5-301636ee7dd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:51.450071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd716f9c-50c9-4879-b5a5-301636ee7dd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:51.451838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-fd716f9c-50c9-4879-b5a5-301636ee7dd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:51.465996 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd716f9c-50c9-4879-b5a5-301636ee7dd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:51.467416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd716f9c-50c9-4879-b5a5-301636ee7dd4 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:51.478932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1338/2687] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:52.663269 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe817fea-9075-4b32-8403-f138e69428c0 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:52.671938 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe817fea-9075-4b32-8403-f138e69428c0 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:52.675564 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3fc34-01d6-44c5-8153-58248cc6fb4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:52.676647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3fc34-01d6-44c5-8153-58248cc6fb4a service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:52.676925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3fc34-01d6-44c5-8153-58248cc6fb4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:52.677195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3fc34-01d6-44c5-8153-58248cc6fb4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:52.678939 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e8f3fc34-01d6-44c5-8153-58248cc6fb4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:52.692400 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3fc34-01d6-44c5-8153-58248cc6fb4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:52.693795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3fc34-01d6-44c5-8153-58248cc6fb4a service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:52.704851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1350/2688] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:58.050636 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd716f9c-50c9-4879-b5a5-301636ee7dd4 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:58.059251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd716f9c-50c9-4879-b5a5-301636ee7dd4 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:58.062850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9076a2-98f5-40c8-a076-58e38e18444c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:58.063435 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9076a2-98f5-40c8-a076-58e38e18444c service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:58.063713 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9076a2-98f5-40c8-a076-58e38e18444c service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:58.063982 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9076a2-98f5-40c8-a076-58e38e18444c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:58.065689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ac9076a2-98f5-40c8-a076-58e38e18444c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:58.077432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9076a2-98f5-40c8-a076-58e38e18444c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:58.078894 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9076a2-98f5-40c8-a076-58e38e18444c service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:58.088735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1339/2689] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:01.147460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3fc34-01d6-44c5-8153-58248cc6fb4a service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:01.153563 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e8f3fc34-01d6-44c5-8153-58248cc6fb4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:01.173548 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3fc34-01d6-44c5-8153-58248cc6fb4a service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:01.178600 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea531fcb-5e1f-4ac5-be7c-d92a539eece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:01.179254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea531fcb-5e1f-4ac5-be7c-d92a539eece8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:01.179526 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea531fcb-5e1f-4ac5-be7c-d92a539eece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:01.179800 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea531fcb-5e1f-4ac5-be7c-d92a539eece8 admin admin] PATH_INFO: `/v3/users/88cd06365efb4911b40d8aa0c721c32f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:01.193341 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea531fcb-5e1f-4ac5-be7c-d92a539eece8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88cd06365efb4911b40d8aa0c721c32f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:01.195326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea531fcb-5e1f-4ac5-be7c-d92a539eece8 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:01.244900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ea531fcb-5e1f-4ac5-be7c-d92a539eece8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88cd06365efb4911b40d8aa0c721c32f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:01.245556 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ea531fcb-5e1f-4ac5-be7c-d92a539eece8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88cd06365efb4911b40d8aa0c721c32f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:01.253229 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ea531fcb-5e1f-4ac5-be7c-d92a539eece8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88cd06365efb4911b40d8aa0c721c32f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:01.266749 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ea531fcb-5e1f-4ac5-be7c-d92a539eece8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88cd06365efb4911b40d8aa0c721c32f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:01.273785 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ea531fcb-5e1f-4ac5-be7c-d92a539eece8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88cd06365efb4911b40d8aa0c721c32f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:01.279892 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1351/2690] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:01 2022] DELETE /identity/v3/users/88cd06365efb4911b40d8aa0c721c32f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:01.453252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9076a2-98f5-40c8-a076-58e38e18444c service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:01.465932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9076a2-98f5-40c8-a076-58e38e18444c service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:01.523461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd82fa-3bdf-492e-990b-d4f40f9e731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:01.524054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd82fa-3bdf-492e-990b-d4f40f9e731a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:01.524333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd82fa-3bdf-492e-990b-d4f40f9e731a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:01.524605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd82fa-3bdf-492e-990b-d4f40f9e731a admin admin] PATH_INFO: `/v3/projects/a9a10d96a23f4af687c4fc40d667c395` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:01.534741 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd82fa-3bdf-492e-990b-d4f40f9e731a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a10d96a23f4af687c4fc40d667c395)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:01.537198 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd82fa-3bdf-492e-990b-d4f40f9e731a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:01.580831 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-85dd82fa-3bdf-492e-990b-d4f40f9e731a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a10d96a23f4af687c4fc40d667c395', 'request_id': 'req-85dd82fa-3bdf-492e-990b-d4f40f9e731a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:01.588075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-85dd82fa-3bdf-492e-990b-d4f40f9e731a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a10d96a23f4af687c4fc40d667c395', 'request_id': 'req-85dd82fa-3bdf-492e-990b-d4f40f9e731a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:01.594548 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-85dd82fa-3bdf-492e-990b-d4f40f9e731a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a10d96a23f4af687c4fc40d667c395', 'request_id': 'req-85dd82fa-3bdf-492e-990b-d4f40f9e731a'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:01.605954 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-85dd82fa-3bdf-492e-990b-d4f40f9e731a admin admin] The token cache is being invalidate because project a9a10d96a23f4af687c4fc40d667c395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:01.606269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-85dd82fa-3bdf-492e-990b-d4f40f9e731a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:01.606934 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-85dd82fa-3bdf-492e-990b-d4f40f9e731a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:01.608629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1340/2691] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:01 2022] DELETE /identity/v3/projects/a9a10d96a23f4af687c4fc40d667c395 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:01.613326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd75f9d-a8ba-4a26-96e8-3904cd8fa126 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:01.613611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd75f9d-a8ba-4a26-96e8-3904cd8fa126 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:01.613911 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd75f9d-a8ba-4a26-96e8-3904cd8fa126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:01.633693 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-bdd75f9d-a8ba-4a26-96e8-3904cd8fa126 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:01.634856 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bdd75f9d-a8ba-4a26-96e8-3904cd8fa126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:01.692124 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1352/2692] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:01.700314 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2b63a-2937-456a-994c-affb531bb871 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:01.700599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2b63a-2937-456a-994c-affb531bb871 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:01.700876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2b63a-2937-456a-994c-affb531bb871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:01.720816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-d8d2b63a-2937-456a-994c-affb531bb871 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:01.722018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d8d2b63a-2937-456a-994c-affb531bb871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:01.731661 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1341/2693] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:01.735757 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd75f9d-a8ba-4a26-96e8-3904cd8fa126 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:01.745449 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd75f9d-a8ba-4a26-96e8-3904cd8fa126 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:01.749946 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458694a3-a11a-4750-b192-7c2ec60d2b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:01.750531 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458694a3-a11a-4750-b192-7c2ec60d2b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:01.750839 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458694a3-a11a-4750-b192-7c2ec60d2b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:01.751108 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458694a3-a11a-4750-b192-7c2ec60d2b3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:01.751750 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458694a3-a11a-4750-b192-7c2ec60d2b3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:01.752050 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458694a3-a11a-4750-b192-7c2ec60d2b3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:01.753770 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458694a3-a11a-4750-b192-7c2ec60d2b3e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:01.765114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1353/2694] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:01.769828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2b63a-2937-456a-994c-affb531bb871 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:01.779267 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2b63a-2937-456a-994c-affb531bb871 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:01.783983 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc1272-c88b-45a7-8ab1-3e67348d304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:01.784582 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc1272-c88b-45a7-8ab1-3e67348d304c admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:01.784941 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc1272-c88b-45a7-8ab1-3e67348d304c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:01.785725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc1272-c88b-45a7-8ab1-3e67348d304c admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:01.786356 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc1272-c88b-45a7-8ab1-3e67348d304c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:01.788267 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc1272-c88b-45a7-8ab1-3e67348d304c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:01.823885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1342/2695] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:01 2022] POST /identity/v3/projects => generated 355 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:01.827739 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458694a3-a11a-4750-b192-7c2ec60d2b3e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:01.838063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458694a3-a11a-4750-b192-7c2ec60d2b3e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:01.869815 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:01.895618 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c4bbe-53ae-45b1-8d5b-db3a0e34a756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:01.896146 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c4bbe-53ae-45b1-8d5b-db3a0e34a756 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:01.896423 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c4bbe-53ae-45b1-8d5b-db3a0e34a756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:01.896692 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c4bbe-53ae-45b1-8d5b-db3a0e34a756 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:01.897319 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c4bbe-53ae-45b1-8d5b-db3a0e34a756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:01.899266 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c4bbe-53ae-45b1-8d5b-db3a0e34a756 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:01.923377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1354/2696] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:01 2022] POST /identity/v3/users => generated 278 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:01.924539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc1272-c88b-45a7-8ab1-3e67348d304c admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:01.935400 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc1272-c88b-45a7-8ab1-3e67348d304c admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:01.939979 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41961fb-bbb8-40ce-b846-f8a6104cac52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:01.940597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41961fb-bbb8-40ce-b846-f8a6104cac52 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:01.940862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41961fb-bbb8-40ce-b846-f8a6104cac52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:01.941137 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41961fb-bbb8-40ce-b846-f8a6104cac52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:01.941775 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41961fb-bbb8-40ce-b846-f8a6104cac52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:01.943401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41961fb-bbb8-40ce-b846-f8a6104cac52 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:01.953373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1343/2697] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:01.957133 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c4bbe-53ae-45b1-8d5b-db3a0e34a756 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:01.967002 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c4bbe-53ae-45b1-8d5b-db3a0e34a756 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:01.972113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9630de-ea2d-41fa-b51a-b8e17a542362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:01.973215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9630de-ea2d-41fa-b51a-b8e17a542362 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:01.973496 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9630de-ea2d-41fa-b51a-b8e17a542362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:01.973767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9630de-ea2d-41fa-b51a-b8e17a542362 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:01.974424 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9630de-ea2d-41fa-b51a-b8e17a542362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:01.976169 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9630de-ea2d-41fa-b51a-b8e17a542362 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:01.986703 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1355/2698] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:01.991271 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41961fb-bbb8-40ce-b846-f8a6104cac52 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:02.000974 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41961fb-bbb8-40ce-b846-f8a6104cac52 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:02.005598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fec4cf-6953-4445-97bb-200d978bc405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:02.006234 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fec4cf-6953-4445-97bb-200d978bc405 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:02.006517 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fec4cf-6953-4445-97bb-200d978bc405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:02.006841 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fec4cf-6953-4445-97bb-200d978bc405 admin admin] PATH_INFO: `/v3/projects/9023313e3d024eae9bcf2fc9e8fe7cd3/users/f0653025b4c64dc9b408a1c1a3226141/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:02.009011 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:02.023568 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fec4cf-6953-4445-97bb-200d978bc405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9023313e3d024eae9bcf2fc9e8fe7cd3, user_id=f0653025b4c64dc9b408a1c1a3226141, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:02.026224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fec4cf-6953-4445-97bb-200d978bc405 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:02.038791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1344/2699] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:01 2022] PUT /identity/v3/projects/9023313e3d024eae9bcf2fc9e8fe7cd3/users/f0653025b4c64dc9b408a1c1a3226141/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:02.049296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf0fe7-b9c9-495c-b996-3c38c1c5e170 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:02.049585 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf0fe7-b9c9-495c-b996-3c38c1c5e170 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:02.049859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf0fe7-b9c9-495c-b996-3c38c1c5e170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:02.077501 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b7cf0fe7-b9c9-495c-b996-3c38c1c5e170 None None] MFA Rules not processed for user `f0653025b4c64dc9b408a1c1a3226141`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:02.078746 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b7cf0fe7-b9c9-495c-b996-3c38c1c5e170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:02.142553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1356/2700] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:02.147114 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fec4cf-6953-4445-97bb-200d978bc405 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:02.209836 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fec4cf-6953-4445-97bb-200d978bc405 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:02.214442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a8942-e299-44c9-ab89-b0047660ced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:02.215074 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a8942-e299-44c9-ab89-b0047660ced1 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:02.215352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a8942-e299-44c9-ab89-b0047660ced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:02.215623 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a8942-e299-44c9-ab89-b0047660ced1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:02.216267 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a8942-e299-44c9-ab89-b0047660ced1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:02.218164 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a8942-e299-44c9-ab89-b0047660ced1 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:02.244739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1345/2701] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:02 2022] POST /identity/v3/projects => generated 357 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:02.248971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf0fe7-b9c9-495c-b996-3c38c1c5e170 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:02.259702 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf0fe7-b9c9-495c-b996-3c38c1c5e170 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:02.315845 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8dd90-9b10-4b69-bf90-f1c3a29fb653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:02.316446 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8dd90-9b10-4b69-bf90-f1c3a29fb653 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:02.316722 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8dd90-9b10-4b69-bf90-f1c3a29fb653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:02.316992 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8dd90-9b10-4b69-bf90-f1c3a29fb653 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:02.317624 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8dd90-9b10-4b69-bf90-f1c3a29fb653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:02.319569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8dd90-9b10-4b69-bf90-f1c3a29fb653 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:02.340650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1357/2702] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:02 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:02.344769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a8942-e299-44c9-ab89-b0047660ced1 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:02.355504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a8942-e299-44c9-ab89-b0047660ced1 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:02.360839 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123b716-547c-4534-b902-951c575f6a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:02.361436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123b716-547c-4534-b902-951c575f6a92 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:02.361710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123b716-547c-4534-b902-951c575f6a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:02.361984 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123b716-547c-4534-b902-951c575f6a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:02.362645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123b716-547c-4534-b902-951c575f6a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:02.364721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123b716-547c-4534-b902-951c575f6a92 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:02.375063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1346/2703] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:02.379155 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8dd90-9b10-4b69-bf90-f1c3a29fb653 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:02.389464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8dd90-9b10-4b69-bf90-f1c3a29fb653 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:02.394269 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa925097-870f-4739-955e-6d4c8ea6e784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:02.394948 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa925097-870f-4739-955e-6d4c8ea6e784 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:02.395225 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa925097-870f-4739-955e-6d4c8ea6e784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:02.395499 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa925097-870f-4739-955e-6d4c8ea6e784 admin admin] PATH_INFO: `/v3/projects/e93a95acd6ee4a52aadae36dacae985f/users/e3dfeabc137d498ab2768cf0b8f5f12e/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:02.531699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa925097-870f-4739-955e-6d4c8ea6e784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93a95acd6ee4a52aadae36dacae985f, user_id=e3dfeabc137d498ab2768cf0b8f5f12e, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:02.534292 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa925097-870f-4739-955e-6d4c8ea6e784 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:02.547482 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1358/2704] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:02 2022] PUT /identity/v3/projects/e93a95acd6ee4a52aadae36dacae985f/users/e3dfeabc137d498ab2768cf0b8f5f12e/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:02.551971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123b716-547c-4534-b902-951c575f6a92 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:02.561878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123b716-547c-4534-b902-951c575f6a92 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:02.618598 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba66c3d-0780-4c65-a59a-2462ce42e074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:02.619244 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba66c3d-0780-4c65-a59a-2462ce42e074 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:02.619527 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba66c3d-0780-4c65-a59a-2462ce42e074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:02.619800 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba66c3d-0780-4c65-a59a-2462ce42e074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:02.620473 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba66c3d-0780-4c65-a59a-2462ce42e074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:02.622083 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba66c3d-0780-4c65-a59a-2462ce42e074 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:02.632331 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1347/2705] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:02.636459 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa925097-870f-4739-955e-6d4c8ea6e784 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:02.646568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa925097-870f-4739-955e-6d4c8ea6e784 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:02.651051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48813399-dc60-4d06-92d4-e5c7df2fd168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:02.651710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48813399-dc60-4d06-92d4-e5c7df2fd168 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:02.651982 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48813399-dc60-4d06-92d4-e5c7df2fd168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:02.652248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48813399-dc60-4d06-92d4-e5c7df2fd168 admin admin] PATH_INFO: `/v3/projects/e93a95acd6ee4a52aadae36dacae985f/users/e3dfeabc137d498ab2768cf0b8f5f12e/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:02.654117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48813399-dc60-4d06-92d4-e5c7df2fd168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93a95acd6ee4a52aadae36dacae985f, user_id=e3dfeabc137d498ab2768cf0b8f5f12e, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:02.656701 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48813399-dc60-4d06-92d4-e5c7df2fd168 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:02.659675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:02.667928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1359/2706] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:02 2022] PUT /identity/v3/projects/e93a95acd6ee4a52aadae36dacae985f/users/e3dfeabc137d498ab2768cf0b8f5f12e/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:02.679855 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7372c4-c0e2-40b0-b372-666459b02750 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:02.680136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7372c4-c0e2-40b0-b372-666459b02750 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:02.680405 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7372c4-c0e2-40b0-b372-666459b02750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:02.710510 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-0e7372c4-c0e2-40b0-b372-666459b02750 None None] MFA Rules not processed for user `e3dfeabc137d498ab2768cf0b8f5f12e`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:02.711739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0e7372c4-c0e2-40b0-b372-666459b02750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:02.752909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:02.780906 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1348/2707] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:02.792836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48813399-dc60-4d06-92d4-e5c7df2fd168 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:02.794519 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-48813399-dc60-4d06-92d4-e5c7df2fd168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:02.850488 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48813399-dc60-4d06-92d4-e5c7df2fd168 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:02.854145 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c6253-c89c-44f2-95c8-d4a36a84f46e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:02.854767 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c6253-c89c-44f2-95c8-d4a36a84f46e service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:02.855045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c6253-c89c-44f2-95c8-d4a36a84f46e service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:02.855316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c6253-c89c-44f2-95c8-d4a36a84f46e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:02.864623 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c6253-c89c-44f2-95c8-d4a36a84f46e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:02.866017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c6253-c89c-44f2-95c8-d4a36a84f46e service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:02.875185 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1360/2708] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:02 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:02.951010 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7372c4-c0e2-40b0-b372-666459b02750 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:02.960586 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7372c4-c0e2-40b0-b372-666459b02750 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:02.964358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0ee0e-149f-4cb2-8075-2f19583f9de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:02.964942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0ee0e-149f-4cb2-8075-2f19583f9de6 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:02.965216 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0ee0e-149f-4cb2-8075-2f19583f9de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:02.965483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0ee0e-149f-4cb2-8075-2f19583f9de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:03.023678 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0ee0e-149f-4cb2-8075-2f19583f9de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:03.025102 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0ee0e-149f-4cb2-8075-2f19583f9de6 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:03.034068 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1349/2709] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:12.871057 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=28 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:13.029928 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=38 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:17.954404 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c6253-c89c-44f2-95c8-d4a36a84f46e service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:18.014586 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c6253-c89c-44f2-95c8-d4a36a84f46e service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:18.019542 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e982f-0c52-40e6-ac75-addb81382f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:18.020147 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e982f-0c52-40e6-ac75-addb81382f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:18.020418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e982f-0c52-40e6-ac75-addb81382f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:18.020679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e982f-0c52-40e6-ac75-addb81382f0d admin admin] PATH_INFO: `/v3/users/f0653025b4c64dc9b408a1c1a3226141` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:18.021769 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e982f-0c52-40e6-ac75-addb81382f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0653025b4c64dc9b408a1c1a3226141)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:18.023847 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e982f-0c52-40e6-ac75-addb81382f0d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:18.067018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-685e982f-0c52-40e6-ac75-addb81382f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0653025b4c64dc9b408a1c1a3226141'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.067658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-685e982f-0c52-40e6-ac75-addb81382f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0653025b4c64dc9b408a1c1a3226141'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.075360 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-685e982f-0c52-40e6-ac75-addb81382f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0653025b4c64dc9b408a1c1a3226141'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.088114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-685e982f-0c52-40e6-ac75-addb81382f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0653025b4c64dc9b408a1c1a3226141'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.094815 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-685e982f-0c52-40e6-ac75-addb81382f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0653025b4c64dc9b408a1c1a3226141'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.101360 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1361/2710] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:17 2022] DELETE /identity/v3/users/f0653025b4c64dc9b408a1c1a3226141 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:18.106389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67950fb5-ae41-41e9-b670-fc71d85a1fa5 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:18.107058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67950fb5-ae41-41e9-b670-fc71d85a1fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:18.107058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67950fb5-ae41-41e9-b670-fc71d85a1fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:18.125787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-67950fb5-ae41-41e9-b670-fc71d85a1fa5 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:18.127031 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-67950fb5-ae41-41e9-b670-fc71d85a1fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:18.184452 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1350/2711] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:18.194818 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e982f-0c52-40e6-ac75-addb81382f0d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:18.196248 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-685e982f-0c52-40e6-ac75-addb81382f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:18.258495 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e982f-0c52-40e6-ac75-addb81382f0d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:18.262133 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921db4ef-c4ac-4d1e-9b8f-2339f183e0a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:18.262763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921db4ef-c4ac-4d1e-9b8f-2339f183e0a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:18.263044 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921db4ef-c4ac-4d1e-9b8f-2339f183e0a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:18.263315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921db4ef-c4ac-4d1e-9b8f-2339f183e0a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:18.272305 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921db4ef-c4ac-4d1e-9b8f-2339f183e0a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:18.273710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921db4ef-c4ac-4d1e-9b8f-2339f183e0a1 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:18.282989 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1362/2712] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:18.550001 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67950fb5-ae41-41e9-b670-fc71d85a1fa5 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:18.551491 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-67950fb5-ae41-41e9-b670-fc71d85a1fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:18.566147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67950fb5-ae41-41e9-b670-fc71d85a1fa5 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:18.570925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:18.571560 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:18.572689 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:18.572974 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94 admin admin] PATH_INFO: `/v3/projects/9023313e3d024eae9bcf2fc9e8fe7cd3` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:18.574310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9023313e3d024eae9bcf2fc9e8fe7cd3)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:18.576256 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:18.628812 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9023313e3d024eae9bcf2fc9e8fe7cd3', 'request_id': 'req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.637057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9023313e3d024eae9bcf2fc9e8fe7cd3', 'request_id': 'req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.643429 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9023313e3d024eae9bcf2fc9e8fe7cd3', 'request_id': 'req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.654135 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94 admin admin] The token cache is being invalidate because project 9023313e3d024eae9bcf2fc9e8fe7cd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:18.654459 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.655129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.656618 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1351/2713] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:18 2022] DELETE /identity/v3/projects/9023313e3d024eae9bcf2fc9e8fe7cd3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:18.660715 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921db4ef-c4ac-4d1e-9b8f-2339f183e0a1 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:18.670407 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921db4ef-c4ac-4d1e-9b8f-2339f183e0a1 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:18.688722 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:18.733325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00110e6d-d132-41d7-8621-d80132706dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:18.733956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00110e6d-d132-41d7-8621-d80132706dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:18.734235 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00110e6d-d132-41d7-8621-d80132706dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:18.734512 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00110e6d-d132-41d7-8621-d80132706dd7 admin admin] PATH_INFO: `/v3/users/e3dfeabc137d498ab2768cf0b8f5f12e` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:18.735830 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00110e6d-d132-41d7-8621-d80132706dd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3dfeabc137d498ab2768cf0b8f5f12e)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:18.738358 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00110e6d-d132-41d7-8621-d80132706dd7 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:18.789170 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-00110e6d-d132-41d7-8621-d80132706dd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3dfeabc137d498ab2768cf0b8f5f12e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.789892 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-00110e6d-d132-41d7-8621-d80132706dd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3dfeabc137d498ab2768cf0b8f5f12e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.798900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-00110e6d-d132-41d7-8621-d80132706dd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3dfeabc137d498ab2768cf0b8f5f12e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.813282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-00110e6d-d132-41d7-8621-d80132706dd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3dfeabc137d498ab2768cf0b8f5f12e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.820780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-00110e6d-d132-41d7-8621-d80132706dd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3dfeabc137d498ab2768cf0b8f5f12e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.827389 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1363/2714] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:18 2022] DELETE /identity/v3/users/e3dfeabc137d498ab2768cf0b8f5f12e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:19.099916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:19.101633 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:19.118706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabfbb0-e9be-4d63-8d8e-b3abaeac3a94 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:19.175374 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0d728-e99c-4c55-8e26-3b3499570709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:19.176019 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d728-e99c-4c55-8e26-3b3499570709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:19.176294 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d728-e99c-4c55-8e26-3b3499570709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:19.176562 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d728-e99c-4c55-8e26-3b3499570709 admin admin] PATH_INFO: `/v3/projects/e93a95acd6ee4a52aadae36dacae985f` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:19.177671 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0d728-e99c-4c55-8e26-3b3499570709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93a95acd6ee4a52aadae36dacae985f)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:19.179744 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0d728-e99c-4c55-8e26-3b3499570709 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:19.210124 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:19.227498 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c1a0d728-e99c-4c55-8e26-3b3499570709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93a95acd6ee4a52aadae36dacae985f', 'request_id': 'req-c1a0d728-e99c-4c55-8e26-3b3499570709'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:19.234651 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c1a0d728-e99c-4c55-8e26-3b3499570709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93a95acd6ee4a52aadae36dacae985f', 'request_id': 'req-c1a0d728-e99c-4c55-8e26-3b3499570709'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:19.240782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c1a0d728-e99c-4c55-8e26-3b3499570709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93a95acd6ee4a52aadae36dacae985f', 'request_id': 'req-c1a0d728-e99c-4c55-8e26-3b3499570709'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:19.250878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c1a0d728-e99c-4c55-8e26-3b3499570709 admin admin] The token cache is being invalidate because project e93a95acd6ee4a52aadae36dacae985f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:19.251163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c1a0d728-e99c-4c55-8e26-3b3499570709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:19.251791 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-c1a0d728-e99c-4c55-8e26-3b3499570709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:19.253816 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1352/2715] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:19 2022] DELETE /identity/v3/projects/e93a95acd6ee4a52aadae36dacae985f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:19.258661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa741ff6-a5a6-4e63-8699-98866735b359 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:19.259137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa741ff6-a5a6-4e63-8699-98866735b359 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:19.259239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa741ff6-a5a6-4e63-8699-98866735b359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:19.279409 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-aa741ff6-a5a6-4e63-8699-98866735b359 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:19.280823 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-aa741ff6-a5a6-4e63-8699-98866735b359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:19.341027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1364/2716] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:19.348871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788413e-9535-4963-933b-b145fc385afa None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:19.349160 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788413e-9535-4963-933b-b145fc385afa None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:19.349439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788413e-9535-4963-933b-b145fc385afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:19.368733 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-1788413e-9535-4963-933b-b145fc385afa None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:19.369924 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1788413e-9535-4963-933b-b145fc385afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:19.378224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1353/2717] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:19.382411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa741ff6-a5a6-4e63-8699-98866735b359 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:19.392122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa741ff6-a5a6-4e63-8699-98866735b359 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:19.397255 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b783a-43d5-49bb-be9a-c94913bf557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:19.397845 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b783a-43d5-49bb-be9a-c94913bf557b admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:19.398128 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b783a-43d5-49bb-be9a-c94913bf557b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:19.398402 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b783a-43d5-49bb-be9a-c94913bf557b admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:19.399093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b783a-43d5-49bb-be9a-c94913bf557b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:19.399398 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b783a-43d5-49bb-be9a-c94913bf557b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:19.400976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b783a-43d5-49bb-be9a-c94913bf557b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:19.412295 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1365/2718] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:19.416543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788413e-9535-4963-933b-b145fc385afa None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:19.425579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788413e-9535-4963-933b-b145fc385afa None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:19.430168 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4921c4-d01b-439f-8c0d-415fc57619c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:19.430788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4921c4-d01b-439f-8c0d-415fc57619c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:19.431067 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4921c4-d01b-439f-8c0d-415fc57619c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:19.431336 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4921c4-d01b-439f-8c0d-415fc57619c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:19.431969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4921c4-d01b-439f-8c0d-415fc57619c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:19.433853 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4921c4-d01b-439f-8c0d-415fc57619c4 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:19.462573 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1354/2719] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:19 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:19.466912 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b783a-43d5-49bb-be9a-c94913bf557b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:19.477141 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b783a-43d5-49bb-be9a-c94913bf557b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:19.503996 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:19.543268 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11633261-3742-44cd-a07e-03a39156cde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:19.543865 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11633261-3742-44cd-a07e-03a39156cde6 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:19.544141 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11633261-3742-44cd-a07e-03a39156cde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:19.544411 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11633261-3742-44cd-a07e-03a39156cde6 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:19.545045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11633261-3742-44cd-a07e-03a39156cde6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:19.547021 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11633261-3742-44cd-a07e-03a39156cde6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:19.568845 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1366/2720] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:19 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:19.573457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4921c4-d01b-439f-8c0d-415fc57619c4 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:19.583903 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4921c4-d01b-439f-8c0d-415fc57619c4 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:19.588546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dd41d-a3ed-4622-8fda-97720cb2efc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:19.589138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dd41d-a3ed-4622-8fda-97720cb2efc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:19.589419 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dd41d-a3ed-4622-8fda-97720cb2efc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:19.589691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dd41d-a3ed-4622-8fda-97720cb2efc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:19.590328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96dd41d-a3ed-4622-8fda-97720cb2efc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:19.591937 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96dd41d-a3ed-4622-8fda-97720cb2efc1 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:19.601722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1355/2721] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:19.605688 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11633261-3742-44cd-a07e-03a39156cde6 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:19.616222 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11633261-3742-44cd-a07e-03a39156cde6 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:19.620823 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b6078-69c3-4805-941f-18f43f223924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:19.621416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b6078-69c3-4805-941f-18f43f223924 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:19.621694 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b6078-69c3-4805-941f-18f43f223924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:19.621965 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b6078-69c3-4805-941f-18f43f223924 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:19.622599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b6078-69c3-4805-941f-18f43f223924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:19.624199 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b6078-69c3-4805-941f-18f43f223924 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:19.635096 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1367/2722] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:19.639264 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dd41d-a3ed-4622-8fda-97720cb2efc1 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:19.649470 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dd41d-a3ed-4622-8fda-97720cb2efc1 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:19.654051 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57567c0-a257-4f5d-aa18-f97c6fcb729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:19.654735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57567c0-a257-4f5d-aa18-f97c6fcb729d admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:19.655010 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57567c0-a257-4f5d-aa18-f97c6fcb729d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:19.655280 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57567c0-a257-4f5d-aa18-f97c6fcb729d admin admin] PATH_INFO: `/v3/projects/1b65632aaa4a45269921926748989188/users/c499b74ca4e545e3a58cc3e9bf67bf21/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:19.670794 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57567c0-a257-4f5d-aa18-f97c6fcb729d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b65632aaa4a45269921926748989188, user_id=c499b74ca4e545e3a58cc3e9bf67bf21, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:19.673446 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57567c0-a257-4f5d-aa18-f97c6fcb729d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:19.686788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1356/2723] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:19 2022] PUT /identity/v3/projects/1b65632aaa4a45269921926748989188/users/c499b74ca4e545e3a58cc3e9bf67bf21/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:19.699795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad742ca2-16a1-46a5-b610-a44d01624b78 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:19.700086 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad742ca2-16a1-46a5-b610-a44d01624b78 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:19.700356 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad742ca2-16a1-46a5-b610-a44d01624b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:19.728038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ad742ca2-16a1-46a5-b610-a44d01624b78 None None] MFA Rules not processed for user `c499b74ca4e545e3a58cc3e9bf67bf21`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:19.729234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ad742ca2-16a1-46a5-b610-a44d01624b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:19.790402 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1368/2724] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:19.795085 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57567c0-a257-4f5d-aa18-f97c6fcb729d admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:19.857130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57567c0-a257-4f5d-aa18-f97c6fcb729d admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:19.861757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413384b-7000-48e8-aa06-62f87968b37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:19.862395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413384b-7000-48e8-aa06-62f87968b37c admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:19.862716 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413384b-7000-48e8-aa06-62f87968b37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:19.862999 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413384b-7000-48e8-aa06-62f87968b37c admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:19.863638 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413384b-7000-48e8-aa06-62f87968b37c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:19.865559 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413384b-7000-48e8-aa06-62f87968b37c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:19.892383 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1357/2725] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:19 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:19.897184 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad742ca2-16a1-46a5-b610-a44d01624b78 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:19.907792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad742ca2-16a1-46a5-b610-a44d01624b78 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:19.966772 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da079a38-aa67-47bc-ba73-af8c2518ad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:19.967373 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da079a38-aa67-47bc-ba73-af8c2518ad3d admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:19.967727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da079a38-aa67-47bc-ba73-af8c2518ad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:19.968000 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da079a38-aa67-47bc-ba73-af8c2518ad3d admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:19.968663 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da079a38-aa67-47bc-ba73-af8c2518ad3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:19.970555 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da079a38-aa67-47bc-ba73-af8c2518ad3d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:19.991156 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1369/2726] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:19 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:19.995280 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413384b-7000-48e8-aa06-62f87968b37c admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:20.005854 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413384b-7000-48e8-aa06-62f87968b37c admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:20.010509 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0984e2-9ec6-4e2c-a7b6-eef80a33448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:20.011176 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0984e2-9ec6-4e2c-a7b6-eef80a33448b admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:20.011458 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0984e2-9ec6-4e2c-a7b6-eef80a33448b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:20.011734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0984e2-9ec6-4e2c-a7b6-eef80a33448b admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:20.012373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0984e2-9ec6-4e2c-a7b6-eef80a33448b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:20.013951 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0984e2-9ec6-4e2c-a7b6-eef80a33448b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:20.024875 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1358/2727] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:20.028894 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da079a38-aa67-47bc-ba73-af8c2518ad3d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:20.038843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da079a38-aa67-47bc-ba73-af8c2518ad3d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:20.043495 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8636dba-5af5-4899-870a-040374ef313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:20.044057 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8636dba-5af5-4899-870a-040374ef313d admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:20.044332 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8636dba-5af5-4899-870a-040374ef313d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:20.044622 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8636dba-5af5-4899-870a-040374ef313d admin admin] PATH_INFO: `/v3/projects/c0e2202990354d98b129896583907ddd/users/8074dca45a714f11941f93b172eac7ba/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:20.058959 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8636dba-5af5-4899-870a-040374ef313d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e2202990354d98b129896583907ddd, user_id=8074dca45a714f11941f93b172eac7ba, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:20.061569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8636dba-5af5-4899-870a-040374ef313d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:20.074851 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1370/2728] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:20 2022] PUT /identity/v3/projects/c0e2202990354d98b129896583907ddd/users/8074dca45a714f11941f93b172eac7ba/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:20.078896 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0984e2-9ec6-4e2c-a7b6-eef80a33448b admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:20.089566 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0984e2-9ec6-4e2c-a7b6-eef80a33448b admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:20.110904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:20.148885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb4375-e5fd-4fe6-9a0b-3169162957e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:20.149542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb4375-e5fd-4fe6-9a0b-3169162957e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:20.149746 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb4375-e5fd-4fe6-9a0b-3169162957e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:20.150011 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb4375-e5fd-4fe6-9a0b-3169162957e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:20.150661 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb4375-e5fd-4fe6-9a0b-3169162957e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:20.152225 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb4375-e5fd-4fe6-9a0b-3169162957e4 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:20.161741 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1359/2729] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:20.165934 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8636dba-5af5-4899-870a-040374ef313d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:20.171345 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:20.178152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8636dba-5af5-4899-870a-040374ef313d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:20.182876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cecc4-a52a-49d5-8daa-8b2c1b29fe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:20.183512 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cecc4-a52a-49d5-8daa-8b2c1b29fe52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:20.183786 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cecc4-a52a-49d5-8daa-8b2c1b29fe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:20.184051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cecc4-a52a-49d5-8daa-8b2c1b29fe52 admin admin] PATH_INFO: `/v3/projects/c0e2202990354d98b129896583907ddd/users/8074dca45a714f11941f93b172eac7ba/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:20.185927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cecc4-a52a-49d5-8daa-8b2c1b29fe52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e2202990354d98b129896583907ddd, user_id=8074dca45a714f11941f93b172eac7ba, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:20.188610 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cecc4-a52a-49d5-8daa-8b2c1b29fe52 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:20.200965 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1371/2730] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:20 2022] PUT /identity/v3/projects/c0e2202990354d98b129896583907ddd/users/8074dca45a714f11941f93b172eac7ba/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:20.211655 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de6c74-efd8-49be-a693-b244823170f0 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:20.211936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de6c74-efd8-49be-a693-b244823170f0 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:20.212207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de6c74-efd8-49be-a693-b244823170f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:20.243703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-c8de6c74-efd8-49be-a693-b244823170f0 None None] MFA Rules not processed for user `8074dca45a714f11941f93b172eac7ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:20.244911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c8de6c74-efd8-49be-a693-b244823170f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:20.313028 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1360/2731] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:20.324295 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cecc4-a52a-49d5-8daa-8b2c1b29fe52 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:20.326075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-214cecc4-a52a-49d5-8daa-8b2c1b29fe52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:20.381807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cecc4-a52a-49d5-8daa-8b2c1b29fe52 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:20.385451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60921c-a9d9-45c6-9911-a7b38e5a6de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:20.386043 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60921c-a9d9-45c6-9911-a7b38e5a6de7 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:20.386321 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60921c-a9d9-45c6-9911-a7b38e5a6de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:20.386591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60921c-a9d9-45c6-9911-a7b38e5a6de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:20.396234 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60921c-a9d9-45c6-9911-a7b38e5a6de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:20.397645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60921c-a9d9-45c6-9911-a7b38e5a6de7 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:20.407785 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1372/2732] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:20.511021 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de6c74-efd8-49be-a693-b244823170f0 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:20.521123 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de6c74-efd8-49be-a693-b244823170f0 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:20.524673 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a15a2b-f45d-4c48-8e30-13a2253b2812 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:20.525268 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a15a2b-f45d-4c48-8e30-13a2253b2812 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:20.525546 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a15a2b-f45d-4c48-8e30-13a2253b2812 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:20.525818 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a15a2b-f45d-4c48-8e30-13a2253b2812 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:20.589179 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a15a2b-f45d-4c48-8e30-13a2253b2812 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:20.590515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a15a2b-f45d-4c48-8e30-13a2253b2812 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:20.600521 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1361/2733] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:23.175787 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60921c-a9d9-45c6-9911-a7b38e5a6de7 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:23.235991 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60921c-a9d9-45c6-9911-a7b38e5a6de7 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:23.240915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21552b2b-0ff2-437a-87cf-e891b7ace051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:23.241522 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21552b2b-0ff2-437a-87cf-e891b7ace051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:23.241795 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21552b2b-0ff2-437a-87cf-e891b7ace051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:23.242061 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21552b2b-0ff2-437a-87cf-e891b7ace051 admin admin] PATH_INFO: `/v3/users/c499b74ca4e545e3a58cc3e9bf67bf21` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:23.243183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21552b2b-0ff2-437a-87cf-e891b7ace051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c499b74ca4e545e3a58cc3e9bf67bf21)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:23.245063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21552b2b-0ff2-437a-87cf-e891b7ace051 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:23.290489 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-21552b2b-0ff2-437a-87cf-e891b7ace051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c499b74ca4e545e3a58cc3e9bf67bf21'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:23.291192 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-21552b2b-0ff2-437a-87cf-e891b7ace051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c499b74ca4e545e3a58cc3e9bf67bf21'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:23.298237 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-21552b2b-0ff2-437a-87cf-e891b7ace051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c499b74ca4e545e3a58cc3e9bf67bf21'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:23.311850 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-21552b2b-0ff2-437a-87cf-e891b7ace051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c499b74ca4e545e3a58cc3e9bf67bf21'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:23.319772 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-21552b2b-0ff2-437a-87cf-e891b7ace051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c499b74ca4e545e3a58cc3e9bf67bf21'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:23.326875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1373/2734] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:23 2022] DELETE /identity/v3/users/c499b74ca4e545e3a58cc3e9bf67bf21 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:23.331358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501a48f-ae0d-4a2c-8386-e43d4704bace None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:23.331844 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501a48f-ae0d-4a2c-8386-e43d4704bace None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:23.331958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501a48f-ae0d-4a2c-8386-e43d4704bace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:23.350504 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-1501a48f-ae0d-4a2c-8386-e43d4704bace None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:23.351743 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1501a48f-ae0d-4a2c-8386-e43d4704bace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:23.390947 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:23.411024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1362/2735] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:23.420568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21552b2b-0ff2-437a-87cf-e891b7ace051 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:23.421984 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-21552b2b-0ff2-437a-87cf-e891b7ace051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:23.435680 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:23.479787 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21552b2b-0ff2-437a-87cf-e891b7ace051 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:23.483416 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f0f88-bc63-4ee9-a8df-f6109b84761c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:23.484006 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f0f88-bc63-4ee9-a8df-f6109b84761c service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:23.484282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f0f88-bc63-4ee9-a8df-f6109b84761c service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:23.484551 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f0f88-bc63-4ee9-a8df-f6109b84761c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:23.493915 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f0f88-bc63-4ee9-a8df-f6109b84761c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:23.495377 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f0f88-bc63-4ee9-a8df-f6109b84761c service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:23.505392 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1374/2736] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:23.769038 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501a48f-ae0d-4a2c-8386-e43d4704bace None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:23.770583 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-1501a48f-ae0d-4a2c-8386-e43d4704bace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:23.783735 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501a48f-ae0d-4a2c-8386-e43d4704bace None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:23.788619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de7d66-8049-4109-aa58-c13915ba7e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:23.789255 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de7d66-8049-4109-aa58-c13915ba7e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:23.789542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de7d66-8049-4109-aa58-c13915ba7e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:23.789811 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de7d66-8049-4109-aa58-c13915ba7e8e admin admin] PATH_INFO: `/v3/projects/1b65632aaa4a45269921926748989188` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:23.790985 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de7d66-8049-4109-aa58-c13915ba7e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b65632aaa4a45269921926748989188)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:23.792900 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de7d66-8049-4109-aa58-c13915ba7e8e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:23.839704 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a3de7d66-8049-4109-aa58-c13915ba7e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b65632aaa4a45269921926748989188', 'request_id': 'req-a3de7d66-8049-4109-aa58-c13915ba7e8e'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:23.847720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a3de7d66-8049-4109-aa58-c13915ba7e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b65632aaa4a45269921926748989188', 'request_id': 'req-a3de7d66-8049-4109-aa58-c13915ba7e8e'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:23.853875 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a3de7d66-8049-4109-aa58-c13915ba7e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b65632aaa4a45269921926748989188', 'request_id': 'req-a3de7d66-8049-4109-aa58-c13915ba7e8e'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:23.864829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a3de7d66-8049-4109-aa58-c13915ba7e8e admin admin] The token cache is being invalidate because project 1b65632aaa4a45269921926748989188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:23.865114 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a3de7d66-8049-4109-aa58-c13915ba7e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:23.865763 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a3de7d66-8049-4109-aa58-c13915ba7e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:23.867342 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1363/2737] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:23 2022] DELETE /identity/v3/projects/1b65632aaa4a45269921926748989188 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:23.871351 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f0f88-bc63-4ee9-a8df-f6109b84761c service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:23.881114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f0f88-bc63-4ee9-a8df-f6109b84761c service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:23.935152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249c116-b1b6-4711-828b-5cced96c1d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:23.935765 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249c116-b1b6-4711-828b-5cced96c1d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:23.936042 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249c116-b1b6-4711-828b-5cced96c1d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:23.936303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249c116-b1b6-4711-828b-5cced96c1d90 admin admin] PATH_INFO: `/v3/users/8074dca45a714f11941f93b172eac7ba` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:23.937391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249c116-b1b6-4711-828b-5cced96c1d90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8074dca45a714f11941f93b172eac7ba)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:23.939292 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249c116-b1b6-4711-828b-5cced96c1d90 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:23.988246 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b249c116-b1b6-4711-828b-5cced96c1d90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8074dca45a714f11941f93b172eac7ba'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:23.988884 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b249c116-b1b6-4711-828b-5cced96c1d90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8074dca45a714f11941f93b172eac7ba'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:23.996698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b249c116-b1b6-4711-828b-5cced96c1d90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8074dca45a714f11941f93b172eac7ba'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.009620 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b249c116-b1b6-4711-828b-5cced96c1d90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8074dca45a714f11941f93b172eac7ba'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.016550 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b249c116-b1b6-4711-828b-5cced96c1d90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8074dca45a714f11941f93b172eac7ba'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.022578 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1375/2738] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:23 2022] DELETE /identity/v3/users/8074dca45a714f11941f93b172eac7ba => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:24.292316 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de7d66-8049-4109-aa58-c13915ba7e8e admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:24.294076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a3de7d66-8049-4109-aa58-c13915ba7e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:24.307935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de7d66-8049-4109-aa58-c13915ba7e8e admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:24.366633 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424760f-7660-4b87-9b37-401417a1f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:24.367324 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424760f-7660-4b87-9b37-401417a1f9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:24.367525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424760f-7660-4b87-9b37-401417a1f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:24.367797 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424760f-7660-4b87-9b37-401417a1f9bb admin admin] PATH_INFO: `/v3/projects/c0e2202990354d98b129896583907ddd` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:24.368908 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424760f-7660-4b87-9b37-401417a1f9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e2202990354d98b129896583907ddd)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:24.370859 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424760f-7660-4b87-9b37-401417a1f9bb admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:24.415882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1424760f-7660-4b87-9b37-401417a1f9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e2202990354d98b129896583907ddd', 'request_id': 'req-1424760f-7660-4b87-9b37-401417a1f9bb'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.423169 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1424760f-7660-4b87-9b37-401417a1f9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e2202990354d98b129896583907ddd', 'request_id': 'req-1424760f-7660-4b87-9b37-401417a1f9bb'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.429312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1424760f-7660-4b87-9b37-401417a1f9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e2202990354d98b129896583907ddd', 'request_id': 'req-1424760f-7660-4b87-9b37-401417a1f9bb'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.435679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:24.441313 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1424760f-7660-4b87-9b37-401417a1f9bb admin admin] The token cache is being invalidate because project c0e2202990354d98b129896583907ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:24.441685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1424760f-7660-4b87-9b37-401417a1f9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.442433 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-1424760f-7660-4b87-9b37-401417a1f9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.444347 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1364/2739] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:24 2022] DELETE /identity/v3/projects/c0e2202990354d98b129896583907ddd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:24.449597 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aae51-0199-4746-ae7a-bae5d3a88d4b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:24.450073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aae51-0199-4746-ae7a-bae5d3a88d4b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:24.450195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aae51-0199-4746-ae7a-bae5d3a88d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:24.469656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-117aae51-0199-4746-ae7a-bae5d3a88d4b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:24.470871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-117aae51-0199-4746-ae7a-bae5d3a88d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:24.499985 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:24.531532 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1376/2740] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:24.540543 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a352ae-24b4-4023-86a3-ec0238612caa None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:24.540826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a352ae-24b4-4023-86a3-ec0238612caa None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:24.541091 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a352ae-24b4-4023-86a3-ec0238612caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:24.560126 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-d0a352ae-24b4-4023-86a3-ec0238612caa None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:24.561310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d0a352ae-24b4-4023-86a3-ec0238612caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:24.569593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1365/2741] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:24.574063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aae51-0199-4746-ae7a-bae5d3a88d4b None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:24.584075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aae51-0199-4746-ae7a-bae5d3a88d4b None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:24.588598 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cf1e1-ef14-4469-af96-93faf61d05f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:24.589181 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cf1e1-ef14-4469-af96-93faf61d05f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:24.589457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cf1e1-ef14-4469-af96-93faf61d05f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:24.589727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cf1e1-ef14-4469-af96-93faf61d05f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:24.590365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cf1e1-ef14-4469-af96-93faf61d05f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:24.590704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cf1e1-ef14-4469-af96-93faf61d05f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:24.592282 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cf1e1-ef14-4469-af96-93faf61d05f5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:24.603272 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1377/2742] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:24.607774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a352ae-24b4-4023-86a3-ec0238612caa None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:24.617092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a352ae-24b4-4023-86a3-ec0238612caa None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:24.621711 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a54a1-7886-4110-b620-d0bad944fc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:24.622304 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a54a1-7886-4110-b620-d0bad944fc96 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:24.622579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a54a1-7886-4110-b620-d0bad944fc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:24.622875 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a54a1-7886-4110-b620-d0bad944fc96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:24.623518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a54a1-7886-4110-b620-d0bad944fc96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:24.625729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a54a1-7886-4110-b620-d0bad944fc96 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:24.652792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1366/2743] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:24 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:24.657117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cf1e1-ef14-4469-af96-93faf61d05f5 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:24.666953 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cf1e1-ef14-4469-af96-93faf61d05f5 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:24.722464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fda9a-52d6-426c-90d6-73e7575de04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:24.723086 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fda9a-52d6-426c-90d6-73e7575de04d admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:24.723363 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fda9a-52d6-426c-90d6-73e7575de04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:24.723636 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fda9a-52d6-426c-90d6-73e7575de04d admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:24.724264 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fda9a-52d6-426c-90d6-73e7575de04d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:24.726139 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fda9a-52d6-426c-90d6-73e7575de04d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:24.754167 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1378/2744] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:24 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:24.758734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a54a1-7886-4110-b620-d0bad944fc96 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:24.768945 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a54a1-7886-4110-b620-d0bad944fc96 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:24.773424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc957173-22a9-4009-8166-82eb8ff4445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:24.774016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc957173-22a9-4009-8166-82eb8ff4445d admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:24.774295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc957173-22a9-4009-8166-82eb8ff4445d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:24.774566 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc957173-22a9-4009-8166-82eb8ff4445d admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:24.775227 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc957173-22a9-4009-8166-82eb8ff4445d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:24.776834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc957173-22a9-4009-8166-82eb8ff4445d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:24.787010 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1367/2745] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:24.790867 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fda9a-52d6-426c-90d6-73e7575de04d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:24.801093 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fda9a-52d6-426c-90d6-73e7575de04d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:24.805598 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa0644-8891-4904-9ca5-123524b2076c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:24.806189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa0644-8891-4904-9ca5-123524b2076c admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:24.806462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa0644-8891-4904-9ca5-123524b2076c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:24.806763 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa0644-8891-4904-9ca5-123524b2076c admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:24.807400 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa0644-8891-4904-9ca5-123524b2076c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:24.808951 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa0644-8891-4904-9ca5-123524b2076c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:24.819718 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1379/2746] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:24.823827 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc957173-22a9-4009-8166-82eb8ff4445d admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:24.833594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc957173-22a9-4009-8166-82eb8ff4445d admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:24.838102 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2c464-ca10-4d8b-92f8-bc40b06d838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:24.838777 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2c464-ca10-4d8b-92f8-bc40b06d838e admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:24.839057 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2c464-ca10-4d8b-92f8-bc40b06d838e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:24.839329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2c464-ca10-4d8b-92f8-bc40b06d838e admin admin] PATH_INFO: `/v3/projects/a32c5adf500c4d31bc131230e66e8689/users/420e4d9f8ee54efbadea15a42ae2c953/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:24.853329 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2c464-ca10-4d8b-92f8-bc40b06d838e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32c5adf500c4d31bc131230e66e8689, user_id=420e4d9f8ee54efbadea15a42ae2c953, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:24.856016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2c464-ca10-4d8b-92f8-bc40b06d838e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:24.869681 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1368/2747] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:24 2022] PUT /identity/v3/projects/a32c5adf500c4d31bc131230e66e8689/users/420e4d9f8ee54efbadea15a42ae2c953/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:24.880354 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475e7d8-2554-4dee-8cdf-e1e58292d468 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:24.880632 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475e7d8-2554-4dee-8cdf-e1e58292d468 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:24.880899 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475e7d8-2554-4dee-8cdf-e1e58292d468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:24.907512 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b475e7d8-2554-4dee-8cdf-e1e58292d468 None None] MFA Rules not processed for user `420e4d9f8ee54efbadea15a42ae2c953`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:24.908703 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b475e7d8-2554-4dee-8cdf-e1e58292d468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:24.969424 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1380/2748] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:24.973969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2c464-ca10-4d8b-92f8-bc40b06d838e admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:25.034370 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2c464-ca10-4d8b-92f8-bc40b06d838e admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:25.039087 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9d34c-7cf8-4441-be9d-3ae341ec8e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:25.039618 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9d34c-7cf8-4441-be9d-3ae341ec8e52 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.039899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9d34c-7cf8-4441-be9d-3ae341ec8e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.040172 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9d34c-7cf8-4441-be9d-3ae341ec8e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.040806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9d34c-7cf8-4441-be9d-3ae341ec8e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:25.042710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9d34c-7cf8-4441-be9d-3ae341ec8e52 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:25.069676 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1369/2749] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:24 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:25.074180 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475e7d8-2554-4dee-8cdf-e1e58292d468 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:25.084741 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475e7d8-2554-4dee-8cdf-e1e58292d468 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:25.111635 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:25.142589 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679861a-12c4-44a6-b69a-ddc0db5424b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:25.143223 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679861a-12c4-44a6-b69a-ddc0db5424b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.143501 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679861a-12c4-44a6-b69a-ddc0db5424b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.143773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679861a-12c4-44a6-b69a-ddc0db5424b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.144396 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679861a-12c4-44a6-b69a-ddc0db5424b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:25.146278 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679861a-12c4-44a6-b69a-ddc0db5424b9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:25.167816 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1381/2750] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:25 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:25.172105 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9d34c-7cf8-4441-be9d-3ae341ec8e52 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:25.182964 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9d34c-7cf8-4441-be9d-3ae341ec8e52 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:25.188085 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8baceb-a6a2-4b11-912b-9cb374229879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:25.188679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8baceb-a6a2-4b11-912b-9cb374229879 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.188960 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8baceb-a6a2-4b11-912b-9cb374229879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.189233 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8baceb-a6a2-4b11-912b-9cb374229879 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.189871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8baceb-a6a2-4b11-912b-9cb374229879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:25.191486 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8baceb-a6a2-4b11-912b-9cb374229879 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:25.202458 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1370/2751] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:25.206741 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679861a-12c4-44a6-b69a-ddc0db5424b9 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:25.216577 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679861a-12c4-44a6-b69a-ddc0db5424b9 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:25.221933 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beae4df-7939-476d-a7d1-76e4153f9d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:25.222586 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beae4df-7939-476d-a7d1-76e4153f9d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.222891 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beae4df-7939-476d-a7d1-76e4153f9d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.223164 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beae4df-7939-476d-a7d1-76e4153f9d86 admin admin] PATH_INFO: `/v3/projects/8754326fa7ce46dda290d21400265b60/users/209e1b1df1a9411883d342bbd8db7baa/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.238209 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beae4df-7939-476d-a7d1-76e4153f9d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8754326fa7ce46dda290d21400265b60, user_id=209e1b1df1a9411883d342bbd8db7baa, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:25.240875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beae4df-7939-476d-a7d1-76e4153f9d86 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:25.253875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1382/2752] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:25 2022] PUT /identity/v3/projects/8754326fa7ce46dda290d21400265b60/users/209e1b1df1a9411883d342bbd8db7baa/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:25.257965 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8baceb-a6a2-4b11-912b-9cb374229879 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:25.267932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8baceb-a6a2-4b11-912b-9cb374229879 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:25.327670 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a0fab-ae75-4748-bf1e-e1b399619ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:25.328284 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a0fab-ae75-4748-bf1e-e1b399619ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.328566 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a0fab-ae75-4748-bf1e-e1b399619ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.328838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a0fab-ae75-4748-bf1e-e1b399619ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.329473 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a0fab-ae75-4748-bf1e-e1b399619ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:25.331089 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a0fab-ae75-4748-bf1e-e1b399619ae0 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:25.341146 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1371/2753] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:25.345325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beae4df-7939-476d-a7d1-76e4153f9d86 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:25.355973 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beae4df-7939-476d-a7d1-76e4153f9d86 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:25.360604 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecfe26-4510-4c7c-881f-6fa2cdceb818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:25.361243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecfe26-4510-4c7c-881f-6fa2cdceb818 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.361521 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecfe26-4510-4c7c-881f-6fa2cdceb818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.361793 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecfe26-4510-4c7c-881f-6fa2cdceb818 admin admin] PATH_INFO: `/v3/projects/8754326fa7ce46dda290d21400265b60/users/209e1b1df1a9411883d342bbd8db7baa/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.364370 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecfe26-4510-4c7c-881f-6fa2cdceb818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8754326fa7ce46dda290d21400265b60, user_id=209e1b1df1a9411883d342bbd8db7baa, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:25.367049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecfe26-4510-4c7c-881f-6fa2cdceb818 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:25.377129 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1383/2754] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:25 2022] PUT /identity/v3/projects/8754326fa7ce46dda290d21400265b60/users/209e1b1df1a9411883d342bbd8db7baa/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:25.387977 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d3274-9f3b-4368-bbc7-007662eaad5e None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.388465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d3274-9f3b-4368-bbc7-007662eaad5e None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.388574 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d3274-9f3b-4368-bbc7-007662eaad5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.397138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:25.418193 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-cb4d3274-9f3b-4368-bbc7-007662eaad5e None None] MFA Rules not processed for user `209e1b1df1a9411883d342bbd8db7baa`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:25.419448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-cb4d3274-9f3b-4368-bbc7-007662eaad5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:25.486855 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1372/2755] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:25.498128 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecfe26-4510-4c7c-881f-6fa2cdceb818 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:25.499911 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cbecfe26-4510-4c7c-881f-6fa2cdceb818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:25.556168 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecfe26-4510-4c7c-881f-6fa2cdceb818 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:25.559818 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53efced-6261-4810-83ed-05406563e502 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:25.560405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53efced-6261-4810-83ed-05406563e502 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.560689 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53efced-6261-4810-83ed-05406563e502 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.560958 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53efced-6261-4810-83ed-05406563e502 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.570247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53efced-6261-4810-83ed-05406563e502 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:25.571698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53efced-6261-4810-83ed-05406563e502 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:25.581686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1384/2756] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:26.143054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d3274-9f3b-4368-bbc7-007662eaad5e None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:26.204776 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d3274-9f3b-4368-bbc7-007662eaad5e None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:26.209297 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc1511-7e8c-46e7-9c54-2ea45467eb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:26.209914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1511-7e8c-46e7-9c54-2ea45467eb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.210196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1511-7e8c-46e7-9c54-2ea45467eb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.210470 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1511-7e8c-46e7-9c54-2ea45467eb4b admin admin] PATH_INFO: `/v3/users/420e4d9f8ee54efbadea15a42ae2c953` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.211629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc1511-7e8c-46e7-9c54-2ea45467eb4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=420e4d9f8ee54efbadea15a42ae2c953)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:26.213528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc1511-7e8c-46e7-9c54-2ea45467eb4b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:26.259053 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-72fc1511-7e8c-46e7-9c54-2ea45467eb4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '420e4d9f8ee54efbadea15a42ae2c953'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.259719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-72fc1511-7e8c-46e7-9c54-2ea45467eb4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '420e4d9f8ee54efbadea15a42ae2c953'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.271761 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-72fc1511-7e8c-46e7-9c54-2ea45467eb4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '420e4d9f8ee54efbadea15a42ae2c953'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.279035 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-72fc1511-7e8c-46e7-9c54-2ea45467eb4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '420e4d9f8ee54efbadea15a42ae2c953'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.286709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-72fc1511-7e8c-46e7-9c54-2ea45467eb4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '420e4d9f8ee54efbadea15a42ae2c953'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.292728 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1373/2757] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:26 2022] DELETE /identity/v3/users/420e4d9f8ee54efbadea15a42ae2c953 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:26.297186 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce79d59-3319-4104-aeb2-d09bcc92c1df None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.297470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce79d59-3319-4104-aeb2-d09bcc92c1df None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.297739 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce79d59-3319-4104-aeb2-d09bcc92c1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.316024 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1ce79d59-3319-4104-aeb2-d09bcc92c1df None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:26.317211 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1ce79d59-3319-4104-aeb2-d09bcc92c1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:26.374686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1385/2758] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:26.384394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc1511-7e8c-46e7-9c54-2ea45467eb4b admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:26.385815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-72fc1511-7e8c-46e7-9c54-2ea45467eb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:26.397378 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:26.447104 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc1511-7e8c-46e7-9c54-2ea45467eb4b admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:26.451024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d190dc2-a8d1-4867-b79c-92d5175b4847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:26.451619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d190dc2-a8d1-4867-b79c-92d5175b4847 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.451901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d190dc2-a8d1-4867-b79c-92d5175b4847 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.452173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d190dc2-a8d1-4867-b79c-92d5175b4847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.461058 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d190dc2-a8d1-4867-b79c-92d5175b4847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:26.462472 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d190dc2-a8d1-4867-b79c-92d5175b4847 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:26.471823 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1374/2759] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:26.734122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce79d59-3319-4104-aeb2-d09bcc92c1df None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:26.735586 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1ce79d59-3319-4104-aeb2-d09bcc92c1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:26.747203 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce79d59-3319-4104-aeb2-d09bcc92c1df None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:26.752290 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42468b4b-1474-4c99-b93e-b3e714d45fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:26.753452 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42468b4b-1474-4c99-b93e-b3e714d45fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.753727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42468b4b-1474-4c99-b93e-b3e714d45fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.754072 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42468b4b-1474-4c99-b93e-b3e714d45fed admin admin] PATH_INFO: `/v3/projects/a32c5adf500c4d31bc131230e66e8689` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.755173 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42468b4b-1474-4c99-b93e-b3e714d45fed admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32c5adf500c4d31bc131230e66e8689)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:26.757091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42468b4b-1474-4c99-b93e-b3e714d45fed admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:26.778717 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:26.805206 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-42468b4b-1474-4c99-b93e-b3e714d45fed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32c5adf500c4d31bc131230e66e8689', 'request_id': 'req-42468b4b-1474-4c99-b93e-b3e714d45fed'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.811287 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-42468b4b-1474-4c99-b93e-b3e714d45fed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32c5adf500c4d31bc131230e66e8689', 'request_id': 'req-42468b4b-1474-4c99-b93e-b3e714d45fed'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.817291 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-42468b4b-1474-4c99-b93e-b3e714d45fed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32c5adf500c4d31bc131230e66e8689', 'request_id': 'req-42468b4b-1474-4c99-b93e-b3e714d45fed'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.831818 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-42468b4b-1474-4c99-b93e-b3e714d45fed admin admin] The token cache is being invalidate because project a32c5adf500c4d31bc131230e66e8689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:26.832086 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-42468b4b-1474-4c99-b93e-b3e714d45fed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.832837 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-42468b4b-1474-4c99-b93e-b3e714d45fed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.834320 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1386/2760] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:26 2022] DELETE /identity/v3/projects/a32c5adf500c4d31bc131230e66e8689 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:26.838775 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d190dc2-a8d1-4867-b79c-92d5175b4847 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:26.849214 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d190dc2-a8d1-4867-b79c-92d5175b4847 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:26.904427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0f237-ff95-40c2-b74a-74c67957380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:26.904970 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0f237-ff95-40c2-b74a-74c67957380e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.905247 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0f237-ff95-40c2-b74a-74c67957380e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.905514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0f237-ff95-40c2-b74a-74c67957380e admin admin] PATH_INFO: `/v3/users/209e1b1df1a9411883d342bbd8db7baa` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.906654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0f237-ff95-40c2-b74a-74c67957380e admin admin] RBAC: Authorizing `identity:delete_user(user_id=209e1b1df1a9411883d342bbd8db7baa)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:26.908567 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0f237-ff95-40c2-b74a-74c67957380e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:26.959382 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-d4c0f237-ff95-40c2-b74a-74c67957380e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '209e1b1df1a9411883d342bbd8db7baa'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.959382 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-d4c0f237-ff95-40c2-b74a-74c67957380e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '209e1b1df1a9411883d342bbd8db7baa'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.973449 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-d4c0f237-ff95-40c2-b74a-74c67957380e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '209e1b1df1a9411883d342bbd8db7baa'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.980973 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-d4c0f237-ff95-40c2-b74a-74c67957380e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '209e1b1df1a9411883d342bbd8db7baa'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.989110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-d4c0f237-ff95-40c2-b74a-74c67957380e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '209e1b1df1a9411883d342bbd8db7baa'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.995386 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1375/2761] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:26 2022] DELETE /identity/v3/users/209e1b1df1a9411883d342bbd8db7baa => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:27.266758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42468b4b-1474-4c99-b93e-b3e714d45fed admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:27.268283 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-42468b4b-1474-4c99-b93e-b3e714d45fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:27.283247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42468b4b-1474-4c99-b93e-b3e714d45fed admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:27.340817 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e844b2e-1efd-4532-9b64-1623a594db54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:27.341437 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e844b2e-1efd-4532-9b64-1623a594db54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.341709 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e844b2e-1efd-4532-9b64-1623a594db54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.341974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e844b2e-1efd-4532-9b64-1623a594db54 admin admin] PATH_INFO: `/v3/projects/8754326fa7ce46dda290d21400265b60` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.343088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e844b2e-1efd-4532-9b64-1623a594db54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8754326fa7ce46dda290d21400265b60)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:27.344950 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e844b2e-1efd-4532-9b64-1623a594db54 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:27.391799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7e844b2e-1efd-4532-9b64-1623a594db54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8754326fa7ce46dda290d21400265b60', 'request_id': 'req-7e844b2e-1efd-4532-9b64-1623a594db54'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:27.398260 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7e844b2e-1efd-4532-9b64-1623a594db54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8754326fa7ce46dda290d21400265b60', 'request_id': 'req-7e844b2e-1efd-4532-9b64-1623a594db54'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:27.403836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7e844b2e-1efd-4532-9b64-1623a594db54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8754326fa7ce46dda290d21400265b60', 'request_id': 'req-7e844b2e-1efd-4532-9b64-1623a594db54'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:27.415694 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7e844b2e-1efd-4532-9b64-1623a594db54 admin admin] The token cache is being invalidate because project 8754326fa7ce46dda290d21400265b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:27.415955 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7e844b2e-1efd-4532-9b64-1623a594db54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:27.416536 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7e844b2e-1efd-4532-9b64-1623a594db54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:27.417984 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1387/2762] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:27 2022] DELETE /identity/v3/projects/8754326fa7ce46dda290d21400265b60 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:27.422972 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5d923-e8dc-4963-a141-bf65cbfad246 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.423427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5d923-e8dc-4963-a141-bf65cbfad246 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.423542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5d923-e8dc-4963-a141-bf65cbfad246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.443115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-bce5d923-e8dc-4963-a141-bf65cbfad246 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:27.444319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-bce5d923-e8dc-4963-a141-bf65cbfad246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:27.469489 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:27.504224 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1376/2763] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:27.513073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e051f39-b5de-4337-8dfa-08444e4cf618 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.513360 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e051f39-b5de-4337-8dfa-08444e4cf618 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.513636 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e051f39-b5de-4337-8dfa-08444e4cf618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.532663 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9e051f39-b5de-4337-8dfa-08444e4cf618 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:27.534374 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9e051f39-b5de-4337-8dfa-08444e4cf618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:27.542106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1388/2764] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:27.546291 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5d923-e8dc-4963-a141-bf65cbfad246 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:27.555932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5d923-e8dc-4963-a141-bf65cbfad246 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:27.560680 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc146f6a-c4fa-423f-bebb-0d69186ce47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:27.561279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc146f6a-c4fa-423f-bebb-0d69186ce47d admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.561558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc146f6a-c4fa-423f-bebb-0d69186ce47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.561826 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc146f6a-c4fa-423f-bebb-0d69186ce47d admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.562465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc146f6a-c4fa-423f-bebb-0d69186ce47d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:27.562822 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc146f6a-c4fa-423f-bebb-0d69186ce47d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:27.564465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc146f6a-c4fa-423f-bebb-0d69186ce47d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:27.576877 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1377/2765] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:27.581621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e051f39-b5de-4337-8dfa-08444e4cf618 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:27.590536 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e051f39-b5de-4337-8dfa-08444e4cf618 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:27.595171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0edd4-0762-4f5c-b754-e32872073317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:27.595797 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0edd4-0762-4f5c-b754-e32872073317 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.596142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0edd4-0762-4f5c-b754-e32872073317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.596431 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0edd4-0762-4f5c-b754-e32872073317 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.597064 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0edd4-0762-4f5c-b754-e32872073317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:27.598945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0edd4-0762-4f5c-b754-e32872073317 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:27.625365 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1389/2766] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:27 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:27.630133 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc146f6a-c4fa-423f-bebb-0d69186ce47d admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:27.640200 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc146f6a-c4fa-423f-bebb-0d69186ce47d admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:27.695477 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059795c2-1e34-4bfa-bf7e-2e8777f736f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:27.696002 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059795c2-1e34-4bfa-bf7e-2e8777f736f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.696282 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059795c2-1e34-4bfa-bf7e-2e8777f736f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.696557 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059795c2-1e34-4bfa-bf7e-2e8777f736f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.697450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059795c2-1e34-4bfa-bf7e-2e8777f736f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:27.699391 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059795c2-1e34-4bfa-bf7e-2e8777f736f8 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:27.720641 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1378/2767] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:27 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:27.726339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0edd4-0762-4f5c-b754-e32872073317 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:27.738730 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0edd4-0762-4f5c-b754-e32872073317 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:27.743571 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb15b4-4bd0-4077-a9e4-e9a042b4eb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:27.744175 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb15b4-4bd0-4077-a9e4-e9a042b4eb81 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.744452 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb15b4-4bd0-4077-a9e4-e9a042b4eb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.744724 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb15b4-4bd0-4077-a9e4-e9a042b4eb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.745368 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb15b4-4bd0-4077-a9e4-e9a042b4eb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:27.747084 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb15b4-4bd0-4077-a9e4-e9a042b4eb81 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:27.749336 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:27.758055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1390/2768] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:27.762094 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059795c2-1e34-4bfa-bf7e-2e8777f736f8 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:27.772766 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059795c2-1e34-4bfa-bf7e-2e8777f736f8 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:27.777449 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f5598-6aa3-46a4-a1b6-d7c07e64a14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:27.778080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f5598-6aa3-46a4-a1b6-d7c07e64a14d admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.778356 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f5598-6aa3-46a4-a1b6-d7c07e64a14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.778654 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f5598-6aa3-46a4-a1b6-d7c07e64a14d admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.779298 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f5598-6aa3-46a4-a1b6-d7c07e64a14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:27.780870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f5598-6aa3-46a4-a1b6-d7c07e64a14d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:27.792597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1379/2769] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:27.796750 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb15b4-4bd0-4077-a9e4-e9a042b4eb81 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:27.806609 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb15b4-4bd0-4077-a9e4-e9a042b4eb81 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:27.811429 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1e640-ccd3-4075-b1c2-d54c081fc352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:27.812066 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1e640-ccd3-4075-b1c2-d54c081fc352 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.812343 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1e640-ccd3-4075-b1c2-d54c081fc352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.812616 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1e640-ccd3-4075-b1c2-d54c081fc352 admin admin] PATH_INFO: `/v3/projects/2bf263fa2cc04bc882c1e117b1730411/users/9d32f4ec25f54f3098fce612d449d8fe/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.827043 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1e640-ccd3-4075-b1c2-d54c081fc352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf263fa2cc04bc882c1e117b1730411, user_id=9d32f4ec25f54f3098fce612d449d8fe, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:27.829643 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1e640-ccd3-4075-b1c2-d54c081fc352 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:27.844617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1391/2770] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:27 2022] PUT /identity/v3/projects/2bf263fa2cc04bc882c1e117b1730411/users/9d32f4ec25f54f3098fce612d449d8fe/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:27.855606 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2e567-5a4a-4c90-801c-a9132c027422 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.855955 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2e567-5a4a-4c90-801c-a9132c027422 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.856230 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2e567-5a4a-4c90-801c-a9132c027422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.884605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-67a2e567-5a4a-4c90-801c-a9132c027422 None None] MFA Rules not processed for user `9d32f4ec25f54f3098fce612d449d8fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:27.886577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-67a2e567-5a4a-4c90-801c-a9132c027422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:27.951214 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1380/2771] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:27.956348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1e640-ccd3-4075-b1c2-d54c081fc352 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:28.017024 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1e640-ccd3-4075-b1c2-d54c081fc352 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:28.021734 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cb36c-f7e4-49d0-8a2e-92e5cbe23870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:28.022328 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cb36c-f7e4-49d0-8a2e-92e5cbe23870 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:28.022604 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cb36c-f7e4-49d0-8a2e-92e5cbe23870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:28.022902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cb36c-f7e4-49d0-8a2e-92e5cbe23870 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:28.023535 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cb36c-f7e4-49d0-8a2e-92e5cbe23870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:28.025471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cb36c-f7e4-49d0-8a2e-92e5cbe23870 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:28.052055 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1392/2772] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:27 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:28.056411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2e567-5a4a-4c90-801c-a9132c027422 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:28.067796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2e567-5a4a-4c90-801c-a9132c027422 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:28.092371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:28.125963 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d7873-226b-4da0-9f1e-22002ec858f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:28.126564 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d7873-226b-4da0-9f1e-22002ec858f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:28.126874 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d7873-226b-4da0-9f1e-22002ec858f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:28.127145 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d7873-226b-4da0-9f1e-22002ec858f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:28.128269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d7873-226b-4da0-9f1e-22002ec858f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:28.130202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d7873-226b-4da0-9f1e-22002ec858f8 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:28.150437 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1381/2773] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:28 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:28.154602 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cb36c-f7e4-49d0-8a2e-92e5cbe23870 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:28.165342 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cb36c-f7e4-49d0-8a2e-92e5cbe23870 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:28.169983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e82693-1add-4d41-b11c-546571e03be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:28.170572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82693-1add-4d41-b11c-546571e03be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:28.170886 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82693-1add-4d41-b11c-546571e03be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:28.171156 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82693-1add-4d41-b11c-546571e03be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:28.171792 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e82693-1add-4d41-b11c-546571e03be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:28.173364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e82693-1add-4d41-b11c-546571e03be8 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:28.184458 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1393/2774] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:28.188634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d7873-226b-4da0-9f1e-22002ec858f8 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:28.199506 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d7873-226b-4da0-9f1e-22002ec858f8 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:28.204053 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d24274-616a-4662-974d-4acdd185d93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:28.204698 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d24274-616a-4662-974d-4acdd185d93b admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:28.204998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d24274-616a-4662-974d-4acdd185d93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:28.205252 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d24274-616a-4662-974d-4acdd185d93b admin admin] PATH_INFO: `/v3/projects/65801d370e0f4482858b2aa9af519e1d/users/5c56af2275e9479b84560c1adfb5b28e/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:28.219588 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d24274-616a-4662-974d-4acdd185d93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=65801d370e0f4482858b2aa9af519e1d, user_id=5c56af2275e9479b84560c1adfb5b28e, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:28.222727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d24274-616a-4662-974d-4acdd185d93b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:28.235712 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1382/2775] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:28 2022] PUT /identity/v3/projects/65801d370e0f4482858b2aa9af519e1d/users/5c56af2275e9479b84560c1adfb5b28e/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:28.239838 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e82693-1add-4d41-b11c-546571e03be8 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:28.249756 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e82693-1add-4d41-b11c-546571e03be8 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:28.311956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57e280-bfa8-42a2-8a44-91ba2691b7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:28.312559 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57e280-bfa8-42a2-8a44-91ba2691b7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:28.312841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57e280-bfa8-42a2-8a44-91ba2691b7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:28.313117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57e280-bfa8-42a2-8a44-91ba2691b7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:28.313754 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57e280-bfa8-42a2-8a44-91ba2691b7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:28.316047 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57e280-bfa8-42a2-8a44-91ba2691b7e6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:28.326063 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1394/2776] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:28.330246 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d24274-616a-4662-974d-4acdd185d93b admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:28.348415 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d24274-616a-4662-974d-4acdd185d93b admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:28.353786 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a64044-0313-4a8f-88fe-15d889b4bf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:28.354450 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a64044-0313-4a8f-88fe-15d889b4bf5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:28.354764 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a64044-0313-4a8f-88fe-15d889b4bf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:28.355039 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a64044-0313-4a8f-88fe-15d889b4bf5d admin admin] PATH_INFO: `/v3/projects/65801d370e0f4482858b2aa9af519e1d/users/5c56af2275e9479b84560c1adfb5b28e/roles/3cd61239237441418529e9028ef801e4` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:28.356992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a64044-0313-4a8f-88fe-15d889b4bf5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=65801d370e0f4482858b2aa9af519e1d, user_id=5c56af2275e9479b84560c1adfb5b28e, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:28.359640 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a64044-0313-4a8f-88fe-15d889b4bf5d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:28.370180 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1383/2777] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:28 2022] PUT /identity/v3/projects/65801d370e0f4482858b2aa9af519e1d/users/5c56af2275e9479b84560c1adfb5b28e/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:28.380957 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee6f1c-ed7f-4489-9489-c7d49c98084b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:28.381239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee6f1c-ed7f-4489-9489-c7d49c98084b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:28.381509 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee6f1c-ed7f-4489-9489-c7d49c98084b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:28.410337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-dcee6f1c-ed7f-4489-9489-c7d49c98084b None None] MFA Rules not processed for user `5c56af2275e9479b84560c1adfb5b28e`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:28.411745 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-dcee6f1c-ed7f-4489-9489-c7d49c98084b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:28.443424 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:28.481646 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1395/2778] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:28.493096 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a64044-0313-4a8f-88fe-15d889b4bf5d admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:28.494942 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c2a64044-0313-4a8f-88fe-15d889b4bf5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:28.553587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a64044-0313-4a8f-88fe-15d889b4bf5d admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:28.557275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c214c-a1a0-471b-9f40-407e43a5c44b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:28.557870 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c214c-a1a0-471b-9f40-407e43a5c44b service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:28.558150 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c214c-a1a0-471b-9f40-407e43a5c44b service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:28.558419 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c214c-a1a0-471b-9f40-407e43a5c44b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:28.612921 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c214c-a1a0-471b-9f40-407e43a5c44b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:28.614371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c214c-a1a0-471b-9f40-407e43a5c44b service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:28.623406 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1384/2779] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:32.822875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee6f1c-ed7f-4489-9489-c7d49c98084b None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:32.824267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-dcee6f1c-ed7f-4489-9489-c7d49c98084b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:32.836413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee6f1c-ed7f-4489-9489-c7d49c98084b None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:32.839992 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18826c-a345-4185-afc1-6b88c7fdc39d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:32.840579 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18826c-a345-4185-afc1-6b88c7fdc39d service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.840858 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18826c-a345-4185-afc1-6b88c7fdc39d service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.841127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18826c-a345-4185-afc1-6b88c7fdc39d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.850495 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18826c-a345-4185-afc1-6b88c7fdc39d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:32.851923 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18826c-a345-4185-afc1-6b88c7fdc39d service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:32.861228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1396/2780] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:37.638975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c214c-a1a0-471b-9f40-407e43a5c44b service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:37.640396 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b93c214c-a1a0-471b-9f40-407e43a5c44b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:37.674241 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:37.696999 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c214c-a1a0-471b-9f40-407e43a5c44b service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:37.700751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615db6a6-464c-45b1-957d-34bd6f1adb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:37.701338 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615db6a6-464c-45b1-957d-34bd6f1adb54 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:37.701611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615db6a6-464c-45b1-957d-34bd6f1adb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:37.701879 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615db6a6-464c-45b1-957d-34bd6f1adb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:37.703588 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-615db6a6-464c-45b1-957d-34bd6f1adb54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:37.712909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615db6a6-464c-45b1-957d-34bd6f1adb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:37.714296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615db6a6-464c-45b1-957d-34bd6f1adb54 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:37.722426 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1385/2781] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:37.744000 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18826c-a345-4185-afc1-6b88c7fdc39d service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:37.805597 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18826c-a345-4185-afc1-6b88c7fdc39d service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:37.810311 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f43c41-e365-4fec-a4de-8b25f18891f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:37.810984 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f43c41-e365-4fec-a4de-8b25f18891f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:37.811260 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f43c41-e365-4fec-a4de-8b25f18891f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:37.811534 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f43c41-e365-4fec-a4de-8b25f18891f4 admin admin] PATH_INFO: `/v3/users/9d32f4ec25f54f3098fce612d449d8fe` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:37.812679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f43c41-e365-4fec-a4de-8b25f18891f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d32f4ec25f54f3098fce612d449d8fe)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:37.814580 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f43c41-e365-4fec-a4de-8b25f18891f4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:37.866024 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-94f43c41-e365-4fec-a4de-8b25f18891f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d32f4ec25f54f3098fce612d449d8fe'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.866706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-94f43c41-e365-4fec-a4de-8b25f18891f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d32f4ec25f54f3098fce612d449d8fe'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.875103 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-94f43c41-e365-4fec-a4de-8b25f18891f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d32f4ec25f54f3098fce612d449d8fe'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.888076 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-94f43c41-e365-4fec-a4de-8b25f18891f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d32f4ec25f54f3098fce612d449d8fe'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.894909 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-94f43c41-e365-4fec-a4de-8b25f18891f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d32f4ec25f54f3098fce612d449d8fe'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.900951 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1397/2782] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:37 2022] DELETE /identity/v3/users/9d32f4ec25f54f3098fce612d449d8fe => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:37.905295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512c574-187b-4a09-ae2d-14198fcd4916 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:37.905584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512c574-187b-4a09-ae2d-14198fcd4916 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:37.905858 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512c574-187b-4a09-ae2d-14198fcd4916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:37.928754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-0512c574-187b-4a09-ae2d-14198fcd4916 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:37.929983 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0512c574-187b-4a09-ae2d-14198fcd4916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:37.991709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1386/2783] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:38.001177 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f43c41-e365-4fec-a4de-8b25f18891f4 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:38.003145 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-94f43c41-e365-4fec-a4de-8b25f18891f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:38.043882 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:38.064008 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f43c41-e365-4fec-a4de-8b25f18891f4 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:38.067731 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d6672-4c1d-4afe-8355-da91a5951845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:38.068331 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d6672-4c1d-4afe-8355-da91a5951845 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:38.068606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d6672-4c1d-4afe-8355-da91a5951845 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:38.068875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d6672-4c1d-4afe-8355-da91a5951845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:38.078188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d6672-4c1d-4afe-8355-da91a5951845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:38.079621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d6672-4c1d-4afe-8355-da91a5951845 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:38.089057 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1398/2784] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:38.363882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512c574-187b-4a09-ae2d-14198fcd4916 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:38.365338 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0512c574-187b-4a09-ae2d-14198fcd4916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:38.378692 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512c574-187b-4a09-ae2d-14198fcd4916 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:38.383749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e46070-3e98-475f-ab9c-8e56517afef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:38.384395 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46070-3e98-475f-ab9c-8e56517afef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:38.385608 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46070-3e98-475f-ab9c-8e56517afef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:38.385933 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46070-3e98-475f-ab9c-8e56517afef5 admin admin] PATH_INFO: `/v3/projects/2bf263fa2cc04bc882c1e117b1730411` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:38.387580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e46070-3e98-475f-ab9c-8e56517afef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf263fa2cc04bc882c1e117b1730411)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:38.389608 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e46070-3e98-475f-ab9c-8e56517afef5 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:38.436929 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a3e46070-3e98-475f-ab9c-8e56517afef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf263fa2cc04bc882c1e117b1730411', 'request_id': 'req-a3e46070-3e98-475f-ab9c-8e56517afef5'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:38.444733 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a3e46070-3e98-475f-ab9c-8e56517afef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf263fa2cc04bc882c1e117b1730411', 'request_id': 'req-a3e46070-3e98-475f-ab9c-8e56517afef5'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:38.452059 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a3e46070-3e98-475f-ab9c-8e56517afef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf263fa2cc04bc882c1e117b1730411', 'request_id': 'req-a3e46070-3e98-475f-ab9c-8e56517afef5'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:38.462350 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a3e46070-3e98-475f-ab9c-8e56517afef5 admin admin] The token cache is being invalidate because project 2bf263fa2cc04bc882c1e117b1730411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:38.462648 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a3e46070-3e98-475f-ab9c-8e56517afef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:38.463327 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a3e46070-3e98-475f-ab9c-8e56517afef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:38.464857 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1387/2785] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:38 2022] DELETE /identity/v3/projects/2bf263fa2cc04bc882c1e117b1730411 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:38.469025 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d6672-4c1d-4afe-8355-da91a5951845 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:38.478438 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d6672-4c1d-4afe-8355-da91a5951845 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:38.532312 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91973f0d-e015-4c86-89b6-875018724bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:38.532925 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91973f0d-e015-4c86-89b6-875018724bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:38.533198 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91973f0d-e015-4c86-89b6-875018724bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:38.533464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91973f0d-e015-4c86-89b6-875018724bfa admin admin] PATH_INFO: `/v3/users/5c56af2275e9479b84560c1adfb5b28e` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:38.534606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91973f0d-e015-4c86-89b6-875018724bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c56af2275e9479b84560c1adfb5b28e)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:38.536535 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91973f0d-e015-4c86-89b6-875018724bfa admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:38.581600 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-91973f0d-e015-4c86-89b6-875018724bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c56af2275e9479b84560c1adfb5b28e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:38.582239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-91973f0d-e015-4c86-89b6-875018724bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c56af2275e9479b84560c1adfb5b28e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:38.591731 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-91973f0d-e015-4c86-89b6-875018724bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c56af2275e9479b84560c1adfb5b28e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:38.605014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-91973f0d-e015-4c86-89b6-875018724bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c56af2275e9479b84560c1adfb5b28e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:38.612572 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-91973f0d-e015-4c86-89b6-875018724bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c56af2275e9479b84560c1adfb5b28e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:38.618430 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1399/2786] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:38 2022] DELETE /identity/v3/users/5c56af2275e9479b84560c1adfb5b28e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:39.117787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e46070-3e98-475f-ab9c-8e56517afef5 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.119338 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a3e46070-3e98-475f-ab9c-8e56517afef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:39.133895 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e46070-3e98-475f-ab9c-8e56517afef5 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:39.190082 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45a648-4002-4862-a0ad-d7aa61318171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.190739 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45a648-4002-4862-a0ad-d7aa61318171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.191018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45a648-4002-4862-a0ad-d7aa61318171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.191285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45a648-4002-4862-a0ad-d7aa61318171 admin admin] PATH_INFO: `/v3/projects/65801d370e0f4482858b2aa9af519e1d` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.192401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45a648-4002-4862-a0ad-d7aa61318171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65801d370e0f4482858b2aa9af519e1d)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.194268 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45a648-4002-4862-a0ad-d7aa61318171 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.195769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:39.243268 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3e45a648-4002-4862-a0ad-d7aa61318171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65801d370e0f4482858b2aa9af519e1d', 'request_id': 'req-3e45a648-4002-4862-a0ad-d7aa61318171'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:39.250666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3e45a648-4002-4862-a0ad-d7aa61318171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65801d370e0f4482858b2aa9af519e1d', 'request_id': 'req-3e45a648-4002-4862-a0ad-d7aa61318171'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:39.256895 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3e45a648-4002-4862-a0ad-d7aa61318171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65801d370e0f4482858b2aa9af519e1d', 'request_id': 'req-3e45a648-4002-4862-a0ad-d7aa61318171'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:39.267042 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3e45a648-4002-4862-a0ad-d7aa61318171 admin admin] The token cache is being invalidate because project 65801d370e0f4482858b2aa9af519e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:39.267328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3e45a648-4002-4862-a0ad-d7aa61318171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:39.267948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-3e45a648-4002-4862-a0ad-d7aa61318171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:39.269934 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1388/2787] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:39 2022] DELETE /identity/v3/projects/65801d370e0f4482858b2aa9af519e1d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:39.275890 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28e731-a8f0-43d2-a396-32103efae617 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.276360 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28e731-a8f0-43d2-a396-32103efae617 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.276464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28e731-a8f0-43d2-a396-32103efae617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.295997 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-6b28e731-a8f0-43d2-a396-32103efae617 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:39.297191 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6b28e731-a8f0-43d2-a396-32103efae617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:39.345669 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:39.357287 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1400/2788] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:39.365106 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ba37-32db-4519-882a-50f94b5b7714 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.365392 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ba37-32db-4519-882a-50f94b5b7714 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.365666 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ba37-32db-4519-882a-50f94b5b7714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.387669 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-a754ba37-32db-4519-882a-50f94b5b7714 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:39.388999 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-a754ba37-32db-4519-882a-50f94b5b7714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:39.397899 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1389/2789] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:39.402189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28e731-a8f0-43d2-a396-32103efae617 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.411868 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28e731-a8f0-43d2-a396-32103efae617 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:39.416428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920943ea-de95-4317-aae2-172af968ecc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.417014 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920943ea-de95-4317-aae2-172af968ecc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.417290 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920943ea-de95-4317-aae2-172af968ecc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.417561 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920943ea-de95-4317-aae2-172af968ecc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.418211 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920943ea-de95-4317-aae2-172af968ecc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:39.418514 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920943ea-de95-4317-aae2-172af968ecc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.420136 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920943ea-de95-4317-aae2-172af968ecc4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.431390 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1401/2790] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:39.435615 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754ba37-32db-4519-882a-50f94b5b7714 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.445138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754ba37-32db-4519-882a-50f94b5b7714 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:39.450080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9befb-48b8-4201-b67c-34789a7c6949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.450601 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9befb-48b8-4201-b67c-34789a7c6949 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.450911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9befb-48b8-4201-b67c-34789a7c6949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.451184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9befb-48b8-4201-b67c-34789a7c6949 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.452860 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9befb-48b8-4201-b67c-34789a7c6949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.454760 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9befb-48b8-4201-b67c-34789a7c6949 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.481401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1390/2791] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:39 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:39.485597 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920943ea-de95-4317-aae2-172af968ecc4 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.495412 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920943ea-de95-4317-aae2-172af968ecc4 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:39.550608 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6063cd-a13d-4853-a12d-ec60eb0eb658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.551220 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6063cd-a13d-4853-a12d-ec60eb0eb658 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.551492 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6063cd-a13d-4853-a12d-ec60eb0eb658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.551759 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6063cd-a13d-4853-a12d-ec60eb0eb658 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.552371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6063cd-a13d-4853-a12d-ec60eb0eb658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.554261 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6063cd-a13d-4853-a12d-ec60eb0eb658 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.575686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1402/2792] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:39 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:39.579736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9befb-48b8-4201-b67c-34789a7c6949 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.592404 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9befb-48b8-4201-b67c-34789a7c6949 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:39.598561 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe3b71-95d1-4022-bfe1-3fce9ba1a092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.602911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe3b71-95d1-4022-bfe1-3fce9ba1a092 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.602911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe3b71-95d1-4022-bfe1-3fce9ba1a092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.602911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe3b71-95d1-4022-bfe1-3fce9ba1a092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.602911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe3b71-95d1-4022-bfe1-3fce9ba1a092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.602911 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe3b71-95d1-4022-bfe1-3fce9ba1a092 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.614529 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1391/2793] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:39.618637 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6063cd-a13d-4853-a12d-ec60eb0eb658 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.628999 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6063cd-a13d-4853-a12d-ec60eb0eb658 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:39.633703 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a84c57-ec53-4714-b08a-cb57e86b8040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.634295 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a84c57-ec53-4714-b08a-cb57e86b8040 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.634575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a84c57-ec53-4714-b08a-cb57e86b8040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.634875 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a84c57-ec53-4714-b08a-cb57e86b8040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.635514 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a84c57-ec53-4714-b08a-cb57e86b8040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.637085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a84c57-ec53-4714-b08a-cb57e86b8040 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.647361 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1403/2794] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:39.651494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe3b71-95d1-4022-bfe1-3fce9ba1a092 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.661913 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe3b71-95d1-4022-bfe1-3fce9ba1a092 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:39.666643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8a47e-317c-474f-8770-5dc1406cb52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.667304 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8a47e-317c-474f-8770-5dc1406cb52b admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.667583 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8a47e-317c-474f-8770-5dc1406cb52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.667856 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8a47e-317c-474f-8770-5dc1406cb52b admin admin] PATH_INFO: `/v3/projects/d17a46ddd1d8412b985820dd1a90b474/users/a3aebafe887c4b3b95ed7b9f8fa5977d/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.682544 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8a47e-317c-474f-8770-5dc1406cb52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17a46ddd1d8412b985820dd1a90b474, user_id=a3aebafe887c4b3b95ed7b9f8fa5977d, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.685185 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8a47e-317c-474f-8770-5dc1406cb52b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.698215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1392/2795] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:39 2022] PUT /identity/v3/projects/d17a46ddd1d8412b985820dd1a90b474/users/a3aebafe887c4b3b95ed7b9f8fa5977d/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:39.709939 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b557d42-4484-474f-a5c9-7318ef790ab4 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.710245 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b557d42-4484-474f-a5c9-7318ef790ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.710506 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b557d42-4484-474f-a5c9-7318ef790ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.738861 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7b557d42-4484-474f-a5c9-7318ef790ab4 None None] MFA Rules not processed for user `a3aebafe887c4b3b95ed7b9f8fa5977d`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:39.740073 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7b557d42-4484-474f-a5c9-7318ef790ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:39.801919 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1404/2796] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:39.813380 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8a47e-317c-474f-8770-5dc1406cb52b admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.815117 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-dec8a47e-317c-474f-8770-5dc1406cb52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:39.873429 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8a47e-317c-474f-8770-5dc1406cb52b admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:39.877024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b3184-61eb-449a-b196-4a15cc7f68bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.877619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b3184-61eb-449a-b196-4a15cc7f68bc service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.877891 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b3184-61eb-449a-b196-4a15cc7f68bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.878156 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b3184-61eb-449a-b196-4a15cc7f68bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.886334 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b3184-61eb-449a-b196-4a15cc7f68bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.887773 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b3184-61eb-449a-b196-4a15cc7f68bc service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.896986 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1393/2797] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:45.193892 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b557d42-4484-474f-a5c9-7318ef790ab4 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:45.245094 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:45.257036 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b557d42-4484-474f-a5c9-7318ef790ab4 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:45.261415 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d185144-ebd2-46a0-8bd3-2b367e91d4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:45.262036 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d185144-ebd2-46a0-8bd3-2b367e91d4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:45.262335 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d185144-ebd2-46a0-8bd3-2b367e91d4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:45.262589 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d185144-ebd2-46a0-8bd3-2b367e91d4bf admin admin] PATH_INFO: `/v3/users/a3aebafe887c4b3b95ed7b9f8fa5977d` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:45.263748 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d185144-ebd2-46a0-8bd3-2b367e91d4bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3aebafe887c4b3b95ed7b9f8fa5977d)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:45.265649 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d185144-ebd2-46a0-8bd3-2b367e91d4bf admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:45.311742 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4d185144-ebd2-46a0-8bd3-2b367e91d4bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3aebafe887c4b3b95ed7b9f8fa5977d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:45.312389 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4d185144-ebd2-46a0-8bd3-2b367e91d4bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3aebafe887c4b3b95ed7b9f8fa5977d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:45.320591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4d185144-ebd2-46a0-8bd3-2b367e91d4bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3aebafe887c4b3b95ed7b9f8fa5977d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:45.333271 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4d185144-ebd2-46a0-8bd3-2b367e91d4bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3aebafe887c4b3b95ed7b9f8fa5977d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:45.339884 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4d185144-ebd2-46a0-8bd3-2b367e91d4bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3aebafe887c4b3b95ed7b9f8fa5977d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:45.345685 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1405/2798] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:45 2022] DELETE /identity/v3/users/a3aebafe887c4b3b95ed7b9f8fa5977d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:45.350907 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc82482-4ccc-4d20-bf51-b4d743e501b7 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:45.351390 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc82482-4ccc-4d20-bf51-b4d743e501b7 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:45.351513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc82482-4ccc-4d20-bf51-b4d743e501b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:45.370923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-0fc82482-4ccc-4d20-bf51-b4d743e501b7 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:45.372095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0fc82482-4ccc-4d20-bf51-b4d743e501b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:45.395296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:45.430774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1394/2799] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:45.440872 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d185144-ebd2-46a0-8bd3-2b367e91d4bf admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:45.442303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4d185144-ebd2-46a0-8bd3-2b367e91d4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:45.499773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d185144-ebd2-46a0-8bd3-2b367e91d4bf admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:45.503671 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c91a25-8339-4e26-90a0-da399b443a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:45.504269 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c91a25-8339-4e26-90a0-da399b443a81 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:45.504545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c91a25-8339-4e26-90a0-da399b443a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:45.504822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c91a25-8339-4e26-90a0-da399b443a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:45.514034 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c91a25-8339-4e26-90a0-da399b443a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:45.515451 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c91a25-8339-4e26-90a0-da399b443a81 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:45.524541 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1406/2800] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:45.788325 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc82482-4ccc-4d20-bf51-b4d743e501b7 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:45.789843 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0fc82482-4ccc-4d20-bf51-b4d743e501b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:45.803518 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc82482-4ccc-4d20-bf51-b4d743e501b7 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:45.808424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6cfcf4-56c4-443c-a176-7ffbb58e697c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:45.809077 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cfcf4-56c4-443c-a176-7ffbb58e697c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:45.809355 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cfcf4-56c4-443c-a176-7ffbb58e697c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:45.809707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cfcf4-56c4-443c-a176-7ffbb58e697c admin admin] PATH_INFO: `/v3/projects/d17a46ddd1d8412b985820dd1a90b474` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:45.810878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6cfcf4-56c4-443c-a176-7ffbb58e697c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d17a46ddd1d8412b985820dd1a90b474)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:45.812933 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6cfcf4-56c4-443c-a176-7ffbb58e697c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:45.860783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2c6cfcf4-56c4-443c-a176-7ffbb58e697c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd17a46ddd1d8412b985820dd1a90b474', 'request_id': 'req-2c6cfcf4-56c4-443c-a176-7ffbb58e697c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:45.868649 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2c6cfcf4-56c4-443c-a176-7ffbb58e697c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd17a46ddd1d8412b985820dd1a90b474', 'request_id': 'req-2c6cfcf4-56c4-443c-a176-7ffbb58e697c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:45.874874 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2c6cfcf4-56c4-443c-a176-7ffbb58e697c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd17a46ddd1d8412b985820dd1a90b474', 'request_id': 'req-2c6cfcf4-56c4-443c-a176-7ffbb58e697c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:45.885638 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2c6cfcf4-56c4-443c-a176-7ffbb58e697c admin admin] The token cache is being invalidate because project d17a46ddd1d8412b985820dd1a90b474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:45.885922 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2c6cfcf4-56c4-443c-a176-7ffbb58e697c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:45.886558 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2c6cfcf4-56c4-443c-a176-7ffbb58e697c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:45.888066 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1395/2801] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:45 2022] DELETE /identity/v3/projects/d17a46ddd1d8412b985820dd1a90b474 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:45.893378 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d668f0-5522-4ff5-8cc8-8418a270588b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:45.893660 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d668f0-5522-4ff5-8cc8-8418a270588b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:45.893930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d668f0-5522-4ff5-8cc8-8418a270588b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:45.915122 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b5d668f0-5522-4ff5-8cc8-8418a270588b None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:45.916608 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b5d668f0-5522-4ff5-8cc8-8418a270588b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:45.976671 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1407/2802] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:46.042289 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a024d0-519e-4908-bf6e-9b10052799b3 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.042640 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a024d0-519e-4908-bf6e-9b10052799b3 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.042927 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a024d0-519e-4908-bf6e-9b10052799b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.062931 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-e8a024d0-519e-4908-bf6e-9b10052799b3 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:46.064233 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e8a024d0-519e-4908-bf6e-9b10052799b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:46.073136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1396/2803] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:46.077618 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d668f0-5522-4ff5-8cc8-8418a270588b None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:46.087777 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d668f0-5522-4ff5-8cc8-8418a270588b None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:46.092291 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d92111-0bbb-49c8-840a-5341796a36e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:46.092880 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d92111-0bbb-49c8-840a-5341796a36e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.093161 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d92111-0bbb-49c8-840a-5341796a36e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.093428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d92111-0bbb-49c8-840a-5341796a36e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.094067 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d92111-0bbb-49c8-840a-5341796a36e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:46.094362 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d92111-0bbb-49c8-840a-5341796a36e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:46.095954 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d92111-0bbb-49c8-840a-5341796a36e4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:46.107901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1408/2804] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:46.112285 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a024d0-519e-4908-bf6e-9b10052799b3 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:46.121485 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a024d0-519e-4908-bf6e-9b10052799b3 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:46.126161 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaeb738-162f-4491-a6de-74f59f99fb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:46.126796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeb738-162f-4491-a6de-74f59f99fb3c admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.127127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeb738-162f-4491-a6de-74f59f99fb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.127401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeb738-162f-4491-a6de-74f59f99fb3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.128602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaeb738-162f-4491-a6de-74f59f99fb3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:46.130528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaeb738-162f-4491-a6de-74f59f99fb3c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:46.157353 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1397/2805] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:46 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:46.161645 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d92111-0bbb-49c8-840a-5341796a36e4 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:46.166740 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:46.173054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d92111-0bbb-49c8-840a-5341796a36e4 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:46.228902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f89fb5-75f8-44e1-b51d-62d3ec4a9d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:46.229539 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f89fb5-75f8-44e1-b51d-62d3ec4a9d6e admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.229732 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f89fb5-75f8-44e1-b51d-62d3ec4a9d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.229984 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f89fb5-75f8-44e1-b51d-62d3ec4a9d6e admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.230606 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f89fb5-75f8-44e1-b51d-62d3ec4a9d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:46.232510 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f89fb5-75f8-44e1-b51d-62d3ec4a9d6e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:46.253853 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1409/2806] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:46 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:46.258052 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaeb738-162f-4491-a6de-74f59f99fb3c admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:46.268317 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaeb738-162f-4491-a6de-74f59f99fb3c admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:46.272988 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e458a6-d916-4b54-8538-c13075099c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:46.273571 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e458a6-d916-4b54-8538-c13075099c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.273851 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e458a6-d916-4b54-8538-c13075099c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.274126 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e458a6-d916-4b54-8538-c13075099c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.274800 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e458a6-d916-4b54-8538-c13075099c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:46.276458 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e458a6-d916-4b54-8538-c13075099c17 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:46.286882 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1398/2807] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:46.290990 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f89fb5-75f8-44e1-b51d-62d3ec4a9d6e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:46.301053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f89fb5-75f8-44e1-b51d-62d3ec4a9d6e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:46.305991 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae1d8c-2eeb-49ea-9c73-bcfc9b2d1781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:46.306597 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae1d8c-2eeb-49ea-9c73-bcfc9b2d1781 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.306899 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae1d8c-2eeb-49ea-9c73-bcfc9b2d1781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.307167 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae1d8c-2eeb-49ea-9c73-bcfc9b2d1781 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.307841 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae1d8c-2eeb-49ea-9c73-bcfc9b2d1781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:46.309409 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae1d8c-2eeb-49ea-9c73-bcfc9b2d1781 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:46.320441 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1410/2808] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:46.325071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e458a6-d916-4b54-8538-c13075099c17 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:46.335167 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e458a6-d916-4b54-8538-c13075099c17 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:46.339757 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02f16c-e36d-4079-95c1-1ed055565a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:46.340394 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02f16c-e36d-4079-95c1-1ed055565a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.340677 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02f16c-e36d-4079-95c1-1ed055565a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.340946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02f16c-e36d-4079-95c1-1ed055565a8b admin admin] PATH_INFO: `/v3/projects/89f49d1e12b94fe1ac2d097e82145658/users/bbcda3b295ab4c1db64270dbfcf6ea7d/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.355159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02f16c-e36d-4079-95c1-1ed055565a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f49d1e12b94fe1ac2d097e82145658, user_id=bbcda3b295ab4c1db64270dbfcf6ea7d, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:46.357762 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02f16c-e36d-4079-95c1-1ed055565a8b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:46.370283 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1399/2809] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:46 2022] PUT /identity/v3/projects/89f49d1e12b94fe1ac2d097e82145658/users/bbcda3b295ab4c1db64270dbfcf6ea7d/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:46.380936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf0f98-0ded-425e-b0ca-25b69aa7a416 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.381267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf0f98-0ded-425e-b0ca-25b69aa7a416 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.381538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf0f98-0ded-425e-b0ca-25b69aa7a416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.408308 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-73cf0f98-0ded-425e-b0ca-25b69aa7a416 None None] MFA Rules not processed for user `bbcda3b295ab4c1db64270dbfcf6ea7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:46.409534 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-73cf0f98-0ded-425e-b0ca-25b69aa7a416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:46.470271 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1411/2810] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:46.474952 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02f16c-e36d-4079-95c1-1ed055565a8b admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:46.522903 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:46.537674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02f16c-e36d-4079-95c1-1ed055565a8b admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:46.542389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6d6f6-3add-4948-b6e4-6960a796c9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:46.543023 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6d6f6-3add-4948-b6e4-6960a796c9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.543305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6d6f6-3add-4948-b6e4-6960a796c9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.543580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6d6f6-3add-4948-b6e4-6960a796c9c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.544225 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6d6f6-3add-4948-b6e4-6960a796c9c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:46.546101 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6d6f6-3add-4948-b6e4-6960a796c9c6 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:46.573359 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1400/2811] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:46 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:46.577484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf0f98-0ded-425e-b0ca-25b69aa7a416 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:46.588596 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf0f98-0ded-425e-b0ca-25b69aa7a416 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:46.642906 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3375de-9501-4bb2-8207-497cd4177090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:46.644109 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3375de-9501-4bb2-8207-497cd4177090 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.644383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3375de-9501-4bb2-8207-497cd4177090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.644649 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3375de-9501-4bb2-8207-497cd4177090 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.645271 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3375de-9501-4bb2-8207-497cd4177090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:46.647178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3375de-9501-4bb2-8207-497cd4177090 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:46.663671 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:46.669876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1412/2812] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:46 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:46.673296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6d6f6-3add-4948-b6e4-6960a796c9c6 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:46.683611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6d6f6-3add-4948-b6e4-6960a796c9c6 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:46.688328 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335dce8-bc5c-4cd4-b8ff-59a3f341478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:46.688923 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335dce8-bc5c-4cd4-b8ff-59a3f341478e admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.689205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335dce8-bc5c-4cd4-b8ff-59a3f341478e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.689476 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335dce8-bc5c-4cd4-b8ff-59a3f341478e admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.690160 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335dce8-bc5c-4cd4-b8ff-59a3f341478e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:46.691806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335dce8-bc5c-4cd4-b8ff-59a3f341478e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:46.702688 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1401/2813] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:46.707152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3375de-9501-4bb2-8207-497cd4177090 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:46.717045 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3375de-9501-4bb2-8207-497cd4177090 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:46.722189 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e29f95-2bdd-4ef7-866d-7a75fe1854ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:46.722810 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e29f95-2bdd-4ef7-866d-7a75fe1854ad admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.723085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e29f95-2bdd-4ef7-866d-7a75fe1854ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.723354 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e29f95-2bdd-4ef7-866d-7a75fe1854ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.724018 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e29f95-2bdd-4ef7-866d-7a75fe1854ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:46.725576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e29f95-2bdd-4ef7-866d-7a75fe1854ad admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:46.735553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1413/2814] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:46.739797 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335dce8-bc5c-4cd4-b8ff-59a3f341478e admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:46.749742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335dce8-bc5c-4cd4-b8ff-59a3f341478e admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:46.754448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7eff91-3959-4ca1-85a5-b0036fbdaf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:46.755116 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7eff91-3959-4ca1-85a5-b0036fbdaf72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.755401 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7eff91-3959-4ca1-85a5-b0036fbdaf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.755673 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7eff91-3959-4ca1-85a5-b0036fbdaf72 admin admin] PATH_INFO: `/v3/projects/3896da4f601f477abeb6bc3b3719acb5/users/12b062485d914ef9aa8e1518a6b7b9ad/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.770448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7eff91-3959-4ca1-85a5-b0036fbdaf72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3896da4f601f477abeb6bc3b3719acb5, user_id=12b062485d914ef9aa8e1518a6b7b9ad, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:46.773157 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7eff91-3959-4ca1-85a5-b0036fbdaf72 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:46.786510 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1402/2815] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:46 2022] PUT /identity/v3/projects/3896da4f601f477abeb6bc3b3719acb5/users/12b062485d914ef9aa8e1518a6b7b9ad/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:46.796721 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee69e50-3486-428f-8fae-11cba689efee None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.797005 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee69e50-3486-428f-8fae-11cba689efee None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.797280 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee69e50-3486-428f-8fae-11cba689efee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.825119 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7ee69e50-3486-428f-8fae-11cba689efee None None] MFA Rules not processed for user `12b062485d914ef9aa8e1518a6b7b9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:46.826335 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7ee69e50-3486-428f-8fae-11cba689efee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:46.890027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1414/2816] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:46.894553 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7eff91-3959-4ca1-85a5-b0036fbdaf72 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:46.954952 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7eff91-3959-4ca1-85a5-b0036fbdaf72 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:46.959614 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d566c5-4be7-4b41-8d0b-d5d53ca9eea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:46.960207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d566c5-4be7-4b41-8d0b-d5d53ca9eea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.960487 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d566c5-4be7-4b41-8d0b-d5d53ca9eea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.960760 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d566c5-4be7-4b41-8d0b-d5d53ca9eea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.961388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d566c5-4be7-4b41-8d0b-d5d53ca9eea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:46.963305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d566c5-4be7-4b41-8d0b-d5d53ca9eea2 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:46.989751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1403/2817] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:46 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:46.993834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee69e50-3486-428f-8fae-11cba689efee None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:47.004330 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee69e50-3486-428f-8fae-11cba689efee None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:47.058089 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f0dee-915e-41b8-b4b7-946afec2218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:47.058706 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f0dee-915e-41b8-b4b7-946afec2218e admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:47.058982 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f0dee-915e-41b8-b4b7-946afec2218e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:47.059247 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f0dee-915e-41b8-b4b7-946afec2218e admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:47.059870 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f0dee-915e-41b8-b4b7-946afec2218e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:47.061759 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f0dee-915e-41b8-b4b7-946afec2218e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:47.083011 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1415/2818] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:46 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:47.087046 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d566c5-4be7-4b41-8d0b-d5d53ca9eea2 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:47.097709 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d566c5-4be7-4b41-8d0b-d5d53ca9eea2 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:47.102503 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b42b66-46ea-4449-8c4c-960e53a13f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:47.103238 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b42b66-46ea-4449-8c4c-960e53a13f2a admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:47.103593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b42b66-46ea-4449-8c4c-960e53a13f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:47.103865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b42b66-46ea-4449-8c4c-960e53a13f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:47.104669 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b42b66-46ea-4449-8c4c-960e53a13f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:47.106580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b42b66-46ea-4449-8c4c-960e53a13f2a admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:47.118293 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1404/2819] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:47.122460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f0dee-915e-41b8-b4b7-946afec2218e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:47.133951 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f0dee-915e-41b8-b4b7-946afec2218e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:47.138573 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182134f4-2f0b-4de4-9a4c-96f1b76c3a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:47.139273 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182134f4-2f0b-4de4-9a4c-96f1b76c3a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:47.139553 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182134f4-2f0b-4de4-9a4c-96f1b76c3a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:47.139825 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182134f4-2f0b-4de4-9a4c-96f1b76c3a0a admin admin] PATH_INFO: `/v3/projects/8cf043f12faa4e48b70316481ec86ccf/users/aa18a78cfbd54552b285dbd86d513721/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:47.155072 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182134f4-2f0b-4de4-9a4c-96f1b76c3a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cf043f12faa4e48b70316481ec86ccf, user_id=aa18a78cfbd54552b285dbd86d513721, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:47.157675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182134f4-2f0b-4de4-9a4c-96f1b76c3a0a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:47.170158 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1416/2820] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:47 2022] PUT /identity/v3/projects/8cf043f12faa4e48b70316481ec86ccf/users/aa18a78cfbd54552b285dbd86d513721/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:47.174077 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b42b66-46ea-4449-8c4c-960e53a13f2a admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:47.183876 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b42b66-46ea-4449-8c4c-960e53a13f2a admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:47.241738 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462c310-70dd-4024-b8e6-8cc9897a6f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:47.242347 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462c310-70dd-4024-b8e6-8cc9897a6f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:47.242635 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462c310-70dd-4024-b8e6-8cc9897a6f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:47.242925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462c310-70dd-4024-b8e6-8cc9897a6f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:47.243561 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462c310-70dd-4024-b8e6-8cc9897a6f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:47.245163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462c310-70dd-4024-b8e6-8cc9897a6f6f admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:47.254919 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1405/2821] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:47.259162 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182134f4-2f0b-4de4-9a4c-96f1b76c3a0a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:47.269884 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182134f4-2f0b-4de4-9a4c-96f1b76c3a0a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:47.274418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690294a-9d40-4d3c-b475-25ecbebc79e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:47.275091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690294a-9d40-4d3c-b475-25ecbebc79e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:47.275397 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690294a-9d40-4d3c-b475-25ecbebc79e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:47.275669 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690294a-9d40-4d3c-b475-25ecbebc79e6 admin admin] PATH_INFO: `/v3/projects/8cf043f12faa4e48b70316481ec86ccf/users/aa18a78cfbd54552b285dbd86d513721/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:47.277647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690294a-9d40-4d3c-b475-25ecbebc79e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cf043f12faa4e48b70316481ec86ccf, user_id=aa18a78cfbd54552b285dbd86d513721, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:47.280263 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690294a-9d40-4d3c-b475-25ecbebc79e6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:47.290856 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1417/2822] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:47 2022] PUT /identity/v3/projects/8cf043f12faa4e48b70316481ec86ccf/users/aa18a78cfbd54552b285dbd86d513721/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:47.302044 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f6992-af4f-4afa-80fe-43ffe1a51f44 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:47.302427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f6992-af4f-4afa-80fe-43ffe1a51f44 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:47.302820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f6992-af4f-4afa-80fe-43ffe1a51f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:47.323742 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:47.333613 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-d88f6992-af4f-4afa-80fe-43ffe1a51f44 None None] MFA Rules not processed for user `aa18a78cfbd54552b285dbd86d513721`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:47.334833 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d88f6992-af4f-4afa-80fe-43ffe1a51f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:47.399946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1406/2823] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:47.411879 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690294a-9d40-4d3c-b475-25ecbebc79e6 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:47.413619 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4690294a-9d40-4d3c-b475-25ecbebc79e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:47.446598 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:47.473428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690294a-9d40-4d3c-b475-25ecbebc79e6 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:47.477145 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d336773-6f17-4251-b3b6-ca3047414771 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:47.477742 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d336773-6f17-4251-b3b6-ca3047414771 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:47.478021 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d336773-6f17-4251-b3b6-ca3047414771 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:47.478293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d336773-6f17-4251-b3b6-ca3047414771 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:47.533549 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d336773-6f17-4251-b3b6-ca3047414771 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:47.535614 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d336773-6f17-4251-b3b6-ca3047414771 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:47.544188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1418/2824] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:49.031340 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f6992-af4f-4afa-80fe-43ffe1a51f44 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:49.032753 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d88f6992-af4f-4afa-80fe-43ffe1a51f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:49.045461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f6992-af4f-4afa-80fe-43ffe1a51f44 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:49.049073 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1dcde-3be8-4f41-baf5-359cea2aca40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:49.049692 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1dcde-3be8-4f41-baf5-359cea2aca40 service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:49.049969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1dcde-3be8-4f41-baf5-359cea2aca40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:49.050239 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1dcde-3be8-4f41-baf5-359cea2aca40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:49.106408 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1dcde-3be8-4f41-baf5-359cea2aca40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:49.108147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1dcde-3be8-4f41-baf5-359cea2aca40 service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:49.117376 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1407/2825] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:49.647738 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d336773-6f17-4251-b3b6-ca3047414771 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:49.656462 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d336773-6f17-4251-b3b6-ca3047414771 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:49.660679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696c9ef-0038-4721-beba-5156ac16dff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:49.661264 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696c9ef-0038-4721-beba-5156ac16dff5 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:49.661540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696c9ef-0038-4721-beba-5156ac16dff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:49.661809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696c9ef-0038-4721-beba-5156ac16dff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:49.670504 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696c9ef-0038-4721-beba-5156ac16dff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:49.671979 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696c9ef-0038-4721-beba-5156ac16dff5 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:49.681257 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1419/2826] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:53.532445 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1dcde-3be8-4f41-baf5-359cea2aca40 service cinder] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:53.595485 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1dcde-3be8-4f41-baf5-359cea2aca40 service cinder] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:53.600512 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772bd73-53e6-4e0a-97cc-2c35c476c00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:53.601123 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772bd73-53e6-4e0a-97cc-2c35c476c00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:53.601399 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772bd73-53e6-4e0a-97cc-2c35c476c00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:53.601669 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772bd73-53e6-4e0a-97cc-2c35c476c00d admin admin] PATH_INFO: `/v3/users/bbcda3b295ab4c1db64270dbfcf6ea7d` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:53.602809 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772bd73-53e6-4e0a-97cc-2c35c476c00d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbcda3b295ab4c1db64270dbfcf6ea7d)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:53.604719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772bd73-53e6-4e0a-97cc-2c35c476c00d admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:53.643539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:53.653949 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6772bd73-53e6-4e0a-97cc-2c35c476c00d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbcda3b295ab4c1db64270dbfcf6ea7d'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:53.654597 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6772bd73-53e6-4e0a-97cc-2c35c476c00d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbcda3b295ab4c1db64270dbfcf6ea7d'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:53.666776 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6772bd73-53e6-4e0a-97cc-2c35c476c00d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbcda3b295ab4c1db64270dbfcf6ea7d'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:53.674206 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6772bd73-53e6-4e0a-97cc-2c35c476c00d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbcda3b295ab4c1db64270dbfcf6ea7d'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:53.681703 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-6772bd73-53e6-4e0a-97cc-2c35c476c00d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbcda3b295ab4c1db64270dbfcf6ea7d'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:53.687561 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1408/2827] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:53 2022] DELETE /identity/v3/users/bbcda3b295ab4c1db64270dbfcf6ea7d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:53.692086 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9ac55-0762-4401-96e2-651213a786bf None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:53.692540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9ac55-0762-4401-96e2-651213a786bf None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:53.692672 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9ac55-0762-4401-96e2-651213a786bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:53.711368 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-cda9ac55-0762-4401-96e2-651213a786bf None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:53.712568 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cda9ac55-0762-4401-96e2-651213a786bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:53.769769 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1420/2828] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:53.779415 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772bd73-53e6-4e0a-97cc-2c35c476c00d admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:53.780817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6772bd73-53e6-4e0a-97cc-2c35c476c00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:53.837771 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772bd73-53e6-4e0a-97cc-2c35c476c00d admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:53.841545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c41a90-c4dc-4b01-9bb0-44fc20dc9d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:53.842147 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c41a90-c4dc-4b01-9bb0-44fc20dc9d7f service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:53.842425 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c41a90-c4dc-4b01-9bb0-44fc20dc9d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:53.842724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c41a90-c4dc-4b01-9bb0-44fc20dc9d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:53.852417 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c41a90-c4dc-4b01-9bb0-44fc20dc9d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:53.853835 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c41a90-c4dc-4b01-9bb0-44fc20dc9d7f service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:53.863720 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1409/2829] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:54.152808 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9ac55-0762-4401-96e2-651213a786bf None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:54.155077 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cda9ac55-0762-4401-96e2-651213a786bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:54.168529 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9ac55-0762-4401-96e2-651213a786bf None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:54.173987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffd457-ad6f-49be-8813-e1b396b31eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:54.175389 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffd457-ad6f-49be-8813-e1b396b31eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:54.175860 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffd457-ad6f-49be-8813-e1b396b31eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:54.176298 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffd457-ad6f-49be-8813-e1b396b31eb6 admin admin] PATH_INFO: `/v3/projects/89f49d1e12b94fe1ac2d097e82145658` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:54.177621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffd457-ad6f-49be-8813-e1b396b31eb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f49d1e12b94fe1ac2d097e82145658)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:54.188577 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffd457-ad6f-49be-8813-e1b396b31eb6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:54.245308 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-79ffd457-ad6f-49be-8813-e1b396b31eb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f49d1e12b94fe1ac2d097e82145658', 'request_id': 'req-79ffd457-ad6f-49be-8813-e1b396b31eb6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.251635 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-79ffd457-ad6f-49be-8813-e1b396b31eb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f49d1e12b94fe1ac2d097e82145658', 'request_id': 'req-79ffd457-ad6f-49be-8813-e1b396b31eb6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.258420 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-79ffd457-ad6f-49be-8813-e1b396b31eb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f49d1e12b94fe1ac2d097e82145658', 'request_id': 'req-79ffd457-ad6f-49be-8813-e1b396b31eb6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.262167 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:54.274334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-79ffd457-ad6f-49be-8813-e1b396b31eb6 admin admin] The token cache is being invalidate because project 89f49d1e12b94fe1ac2d097e82145658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:54.274554 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-79ffd457-ad6f-49be-8813-e1b396b31eb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.275251 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-79ffd457-ad6f-49be-8813-e1b396b31eb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.276843 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1421/2830] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:54 2022] DELETE /identity/v3/projects/89f49d1e12b94fe1ac2d097e82145658 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:54.281523 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c41a90-c4dc-4b01-9bb0-44fc20dc9d7f service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:54.294850 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c41a90-c4dc-4b01-9bb0-44fc20dc9d7f service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:54.357279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e51f28-a1b1-428c-8a55-9bade93a0117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:54.357907 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e51f28-a1b1-428c-8a55-9bade93a0117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:54.358192 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e51f28-a1b1-428c-8a55-9bade93a0117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:54.358465 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e51f28-a1b1-428c-8a55-9bade93a0117 admin admin] PATH_INFO: `/v3/users/12b062485d914ef9aa8e1518a6b7b9ad` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:54.359645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e51f28-a1b1-428c-8a55-9bade93a0117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b062485d914ef9aa8e1518a6b7b9ad)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:54.361624 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e51f28-a1b1-428c-8a55-9bade93a0117 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:54.423904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-80e51f28-a1b1-428c-8a55-9bade93a0117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b062485d914ef9aa8e1518a6b7b9ad'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.424682 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-80e51f28-a1b1-428c-8a55-9bade93a0117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b062485d914ef9aa8e1518a6b7b9ad'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.434527 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:54.442577 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-80e51f28-a1b1-428c-8a55-9bade93a0117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b062485d914ef9aa8e1518a6b7b9ad'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.452204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-80e51f28-a1b1-428c-8a55-9bade93a0117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b062485d914ef9aa8e1518a6b7b9ad'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.460663 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-80e51f28-a1b1-428c-8a55-9bade93a0117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b062485d914ef9aa8e1518a6b7b9ad'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.466719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1410/2831] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:54 2022] DELETE /identity/v3/users/12b062485d914ef9aa8e1518a6b7b9ad => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:54.732471 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffd457-ad6f-49be-8813-e1b396b31eb6 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:54.733931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-79ffd457-ad6f-49be-8813-e1b396b31eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:54.747194 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffd457-ad6f-49be-8813-e1b396b31eb6 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:54.803717 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:54.804339 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:54.804614 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:54.804883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708 admin admin] PATH_INFO: `/v3/projects/3896da4f601f477abeb6bc3b3719acb5` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:54.805991 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3896da4f601f477abeb6bc3b3719acb5)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:54.807893 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:54.852524 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3896da4f601f477abeb6bc3b3719acb5', 'request_id': 'req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.858907 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3896da4f601f477abeb6bc3b3719acb5', 'request_id': 'req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.864983 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3896da4f601f477abeb6bc3b3719acb5', 'request_id': 'req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.877333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708 admin admin] The token cache is being invalidate because project 3896da4f601f477abeb6bc3b3719acb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:54.878149 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.878805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.880294 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1422/2832] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:54 2022] DELETE /identity/v3/projects/3896da4f601f477abeb6bc3b3719acb5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:54.884279 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e51f28-a1b1-428c-8a55-9bade93a0117 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:54.885717 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-80e51f28-a1b1-428c-8a55-9bade93a0117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:54.898326 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e51f28-a1b1-428c-8a55-9bade93a0117 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:54.954103 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2f740-ced4-4bf5-aa39-8158d9f06cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:54.954782 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2f740-ced4-4bf5-aa39-8158d9f06cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:54.955061 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2f740-ced4-4bf5-aa39-8158d9f06cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:54.955356 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2f740-ced4-4bf5-aa39-8158d9f06cad admin admin] PATH_INFO: `/v3/users/aa18a78cfbd54552b285dbd86d513721` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:54.956537 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2f740-ced4-4bf5-aa39-8158d9f06cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa18a78cfbd54552b285dbd86d513721)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:54.958438 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2f740-ced4-4bf5-aa39-8158d9f06cad admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:55.004995 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a4c2f740-ced4-4bf5-aa39-8158d9f06cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa18a78cfbd54552b285dbd86d513721'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.005677 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a4c2f740-ced4-4bf5-aa39-8158d9f06cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa18a78cfbd54552b285dbd86d513721'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.017773 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a4c2f740-ced4-4bf5-aa39-8158d9f06cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa18a78cfbd54552b285dbd86d513721'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.024332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a4c2f740-ced4-4bf5-aa39-8158d9f06cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa18a78cfbd54552b285dbd86d513721'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.031294 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a4c2f740-ced4-4bf5-aa39-8158d9f06cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa18a78cfbd54552b285dbd86d513721'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.037475 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1411/2833] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:54 2022] DELETE /identity/v3/users/aa18a78cfbd54552b285dbd86d513721 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:55.311473 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:55.312906 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:55.326813 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfed5a1-b8eb-4c29-add8-3cf25c7c3708 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:55.391371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e196bd2-6fd3-4433-acfa-d6561d541a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:55.391930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e196bd2-6fd3-4433-acfa-d6561d541a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:55.392206 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e196bd2-6fd3-4433-acfa-d6561d541a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:55.392476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e196bd2-6fd3-4433-acfa-d6561d541a8b admin admin] PATH_INFO: `/v3/projects/8cf043f12faa4e48b70316481ec86ccf` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:55.393692 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e196bd2-6fd3-4433-acfa-d6561d541a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cf043f12faa4e48b70316481ec86ccf)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:55.395977 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e196bd2-6fd3-4433-acfa-d6561d541a8b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:55.431545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:55.451536 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e196bd2-6fd3-4433-acfa-d6561d541a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cf043f12faa4e48b70316481ec86ccf', 'request_id': 'req-8e196bd2-6fd3-4433-acfa-d6561d541a8b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.459809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e196bd2-6fd3-4433-acfa-d6561d541a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cf043f12faa4e48b70316481ec86ccf', 'request_id': 'req-8e196bd2-6fd3-4433-acfa-d6561d541a8b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.466999 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e196bd2-6fd3-4433-acfa-d6561d541a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cf043f12faa4e48b70316481ec86ccf', 'request_id': 'req-8e196bd2-6fd3-4433-acfa-d6561d541a8b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.488357 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e196bd2-6fd3-4433-acfa-d6561d541a8b admin admin] The token cache is being invalidate because project 8cf043f12faa4e48b70316481ec86ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:55.488655 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e196bd2-6fd3-4433-acfa-d6561d541a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.489307 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e196bd2-6fd3-4433-acfa-d6561d541a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.494697 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1423/2834] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:55 2022] DELETE /identity/v3/projects/8cf043f12faa4e48b70316481ec86ccf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:59.258445 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2ba44-4eec-4d6a-9bf9-9a1ae4bbd159 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.258974 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2ba44-4eec-4d6a-9bf9-9a1ae4bbd159 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.259077 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2ba44-4eec-4d6a-9bf9-9a1ae4bbd159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.278933 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-9ea2ba44-4eec-4d6a-9bf9-9a1ae4bbd159 None None] MFA Rules not processed for user `e802392df090479abdd241f103f45dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:59.280173 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-9ea2ba44-4eec-4d6a-9bf9-9a1ae4bbd159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:59.328134 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:59.337868 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1412/2835] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:59.645718 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e196bd2-6fd3-4433-acfa-d6561d541a8b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:59.647151 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8e196bd2-6fd3-4433-acfa-d6561d541a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:59.701859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e196bd2-6fd3-4433-acfa-d6561d541a8b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:59.705452 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3098f16-3671-483a-93e7-2756d289862e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:59.706575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3098f16-3671-483a-93e7-2756d289862e service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.706878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3098f16-3671-483a-93e7-2756d289862e service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.707148 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3098f16-3671-483a-93e7-2756d289862e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.708837 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f3098f16-3671-483a-93e7-2756d289862e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:59.718244 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3098f16-3671-483a-93e7-2756d289862e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:59.719758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3098f16-3671-483a-93e7-2756d289862e service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:59.727665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1424/2836] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:00.053959 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2ba44-4eec-4d6a-9bf9-9a1ae4bbd159 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:00.055571 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-9ea2ba44-4eec-4d6a-9bf9-9a1ae4bbd159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:00.128409 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2ba44-4eec-4d6a-9bf9-9a1ae4bbd159 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:00.133447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ad6d5-5350-45f6-9100-e223ed7df692 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae8db0856ed44088f0bd3cb93701de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:00.134049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ad6d5-5350-45f6-9100-e223ed7df692 service placement] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:00.134330 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ad6d5-5350-45f6-9100-e223ed7df692 service placement] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:00.134604 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ad6d5-5350-45f6-9100-e223ed7df692 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:00.136390 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-322ad6d5-5350-45f6-9100-e223ed7df692 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:00.151507 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ad6d5-5350-45f6-9100-e223ed7df692 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:00.153074 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ad6d5-5350-45f6-9100-e223ed7df692 service placement] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:00.163488 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1413/2837] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:02.849060 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3098f16-3671-483a-93e7-2756d289862e service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:02.853778 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f3098f16-3671-483a-93e7-2756d289862e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:02.933179 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3098f16-3671-483a-93e7-2756d289862e service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:02.939440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28241adf-be9e-4fe8-941f-645708ea2d9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:02.940068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28241adf-be9e-4fe8-941f-645708ea2d9a service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:02.940348 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28241adf-be9e-4fe8-941f-645708ea2d9a service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:02.940617 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28241adf-be9e-4fe8-941f-645708ea2d9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:02.942337 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-28241adf-be9e-4fe8-941f-645708ea2d9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:02.954768 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28241adf-be9e-4fe8-941f-645708ea2d9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:02.956326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28241adf-be9e-4fe8-941f-645708ea2d9a service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:02.966990 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1425/2838] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:09.463810 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ad6d5-5350-45f6-9100-e223ed7df692 service placement] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:09.465346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-322ad6d5-5350-45f6-9100-e223ed7df692 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:09.482182 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ad6d5-5350-45f6-9100-e223ed7df692 service placement] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:09.487927 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a2f3d-b226-4a81-b190-b9c5b2b8fa9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:09.488508 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a2f3d-b226-4a81-b190-b9c5b2b8fa9a service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:09.488790 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a2f3d-b226-4a81-b190-b9c5b2b8fa9a service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:09.489063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a2f3d-b226-4a81-b190-b9c5b2b8fa9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:09.490829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6f9a2f3d-b226-4a81-b190-b9c5b2b8fa9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:09.503668 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a2f3d-b226-4a81-b190-b9c5b2b8fa9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:09.505209 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a2f3d-b226-4a81-b190-b9c5b2b8fa9a service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:09.516167 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1414/2839] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:12.963149 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=74,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:13.966780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28241adf-be9e-4fe8-941f-645708ea2d9a service nova] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:13.978315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28241adf-be9e-4fe8-941f-645708ea2d9a service nova] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:13.983802 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c23736-0bbf-41e4-a910-cc88ad89e4e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:13.984390 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c23736-0bbf-41e4-a910-cc88ad89e4e5 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:13.984670 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c23736-0bbf-41e4-a910-cc88ad89e4e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:13.984936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c23736-0bbf-41e4-a910-cc88ad89e4e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:13.986717 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-79c23736-0bbf-41e4-a910-cc88ad89e4e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:13.999293 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c23736-0bbf-41e4-a910-cc88ad89e4e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:14.000835 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c23736-0bbf-41e4-a910-cc88ad89e4e5 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:14.011156 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1426/2840] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:44:19.511542 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=39 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:24.006771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=6 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:04.023506 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a2f3d-b226-4a81-b190-b9c5b2b8fa9a service nova] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:04.024932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-6f9a2f3d-b226-4a81-b190-b9c5b2b8fa9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:04.036343 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a2f3d-b226-4a81-b190-b9c5b2b8fa9a service nova] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:04.040243 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89d207-872a-4370-97bc-146523b468c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:04.041299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89d207-872a-4370-97bc-146523b468c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:04.041299 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89d207-872a-4370-97bc-146523b468c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:04.041568 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89d207-872a-4370-97bc-146523b468c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:04.043416 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-cd89d207-872a-4370-97bc-146523b468c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:04.055309 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89d207-872a-4370-97bc-146523b468c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:04.056758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89d207-872a-4370-97bc-146523b468c0 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:04.066515 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1415/2841] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:45:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:45:04.141932 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c23736-0bbf-41e4-a910-cc88ad89e4e5 service nova] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:04.151781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c23736-0bbf-41e4-a910-cc88ad89e4e5 service nova] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:04.155601 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb8c32-e13f-4aec-ab06-5a9f5f33b721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:04.156194 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb8c32-e13f-4aec-ab06-5a9f5f33b721 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:04.156475 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb8c32-e13f-4aec-ab06-5a9f5f33b721 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:04.156747 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb8c32-e13f-4aec-ab06-5a9f5f33b721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:04.159120 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7dcb8c32-e13f-4aec-ab06-5a9f5f33b721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:04.172713 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb8c32-e13f-4aec-ab06-5a9f5f33b721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:04.174711 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb8c32-e13f-4aec-ab06-5a9f5f33b721 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:04.185900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1427/2842] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:45:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:45:14.062114 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=6 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:14.180814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=6 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:55.544510 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32aa1b-0294-4c62-86ea-30615d7464ed None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:55.545418 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32aa1b-0294-4c62-86ea-30615d7464ed None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:55.545599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32aa1b-0294-4c62-86ea-30615d7464ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:55.570118 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-9f32aa1b-0294-4c62-86ea-30615d7464ed None None] MFA Rules not processed for user `e802392df090479abdd241f103f45dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:45:55.571424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-9f32aa1b-0294-4c62-86ea-30615d7464ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:55.578608 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1416/2843] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:45:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:45:55.897780 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb8c32-e13f-4aec-ab06-5a9f5f33b721 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:55.907788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb8c32-e13f-4aec-ab06-5a9f5f33b721 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:55.911562 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2c7c2-ecbe-4c08-87d2-570c6d7dbe15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:55.912157 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2c7c2-ecbe-4c08-87d2-570c6d7dbe15 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:55.912433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2c7c2-ecbe-4c08-87d2-570c6d7dbe15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:55.912704 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2c7c2-ecbe-4c08-87d2-570c6d7dbe15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:55.914452 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d1c2c7c2-ecbe-4c08-87d2-570c6d7dbe15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:55.924822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2c7c2-ecbe-4c08-87d2-570c6d7dbe15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:55.926169 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2c7c2-ecbe-4c08-87d2-570c6d7dbe15 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:55.934301 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1428/2844] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:45:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:46:05.564310 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:05.930699 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=6 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:39.223730 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32aa1b-0294-4c62-86ea-30615d7464ed None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:46:39.236269 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32aa1b-0294-4c62-86ea-30615d7464ed None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:46:39.241308 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfea91b-115a-4595-b12b-682a66597e1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae8db0856ed44088f0bd3cb93701de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:46:39.241933 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfea91b-115a-4595-b12b-682a66597e1a service placement] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:46:39.242212 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfea91b-115a-4595-b12b-682a66597e1a service placement] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:46:39.242485 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfea91b-115a-4595-b12b-682a66597e1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:46:39.244257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-dcfea91b-115a-4595-b12b-682a66597e1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:46:39.257237 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfea91b-115a-4595-b12b-682a66597e1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:46:39.258837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfea91b-115a-4595-b12b-682a66597e1a service placement] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:46:39.269230 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1417/2845] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:46:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:46:49.264453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=6 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:00.628658 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2c7c2-ecbe-4c08-87d2-570c6d7dbe15 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:00.637296 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2c7c2-ecbe-4c08-87d2-570c6d7dbe15 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:00.641499 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b2dfb-1232-425e-a1d2-9b3b295c8b87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:00.642086 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b2dfb-1232-425e-a1d2-9b3b295c8b87 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:00.642363 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b2dfb-1232-425e-a1d2-9b3b295c8b87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:00.642654 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b2dfb-1232-425e-a1d2-9b3b295c8b87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:00.644371 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-544b2dfb-1232-425e-a1d2-9b3b295c8b87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:00.701087 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b2dfb-1232-425e-a1d2-9b3b295c8b87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:00.702493 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b2dfb-1232-425e-a1d2-9b3b295c8b87 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:00.712037 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1429/2846] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:05.471606 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfea91b-115a-4595-b12b-682a66597e1a service placement] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:05.480909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfea91b-115a-4595-b12b-682a66597e1a service placement] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:05.485004 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b57779-69b8-4d90-95e1-7c96656c5210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:05.485593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b57779-69b8-4d90-95e1-7c96656c5210 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:05.485867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b57779-69b8-4d90-95e1-7c96656c5210 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:05.486136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b57779-69b8-4d90-95e1-7c96656c5210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:05.487865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-32b57779-69b8-4d90-95e1-7c96656c5210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:05.550766 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b57779-69b8-4d90-95e1-7c96656c5210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:05.552275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b57779-69b8-4d90-95e1-7c96656c5210 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:05.562832 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1418/2847] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:08.574470 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b2dfb-1232-425e-a1d2-9b3b295c8b87 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:08.588772 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b2dfb-1232-425e-a1d2-9b3b295c8b87 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:08.594974 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29cb31-cfdb-45d1-8f41-3c8f46e8c223 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae8db0856ed44088f0bd3cb93701de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:08.595725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29cb31-cfdb-45d1-8f41-3c8f46e8c223 service placement] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:08.596176 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29cb31-cfdb-45d1-8f41-3c8f46e8c223 service placement] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:08.596478 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29cb31-cfdb-45d1-8f41-3c8f46e8c223 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:08.598589 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ea29cb31-cfdb-45d1-8f41-3c8f46e8c223 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:08.616738 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29cb31-cfdb-45d1-8f41-3c8f46e8c223 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:08.618336 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29cb31-cfdb-45d1-8f41-3c8f46e8c223 service placement] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:08.630155 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1430/2848] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:11.749812 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b57779-69b8-4d90-95e1-7c96656c5210 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:11.751379 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-32b57779-69b8-4d90-95e1-7c96656c5210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:11.764682 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b57779-69b8-4d90-95e1-7c96656c5210 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:11.771110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcea863-076b-4fd5-b7b7-abd849a835e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:11.771919 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcea863-076b-4fd5-b7b7-abd849a835e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:11.772196 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcea863-076b-4fd5-b7b7-abd849a835e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:11.772478 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcea863-076b-4fd5-b7b7-abd849a835e0 admin admin] PATH_INFO: `/v3/users/ec3abd787d824c1880da28f9751f46d3` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:11.773626 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcea863-076b-4fd5-b7b7-abd849a835e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3abd787d824c1880da28f9751f46d3)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:11.775601 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcea863-076b-4fd5-b7b7-abd849a835e0 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:11.827973 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-4dcea863-076b-4fd5-b7b7-abd849a835e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3abd787d824c1880da28f9751f46d3'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:11.828765 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-4dcea863-076b-4fd5-b7b7-abd849a835e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3abd787d824c1880da28f9751f46d3'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:11.842457 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-4dcea863-076b-4fd5-b7b7-abd849a835e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3abd787d824c1880da28f9751f46d3'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:11.851810 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-4dcea863-076b-4fd5-b7b7-abd849a835e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3abd787d824c1880da28f9751f46d3'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:11.859482 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-4dcea863-076b-4fd5-b7b7-abd849a835e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3abd787d824c1880da28f9751f46d3'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:11.866254 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1419/2849] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:47:11 2022] DELETE /identity/v3/users/ec3abd787d824c1880da28f9751f46d3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:12.060494 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29cb31-cfdb-45d1-8f41-3c8f46e8c223 service placement] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.073074 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29cb31-cfdb-45d1-8f41-3c8f46e8c223 service placement] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.134056 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659d78b-3299-4936-afff-8ac1be845641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.134782 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659d78b-3299-4936-afff-8ac1be845641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.135062 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659d78b-3299-4936-afff-8ac1be845641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.135334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659d78b-3299-4936-afff-8ac1be845641 admin admin] PATH_INFO: `/v3/projects/bd5dbe2bf7164b9298d647670c7917be` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.137639 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659d78b-3299-4936-afff-8ac1be845641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd5dbe2bf7164b9298d647670c7917be)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.138440 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659d78b-3299-4936-afff-8ac1be845641 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.187119 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2659d78b-3299-4936-afff-8ac1be845641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd5dbe2bf7164b9298d647670c7917be', 'request_id': 'req-2659d78b-3299-4936-afff-8ac1be845641'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:12.193801 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2659d78b-3299-4936-afff-8ac1be845641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd5dbe2bf7164b9298d647670c7917be', 'request_id': 'req-2659d78b-3299-4936-afff-8ac1be845641'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:12.201971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2659d78b-3299-4936-afff-8ac1be845641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd5dbe2bf7164b9298d647670c7917be', 'request_id': 'req-2659d78b-3299-4936-afff-8ac1be845641'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:12.217673 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2659d78b-3299-4936-afff-8ac1be845641 admin admin] The token cache is being invalidate because project bd5dbe2bf7164b9298d647670c7917be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:47:12.217978 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2659d78b-3299-4936-afff-8ac1be845641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:12.219202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2659d78b-3299-4936-afff-8ac1be845641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:12.220807 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1431/2850] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:47:12 2022] DELETE /identity/v3/projects/bd5dbe2bf7164b9298d647670c7917be => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:12.224885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcea863-076b-4fd5-b7b7-abd849a835e0 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.226456 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-4dcea863-076b-4fd5-b7b7-abd849a835e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:12.242914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcea863-076b-4fd5-b7b7-abd849a835e0 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.301562 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee82dc-b5f3-4891-a3f6-48365ad36c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.302194 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee82dc-b5f3-4891-a3f6-48365ad36c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.302475 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee82dc-b5f3-4891-a3f6-48365ad36c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.302781 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee82dc-b5f3-4891-a3f6-48365ad36c85 admin admin] PATH_INFO: `/v3/users/a5ee71ce72324929a1de73aad528826d` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.303919 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee82dc-b5f3-4891-a3f6-48365ad36c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ee71ce72324929a1de73aad528826d)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.305978 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee82dc-b5f3-4891-a3f6-48365ad36c85 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.311432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:12.354853 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f3ee82dc-b5f3-4891-a3f6-48365ad36c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ee71ce72324929a1de73aad528826d'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:12.355520 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f3ee82dc-b5f3-4891-a3f6-48365ad36c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ee71ce72324929a1de73aad528826d'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:12.367220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f3ee82dc-b5f3-4891-a3f6-48365ad36c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ee71ce72324929a1de73aad528826d'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:12.375380 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f3ee82dc-b5f3-4891-a3f6-48365ad36c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ee71ce72324929a1de73aad528826d'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:12.382731 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-f3ee82dc-b5f3-4891-a3f6-48365ad36c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ee71ce72324929a1de73aad528826d'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:12.388667 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1420/2851] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:47:12 2022] DELETE /identity/v3/users/a5ee71ce72324929a1de73aad528826d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:12.571413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659d78b-3299-4936-afff-8ac1be845641 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.572838 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2659d78b-3299-4936-afff-8ac1be845641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:12.586143 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659d78b-3299-4936-afff-8ac1be845641 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.598602 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:12.652455 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3fbc0-b810-48c1-bfab-9b327430093b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.653072 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3fbc0-b810-48c1-bfab-9b327430093b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.653347 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3fbc0-b810-48c1-bfab-9b327430093b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.653616 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3fbc0-b810-48c1-bfab-9b327430093b admin admin] PATH_INFO: `/v3/projects/2c5849999c724340b89ca91c2a90993a` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.654783 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3fbc0-b810-48c1-bfab-9b327430093b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c5849999c724340b89ca91c2a90993a)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.656700 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3fbc0-b810-48c1-bfab-9b327430093b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.706461 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-deb3fbc0-b810-48c1-bfab-9b327430093b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c5849999c724340b89ca91c2a90993a', 'request_id': 'req-deb3fbc0-b810-48c1-bfab-9b327430093b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:12.713066 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-deb3fbc0-b810-48c1-bfab-9b327430093b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c5849999c724340b89ca91c2a90993a', 'request_id': 'req-deb3fbc0-b810-48c1-bfab-9b327430093b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:12.719141 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-deb3fbc0-b810-48c1-bfab-9b327430093b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c5849999c724340b89ca91c2a90993a', 'request_id': 'req-deb3fbc0-b810-48c1-bfab-9b327430093b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:12.734390 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-deb3fbc0-b810-48c1-bfab-9b327430093b admin admin] The token cache is being invalidate because project 2c5849999c724340b89ca91c2a90993a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:47:12.734710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-deb3fbc0-b810-48c1-bfab-9b327430093b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:12.735359 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-deb3fbc0-b810-48c1-bfab-9b327430093b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:12.737082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1432/2852] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:47:12 2022] DELETE /identity/v3/projects/2c5849999c724340b89ca91c2a90993a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:22.385154 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:22.729298 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:25.910796 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee82dc-b5f3-4891-a3f6-48365ad36c85 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:25.912410 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-f3ee82dc-b5f3-4891-a3f6-48365ad36c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:25.985679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee82dc-b5f3-4891-a3f6-48365ad36c85 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:26.049052 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33d788-e5ef-48b0-bc12-d1f19d173e9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:26.049692 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33d788-e5ef-48b0-bc12-d1f19d173e9b service nova] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:26.049975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33d788-e5ef-48b0-bc12-d1f19d173e9b service nova] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:26.050254 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33d788-e5ef-48b0-bc12-d1f19d173e9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:26.052033 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0b33d788-e5ef-48b0-bc12-d1f19d173e9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:26.108815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33d788-e5ef-48b0-bc12-d1f19d173e9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:26.110436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33d788-e5ef-48b0-bc12-d1f19d173e9b service nova] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:26.119406 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1421/2853] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:47:36.115380 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=84 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:38.144814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9da12b-09f8-42f2-b0d4-4f9712e0d7ba None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:38.145357 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9da12b-09f8-42f2-b0d4-4f9712e0d7ba None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:38.145357 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9da12b-09f8-42f2-b0d4-4f9712e0d7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:38.167803 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9e9da12b-09f8-42f2-b0d4-4f9712e0d7ba None None] MFA Rules not processed for user `e802392df090479abdd241f103f45dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:38.168940 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9e9da12b-09f8-42f2-b0d4-4f9712e0d7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:38.176661 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1433/2854] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:47:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:48.162791 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:52.369695 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33d788-e5ef-48b0-bc12-d1f19d173e9b service nova] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:52.371120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0b33d788-e5ef-48b0-bc12-d1f19d173e9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:52.436817 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33d788-e5ef-48b0-bc12-d1f19d173e9b service nova] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:52.440485 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303bef2-4465-4e40-b251-6ad42abba7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:52.441093 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303bef2-4465-4e40-b251-6ad42abba7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:52.441371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303bef2-4465-4e40-b251-6ad42abba7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:52.441644 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303bef2-4465-4e40-b251-6ad42abba7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:52.443373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-3303bef2-4465-4e40-b251-6ad42abba7a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:52.458722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303bef2-4465-4e40-b251-6ad42abba7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:52.460139 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303bef2-4465-4e40-b251-6ad42abba7a0 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:52.471909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1422/2855] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:53.644176 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9da12b-09f8-42f2-b0d4-4f9712e0d7ba None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:53.653762 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9da12b-09f8-42f2-b0d4-4f9712e0d7ba None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:53.657956 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df72e6e-603f-4c88-877f-c1130e72e4cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:53.658549 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df72e6e-603f-4c88-877f-c1130e72e4cb service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:53.658854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df72e6e-603f-4c88-877f-c1130e72e4cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:53.659121 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df72e6e-603f-4c88-877f-c1130e72e4cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:53.660835 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4df72e6e-603f-4c88-877f-c1130e72e4cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:53.674641 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df72e6e-603f-4c88-877f-c1130e72e4cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:53.676040 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df72e6e-603f-4c88-877f-c1130e72e4cb service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:53.686670 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1434/2856] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:02.466275 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=26 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:03.681866 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=6 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:42.605519 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303bef2-4465-4e40-b251-6ad42abba7a0 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:42.606996 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-3303bef2-4465-4e40-b251-6ad42abba7a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:42.617890 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303bef2-4465-4e40-b251-6ad42abba7a0 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:42.621570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14746d5d-a956-4508-8c6c-51129a776f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:42.622706 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14746d5d-a956-4508-8c6c-51129a776f95 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:42.622990 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14746d5d-a956-4508-8c6c-51129a776f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:42.623265 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14746d5d-a956-4508-8c6c-51129a776f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:42.625053 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-14746d5d-a956-4508-8c6c-51129a776f95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:42.634860 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14746d5d-a956-4508-8c6c-51129a776f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:42.636277 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14746d5d-a956-4508-8c6c-51129a776f95 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:42.644865 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1423/2857] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:52.641242 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=6 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:18.390346 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df72e6e-603f-4c88-877f-c1130e72e4cb service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:18.392971 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4df72e6e-603f-4c88-877f-c1130e72e4cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:18.419677 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df72e6e-603f-4c88-877f-c1130e72e4cb service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:18.425350 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e93be-efee-4e73-a302-0fcf71d0d3e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed71d63cd24f4a6caf6ebba2c30d3608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:18.425945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e93be-efee-4e73-a302-0fcf71d0d3e0 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:18.426217 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e93be-efee-4e73-a302-0fcf71d0d3e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:18.426711 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e93be-efee-4e73-a302-0fcf71d0d3e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:18.428443 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-220e93be-efee-4e73-a302-0fcf71d0d3e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:18.442515 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e93be-efee-4e73-a302-0fcf71d0d3e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:18.444464 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e93be-efee-4e73-a302-0fcf71d0d3e0 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:18.457970 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1435/2858] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:24.438975 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14746d5d-a956-4508-8c6c-51129a776f95 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:24.447924 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14746d5d-a956-4508-8c6c-51129a776f95 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:24.452356 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8cec5-a6f7-41b8-92b3-c36600685993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:24.452969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8cec5-a6f7-41b8-92b3-c36600685993 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:24.453253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8cec5-a6f7-41b8-92b3-c36600685993 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:24.453532 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8cec5-a6f7-41b8-92b3-c36600685993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:24.455277 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-5ea8cec5-a6f7-41b8-92b3-c36600685993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:24.517013 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8cec5-a6f7-41b8-92b3-c36600685993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:24.518428 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8cec5-a6f7-41b8-92b3-c36600685993 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:24.527919 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1424/2859] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:27.639774 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e93be-efee-4e73-a302-0fcf71d0d3e0 service nova] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:27.641266 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-220e93be-efee-4e73-a302-0fcf71d0d3e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:27.655235 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e93be-efee-4e73-a302-0fcf71d0d3e0 service nova] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:27.659729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a64a2-ae67-468c-8fa0-5c59818856c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:27.660345 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a64a2-ae67-468c-8fa0-5c59818856c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:27.660621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a64a2-ae67-468c-8fa0-5c59818856c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:27.660889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a64a2-ae67-468c-8fa0-5c59818856c5 admin admin] PATH_INFO: `/v3/users/e802392df090479abdd241f103f45dd8` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:27.662051 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a64a2-ae67-468c-8fa0-5c59818856c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e802392df090479abdd241f103f45dd8)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:27.663917 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a64a2-ae67-468c-8fa0-5c59818856c5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:27.711213 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fc1a64a2-ae67-468c-8fa0-5c59818856c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e802392df090479abdd241f103f45dd8'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:27.711884 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fc1a64a2-ae67-468c-8fa0-5c59818856c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e802392df090479abdd241f103f45dd8'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:27.719490 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fc1a64a2-ae67-468c-8fa0-5c59818856c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e802392df090479abdd241f103f45dd8'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:27.731627 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fc1a64a2-ae67-468c-8fa0-5c59818856c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e802392df090479abdd241f103f45dd8'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:27.738476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fc1a64a2-ae67-468c-8fa0-5c59818856c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e802392df090479abdd241f103f45dd8'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:27.744237 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1436/2860] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:49:27 2022] DELETE /identity/v3/users/e802392df090479abdd241f103f45dd8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:27.919623 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8cec5-a6f7-41b8-92b3-c36600685993 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:27.931534 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8cec5-a6f7-41b8-92b3-c36600685993 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:27.993251 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532fbab-22af-4ccd-a395-d64df97084be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:27.994215 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532fbab-22af-4ccd-a395-d64df97084be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:27.994493 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532fbab-22af-4ccd-a395-d64df97084be admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:27.994879 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532fbab-22af-4ccd-a395-d64df97084be admin admin] PATH_INFO: `/v3/projects/807fe1a229f04ad98d535f7612dd4b66` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:27.996076 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532fbab-22af-4ccd-a395-d64df97084be admin admin] RBAC: Authorizing `identity:delete_project(project_id=807fe1a229f04ad98d535f7612dd4b66)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:27.998033 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532fbab-22af-4ccd-a395-d64df97084be admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:28.048212 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2532fbab-22af-4ccd-a395-d64df97084be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807fe1a229f04ad98d535f7612dd4b66', 'request_id': 'req-2532fbab-22af-4ccd-a395-d64df97084be'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:28.057332 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2532fbab-22af-4ccd-a395-d64df97084be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807fe1a229f04ad98d535f7612dd4b66', 'request_id': 'req-2532fbab-22af-4ccd-a395-d64df97084be'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:28.064318 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2532fbab-22af-4ccd-a395-d64df97084be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807fe1a229f04ad98d535f7612dd4b66', 'request_id': 'req-2532fbab-22af-4ccd-a395-d64df97084be'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:28.076380 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2532fbab-22af-4ccd-a395-d64df97084be admin admin] The token cache is being invalidate because project 807fe1a229f04ad98d535f7612dd4b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:49:28.077048 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2532fbab-22af-4ccd-a395-d64df97084be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:28.077992 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-2532fbab-22af-4ccd-a395-d64df97084be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:28.079645 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1425/2861] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:49:27 2022] DELETE /identity/v3/projects/807fe1a229f04ad98d535f7612dd4b66 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:28.084505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e07811-133c-4efb-a53a-f8f119c3d967 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:28.084794 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e07811-133c-4efb-a53a-f8f119c3d967 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:28.085070 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e07811-133c-4efb-a53a-f8f119c3d967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:28.104891 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-79e07811-133c-4efb-a53a-f8f119c3d967 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:28.106695 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-79e07811-133c-4efb-a53a-f8f119c3d967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:28.164650 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1437/2862] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:28.172466 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a19f7-09f0-40fb-9d9e-6a05ed9a3ef8 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:28.172751 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a19f7-09f0-40fb-9d9e-6a05ed9a3ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:28.173024 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a19f7-09f0-40fb-9d9e-6a05ed9a3ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:28.192265 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-7c6a19f7-09f0-40fb-9d9e-6a05ed9a3ef8 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:28.193454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7c6a19f7-09f0-40fb-9d9e-6a05ed9a3ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:28.201914 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1426/2863] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:28.205900 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e07811-133c-4efb-a53a-f8f119c3d967 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:28.216142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e07811-133c-4efb-a53a-f8f119c3d967 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:28.222114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456eb704-685c-435a-b743-22dfa86ea494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:28.222736 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456eb704-685c-435a-b743-22dfa86ea494 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:28.223017 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456eb704-685c-435a-b743-22dfa86ea494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:28.223290 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456eb704-685c-435a-b743-22dfa86ea494 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:28.223930 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456eb704-685c-435a-b743-22dfa86ea494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:49:28.224230 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456eb704-685c-435a-b743-22dfa86ea494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:28.225796 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456eb704-685c-435a-b743-22dfa86ea494 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:28.237433 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1438/2864] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:49:28.241526 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a19f7-09f0-40fb-9d9e-6a05ed9a3ef8 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:28.251271 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a19f7-09f0-40fb-9d9e-6a05ed9a3ef8 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:28.256010 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a2b34-4511-4645-8f1b-ef8a6478bf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:28.256602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2b34-4511-4645-8f1b-ef8a6478bf90 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:28.256883 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2b34-4511-4645-8f1b-ef8a6478bf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:28.257155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2b34-4511-4645-8f1b-ef8a6478bf90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:28.257819 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a2b34-4511-4645-8f1b-ef8a6478bf90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:28.259732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a2b34-4511-4645-8f1b-ef8a6478bf90 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:28.275178 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:28.288631 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1427/2865] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:49:28 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:28.293344 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456eb704-685c-435a-b743-22dfa86ea494 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:28.303199 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456eb704-685c-435a-b743-22dfa86ea494 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:28.349463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:28.364937 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2920bf3-0cf3-474e-8981-d1f99e9f457a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:28.365537 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2920bf3-0cf3-474e-8981-d1f99e9f457a admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:28.365814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2920bf3-0cf3-474e-8981-d1f99e9f457a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:28.366082 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2920bf3-0cf3-474e-8981-d1f99e9f457a admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:28.366758 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2920bf3-0cf3-474e-8981-d1f99e9f457a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:28.368640 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2920bf3-0cf3-474e-8981-d1f99e9f457a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:28.389987 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1439/2866] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:49:28 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:49:28.394049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a2b34-4511-4645-8f1b-ef8a6478bf90 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:28.404159 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a2b34-4511-4645-8f1b-ef8a6478bf90 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:28.408795 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323992f9-b66e-4405-bbdc-8630a57c71af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:28.409409 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323992f9-b66e-4405-bbdc-8630a57c71af admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:28.409685 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323992f9-b66e-4405-bbdc-8630a57c71af admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:28.409956 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323992f9-b66e-4405-bbdc-8630a57c71af admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:28.410594 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323992f9-b66e-4405-bbdc-8630a57c71af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:28.412184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323992f9-b66e-4405-bbdc-8630a57c71af admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:28.422462 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1428/2867] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:49:28.426106 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2920bf3-0cf3-474e-8981-d1f99e9f457a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:28.436370 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2920bf3-0cf3-474e-8981-d1f99e9f457a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:28.441091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d7355-1b3c-46cb-8474-90a6e7c1f1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:28.441654 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d7355-1b3c-46cb-8474-90a6e7c1f1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:28.441928 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d7355-1b3c-46cb-8474-90a6e7c1f1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:28.442195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d7355-1b3c-46cb-8474-90a6e7c1f1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:28.442861 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d7355-1b3c-46cb-8474-90a6e7c1f1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:28.444412 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d7355-1b3c-46cb-8474-90a6e7c1f1b1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:28.454816 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1440/2868] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:28.458807 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323992f9-b66e-4405-bbdc-8630a57c71af admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:28.468650 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323992f9-b66e-4405-bbdc-8630a57c71af admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:28.473202 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc947d2-f291-482f-8c78-1dfb5277e469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:28.473905 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc947d2-f291-482f-8c78-1dfb5277e469 admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:28.474183 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc947d2-f291-482f-8c78-1dfb5277e469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:28.474454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc947d2-f291-482f-8c78-1dfb5277e469 admin admin] PATH_INFO: `/v3/projects/e4ead5a2db1a4e8e9a4dc683d7344edc/users/c29f5d2a2d4c41c8a2e4f381198276dc/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:28.489280 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc947d2-f291-482f-8c78-1dfb5277e469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ead5a2db1a4e8e9a4dc683d7344edc, user_id=c29f5d2a2d4c41c8a2e4f381198276dc, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:28.491919 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc947d2-f291-482f-8c78-1dfb5277e469 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:28.504787 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1429/2869] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:28 2022] PUT /identity/v3/projects/e4ead5a2db1a4e8e9a4dc683d7344edc/users/c29f5d2a2d4c41c8a2e4f381198276dc/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:28.515989 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3296562-f497-4170-a7f6-ea325d5c39ec None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:28.516271 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3296562-f497-4170-a7f6-ea325d5c39ec None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:28.516540 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3296562-f497-4170-a7f6-ea325d5c39ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:28.544538 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b3296562-f497-4170-a7f6-ea325d5c39ec None None] MFA Rules not processed for user `c29f5d2a2d4c41c8a2e4f381198276dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:28.545756 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b3296562-f497-4170-a7f6-ea325d5c39ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:28.608947 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1441/2870] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:49:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:28.613609 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc947d2-f291-482f-8c78-1dfb5277e469 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:28.674856 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc947d2-f291-482f-8c78-1dfb5277e469 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:28.679277 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae298e-cb24-42d4-9b55-d6d70f4ad40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:28.679867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae298e-cb24-42d4-9b55-d6d70f4ad40f admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:28.680143 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae298e-cb24-42d4-9b55-d6d70f4ad40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:28.680409 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae298e-cb24-42d4-9b55-d6d70f4ad40f admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:28.681060 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae298e-cb24-42d4-9b55-d6d70f4ad40f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:28.682946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae298e-cb24-42d4-9b55-d6d70f4ad40f admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:28.709953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1430/2871] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:49:28 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:28.714094 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3296562-f497-4170-a7f6-ea325d5c39ec None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:28.725141 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3296562-f497-4170-a7f6-ea325d5c39ec None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:28.781468 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7a83e-cabf-4e2a-9171-dd8383b38222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:28.782058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7a83e-cabf-4e2a-9171-dd8383b38222 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:28.782329 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7a83e-cabf-4e2a-9171-dd8383b38222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:28.782594 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7a83e-cabf-4e2a-9171-dd8383b38222 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:28.783250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7a83e-cabf-4e2a-9171-dd8383b38222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:28.785124 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7a83e-cabf-4e2a-9171-dd8383b38222 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:28.805726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1442/2872] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:49:28 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:28.809749 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae298e-cb24-42d4-9b55-d6d70f4ad40f admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:28.819849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae298e-cb24-42d4-9b55-d6d70f4ad40f admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:28.824611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557df2bb-8ba4-4ee4-bc27-e3c97eab77fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:28.825207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557df2bb-8ba4-4ee4-bc27-e3c97eab77fc admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:28.825494 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557df2bb-8ba4-4ee4-bc27-e3c97eab77fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:28.825771 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557df2bb-8ba4-4ee4-bc27-e3c97eab77fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:28.826445 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557df2bb-8ba4-4ee4-bc27-e3c97eab77fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:28.828317 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557df2bb-8ba4-4ee4-bc27-e3c97eab77fc admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:28.839141 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1431/2873] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:28.843834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7a83e-cabf-4e2a-9171-dd8383b38222 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:28.853679 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7a83e-cabf-4e2a-9171-dd8383b38222 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:28.858798 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35dac9f-ccce-4ed8-979e-da22f8e61f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:28.859439 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dac9f-ccce-4ed8-979e-da22f8e61f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:28.859710 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dac9f-ccce-4ed8-979e-da22f8e61f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:28.859979 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dac9f-ccce-4ed8-979e-da22f8e61f82 admin admin] PATH_INFO: `/v3/projects/29505fda040c4d1388b2b956a7f443e3/users/bb050bf60df14f3b886c70447169855f/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:28.874041 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35dac9f-ccce-4ed8-979e-da22f8e61f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29505fda040c4d1388b2b956a7f443e3, user_id=bb050bf60df14f3b886c70447169855f, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:28.876675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35dac9f-ccce-4ed8-979e-da22f8e61f82 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:28.890385 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1443/2874] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:28 2022] PUT /identity/v3/projects/29505fda040c4d1388b2b956a7f443e3/users/bb050bf60df14f3b886c70447169855f/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:28.894509 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557df2bb-8ba4-4ee4-bc27-e3c97eab77fc admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:28.905143 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557df2bb-8ba4-4ee4-bc27-e3c97eab77fc admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:28.964103 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45adf2-45ae-4f1f-b5a7-4ba6b35ba9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:28.965336 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45adf2-45ae-4f1f-b5a7-4ba6b35ba9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:28.965440 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45adf2-45ae-4f1f-b5a7-4ba6b35ba9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:28.965716 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45adf2-45ae-4f1f-b5a7-4ba6b35ba9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:28.966348 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45adf2-45ae-4f1f-b5a7-4ba6b35ba9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:28.967989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45adf2-45ae-4f1f-b5a7-4ba6b35ba9d7 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:28.977549 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1432/2875] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:28.981709 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35dac9f-ccce-4ed8-979e-da22f8e61f82 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:28.991698 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35dac9f-ccce-4ed8-979e-da22f8e61f82 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:28.996246 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2efb73-5418-4765-ad41-b92986c2fa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:28.996871 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2efb73-5418-4765-ad41-b92986c2fa9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:28.997143 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2efb73-5418-4765-ad41-b92986c2fa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:28.997410 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2efb73-5418-4765-ad41-b92986c2fa9d admin admin] PATH_INFO: `/v3/projects/29505fda040c4d1388b2b956a7f443e3/users/bb050bf60df14f3b886c70447169855f/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:28.999302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2efb73-5418-4765-ad41-b92986c2fa9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=29505fda040c4d1388b2b956a7f443e3, user_id=bb050bf60df14f3b886c70447169855f, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:29.001857 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2efb73-5418-4765-ad41-b92986c2fa9d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:29.012350 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1444/2876] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:28 2022] PUT /identity/v3/projects/29505fda040c4d1388b2b956a7f443e3/users/bb050bf60df14f3b886c70447169855f/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:29.022388 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f6f4d-6c5f-4a2c-a966-45654acc1c2d None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:29.022719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f6f4d-6c5f-4a2c-a966-45654acc1c2d None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:29.022998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f6f4d-6c5f-4a2c-a966-45654acc1c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:29.051136 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-ac2f6f4d-6c5f-4a2c-a966-45654acc1c2d None None] MFA Rules not processed for user `bb050bf60df14f3b886c70447169855f`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:29.052333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ac2f6f4d-6c5f-4a2c-a966-45654acc1c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:29.070115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:29.120766 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1433/2877] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:49:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:49:29.132921 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2efb73-5418-4765-ad41-b92986c2fa9d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:29.134827 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8a2efb73-5418-4765-ad41-b92986c2fa9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:29.146327 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:29.195556 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2efb73-5418-4765-ad41-b92986c2fa9d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:29.199267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b474ea-950a-4a8a-9d86-c959335faef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:29.199853 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b474ea-950a-4a8a-9d86-c959335faef5 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:29.200123 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b474ea-950a-4a8a-9d86-c959335faef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:29.200387 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b474ea-950a-4a8a-9d86-c959335faef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:29.209334 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b474ea-950a-4a8a-9d86-c959335faef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:29.210761 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b474ea-950a-4a8a-9d86-c959335faef5 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:29.219876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1445/2878] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:29.294007 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f6f4d-6c5f-4a2c-a966-45654acc1c2d None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:29.304639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f6f4d-6c5f-4a2c-a966-45654acc1c2d None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:29.308587 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6330b-248b-41e5-bcfa-267b0cd9f17d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:29.309177 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6330b-248b-41e5-bcfa-267b0cd9f17d service cinder] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:29.309456 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6330b-248b-41e5-bcfa-267b0cd9f17d service cinder] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:29.309727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6330b-248b-41e5-bcfa-267b0cd9f17d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:29.367536 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6330b-248b-41e5-bcfa-267b0cd9f17d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:29.368953 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6330b-248b-41e5-bcfa-267b0cd9f17d service cinder] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:29.377790 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1434/2879] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:39.215878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=23 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:39.373795 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=48 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:58.412064 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b474ea-950a-4a8a-9d86-c959335faef5 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:58.478253 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b474ea-950a-4a8a-9d86-c959335faef5 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:58.482952 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f59a22-613b-4854-b533-748f136f9e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:58.483577 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f59a22-613b-4854-b533-748f136f9e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:58.483854 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f59a22-613b-4854-b533-748f136f9e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:58.486252 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f59a22-613b-4854-b533-748f136f9e6b admin admin] PATH_INFO: `/v3/users/c29f5d2a2d4c41c8a2e4f381198276dc` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:58.486252 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f59a22-613b-4854-b533-748f136f9e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c29f5d2a2d4c41c8a2e4f381198276dc)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:58.487192 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f59a22-613b-4854-b533-748f136f9e6b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:58.538383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-56f59a22-613b-4854-b533-748f136f9e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c29f5d2a2d4c41c8a2e4f381198276dc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:58.539054 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-56f59a22-613b-4854-b533-748f136f9e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c29f5d2a2d4c41c8a2e4f381198276dc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:58.547089 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-56f59a22-613b-4854-b533-748f136f9e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c29f5d2a2d4c41c8a2e4f381198276dc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:58.567859 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-56f59a22-613b-4854-b533-748f136f9e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c29f5d2a2d4c41c8a2e4f381198276dc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:58.575664 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-56f59a22-613b-4854-b533-748f136f9e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c29f5d2a2d4c41c8a2e4f381198276dc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:58.582192 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1446/2880] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:49:58 2022] DELETE /identity/v3/users/c29f5d2a2d4c41c8a2e4f381198276dc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:58.587368 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed094a3-f7d9-42dc-8dda-d079b7d83594 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:58.588272 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed094a3-f7d9-42dc-8dda-d079b7d83594 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:58.588442 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed094a3-f7d9-42dc-8dda-d079b7d83594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:58.608424 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-0ed094a3-f7d9-42dc-8dda-d079b7d83594 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:58.609628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0ed094a3-f7d9-42dc-8dda-d079b7d83594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:58.669257 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1435/2881] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:58.679292 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f59a22-613b-4854-b533-748f136f9e6b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:58.680834 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-56f59a22-613b-4854-b533-748f136f9e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:58.738070 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f59a22-613b-4854-b533-748f136f9e6b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:58.742085 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251aaff-f1c4-458c-bca1-b0c53f1b31cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:58.742719 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251aaff-f1c4-458c-bca1-b0c53f1b31cc service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:58.743033 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251aaff-f1c4-458c-bca1-b0c53f1b31cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:58.743304 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251aaff-f1c4-458c-bca1-b0c53f1b31cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:58.752935 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251aaff-f1c4-458c-bca1-b0c53f1b31cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:58.754354 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251aaff-f1c4-458c-bca1-b0c53f1b31cc service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:58.763850 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1447/2882] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:59.033165 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed094a3-f7d9-42dc-8dda-d079b7d83594 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:59.034852 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0ed094a3-f7d9-42dc-8dda-d079b7d83594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:59.046884 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed094a3-f7d9-42dc-8dda-d079b7d83594 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:59.051496 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afccb6f-c98e-4aee-8656-5dac2c641e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:59.052127 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afccb6f-c98e-4aee-8656-5dac2c641e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:59.052402 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afccb6f-c98e-4aee-8656-5dac2c641e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:59.052724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afccb6f-c98e-4aee-8656-5dac2c641e38 admin admin] PATH_INFO: `/v3/projects/e4ead5a2db1a4e8e9a4dc683d7344edc` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:59.053853 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afccb6f-c98e-4aee-8656-5dac2c641e38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4ead5a2db1a4e8e9a4dc683d7344edc)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:59.055829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afccb6f-c98e-4aee-8656-5dac2c641e38 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:59.103248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-7afccb6f-c98e-4aee-8656-5dac2c641e38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4ead5a2db1a4e8e9a4dc683d7344edc', 'request_id': 'req-7afccb6f-c98e-4aee-8656-5dac2c641e38'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:59.111599 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-7afccb6f-c98e-4aee-8656-5dac2c641e38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4ead5a2db1a4e8e9a4dc683d7344edc', 'request_id': 'req-7afccb6f-c98e-4aee-8656-5dac2c641e38'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:59.117799 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-7afccb6f-c98e-4aee-8656-5dac2c641e38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4ead5a2db1a4e8e9a4dc683d7344edc', 'request_id': 'req-7afccb6f-c98e-4aee-8656-5dac2c641e38'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:59.128296 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-7afccb6f-c98e-4aee-8656-5dac2c641e38 admin admin] The token cache is being invalidate because project e4ead5a2db1a4e8e9a4dc683d7344edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:49:59.128579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-7afccb6f-c98e-4aee-8656-5dac2c641e38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:59.129200 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-7afccb6f-c98e-4aee-8656-5dac2c641e38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:59.130722 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1436/2883] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:49:59 2022] DELETE /identity/v3/projects/e4ead5a2db1a4e8e9a4dc683d7344edc => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:59.136262 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251aaff-f1c4-458c-bca1-b0c53f1b31cc service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:59.146262 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251aaff-f1c4-458c-bca1-b0c53f1b31cc service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:59.164943 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:59.205273 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89920fac-e02f-4ea0-b891-d3a9a342f838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:59.205905 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89920fac-e02f-4ea0-b891-d3a9a342f838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:59.206181 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89920fac-e02f-4ea0-b891-d3a9a342f838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:59.206456 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89920fac-e02f-4ea0-b891-d3a9a342f838 admin admin] PATH_INFO: `/v3/users/bb050bf60df14f3b886c70447169855f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:59.207621 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89920fac-e02f-4ea0-b891-d3a9a342f838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb050bf60df14f3b886c70447169855f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:59.209656 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89920fac-e02f-4ea0-b891-d3a9a342f838 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:59.258576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-89920fac-e02f-4ea0-b891-d3a9a342f838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb050bf60df14f3b886c70447169855f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:59.258576 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-89920fac-e02f-4ea0-b891-d3a9a342f838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb050bf60df14f3b886c70447169855f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:59.266781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-89920fac-e02f-4ea0-b891-d3a9a342f838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb050bf60df14f3b886c70447169855f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:59.278622 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-89920fac-e02f-4ea0-b891-d3a9a342f838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb050bf60df14f3b886c70447169855f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:59.285386 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-89920fac-e02f-4ea0-b891-d3a9a342f838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb050bf60df14f3b886c70447169855f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:59.291159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1448/2884] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:49:59 2022] DELETE /identity/v3/users/bb050bf60df14f3b886c70447169855f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:59.564472 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afccb6f-c98e-4aee-8656-5dac2c641e38 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:59.565983 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7afccb6f-c98e-4aee-8656-5dac2c641e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:59.581580 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afccb6f-c98e-4aee-8656-5dac2c641e38 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:59.640073 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12e819-fce7-4fd6-9bc4-85dc3fad05b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:59.640763 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12e819-fce7-4fd6-9bc4-85dc3fad05b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:59.641017 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12e819-fce7-4fd6-9bc4-85dc3fad05b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:59.641288 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12e819-fce7-4fd6-9bc4-85dc3fad05b3 admin admin] PATH_INFO: `/v3/projects/29505fda040c4d1388b2b956a7f443e3` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:59.642412 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12e819-fce7-4fd6-9bc4-85dc3fad05b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29505fda040c4d1388b2b956a7f443e3)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:59.644347 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12e819-fce7-4fd6-9bc4-85dc3fad05b3 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:59.676245 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:59.694781 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-8b12e819-fce7-4fd6-9bc4-85dc3fad05b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29505fda040c4d1388b2b956a7f443e3', 'request_id': 'req-8b12e819-fce7-4fd6-9bc4-85dc3fad05b3'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:59.702932 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-8b12e819-fce7-4fd6-9bc4-85dc3fad05b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29505fda040c4d1388b2b956a7f443e3', 'request_id': 'req-8b12e819-fce7-4fd6-9bc4-85dc3fad05b3'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:59.709138 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-8b12e819-fce7-4fd6-9bc4-85dc3fad05b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29505fda040c4d1388b2b956a7f443e3', 'request_id': 'req-8b12e819-fce7-4fd6-9bc4-85dc3fad05b3'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:59.719228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-8b12e819-fce7-4fd6-9bc4-85dc3fad05b3 admin admin] The token cache is being invalidate because project 29505fda040c4d1388b2b956a7f443e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:49:59.719502 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-8b12e819-fce7-4fd6-9bc4-85dc3fad05b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:59.720122 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-8b12e819-fce7-4fd6-9bc4-85dc3fad05b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:59.721584 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1437/2885] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:49:59 2022] DELETE /identity/v3/projects/29505fda040c4d1388b2b956a7f443e3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:59.726453 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce18bd-84cf-4396-a693-c2de8ea29552 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:59.726976 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce18bd-84cf-4396-a693-c2de8ea29552 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:59.727075 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce18bd-84cf-4396-a693-c2de8ea29552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:59.747486 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b2ce18bd-84cf-4396-a693-c2de8ea29552 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:59.748682 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b2ce18bd-84cf-4396-a693-c2de8ea29552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:59.805979 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1449/2886] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:59.814646 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d889-4763-4837-a3cb-7fe28daf0b74 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:59.814944 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d889-4763-4837-a3cb-7fe28daf0b74 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:59.815220 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d889-4763-4837-a3cb-7fe28daf0b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:59.834719 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-ae03d889-4763-4837-a3cb-7fe28daf0b74 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:59.835936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-ae03d889-4763-4837-a3cb-7fe28daf0b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:59.843788 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1438/2887] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:59.847944 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce18bd-84cf-4396-a693-c2de8ea29552 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:59.858418 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce18bd-84cf-4396-a693-c2de8ea29552 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:59.863004 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d2c88-9d13-4db9-b742-4d6fe049ab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:59.863599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d2c88-9d13-4db9-b742-4d6fe049ab7a admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:59.863878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d2c88-9d13-4db9-b742-4d6fe049ab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:59.864152 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d2c88-9d13-4db9-b742-4d6fe049ab7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:59.864824 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d2c88-9d13-4db9-b742-4d6fe049ab7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:49:59.865127 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d2c88-9d13-4db9-b742-4d6fe049ab7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:59.866738 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d2c88-9d13-4db9-b742-4d6fe049ab7a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:59.878333 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1450/2888] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:49:59.882463 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03d889-4763-4837-a3cb-7fe28daf0b74 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:59.892355 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03d889-4763-4837-a3cb-7fe28daf0b74 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:59.897080 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c0d42-4b40-45d0-8d4b-7421f8a917f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:59.897664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c0d42-4b40-45d0-8d4b-7421f8a917f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:59.897937 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c0d42-4b40-45d0-8d4b-7421f8a917f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:59.898204 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c0d42-4b40-45d0-8d4b-7421f8a917f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:59.898863 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c0d42-4b40-45d0-8d4b-7421f8a917f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:59.900727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c0d42-4b40-45d0-8d4b-7421f8a917f6 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:59.928439 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1439/2889] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:49:59 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:59.932508 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d2c88-9d13-4db9-b742-4d6fe049ab7a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:59.942421 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d2c88-9d13-4db9-b742-4d6fe049ab7a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:59.968686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:00.000586 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721e25f-97f8-4759-a8d8-9240ce5e39f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:00.001171 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721e25f-97f8-4759-a8d8-9240ce5e39f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:00.001457 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721e25f-97f8-4759-a8d8-9240ce5e39f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:00.001726 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721e25f-97f8-4759-a8d8-9240ce5e39f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:00.002352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721e25f-97f8-4759-a8d8-9240ce5e39f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:00.004264 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721e25f-97f8-4759-a8d8-9240ce5e39f7 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:00.024383 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1451/2890] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:49:59 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:50:00.029123 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c0d42-4b40-45d0-8d4b-7421f8a917f6 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:00.039453 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c0d42-4b40-45d0-8d4b-7421f8a917f6 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:00.044433 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b205c-6cc1-4ef2-b3ad-3ba4a0e72338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:00.045051 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b205c-6cc1-4ef2-b3ad-3ba4a0e72338 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:00.045326 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b205c-6cc1-4ef2-b3ad-3ba4a0e72338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:00.045593 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b205c-6cc1-4ef2-b3ad-3ba4a0e72338 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:00.046228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b205c-6cc1-4ef2-b3ad-3ba4a0e72338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:00.047837 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b205c-6cc1-4ef2-b3ad-3ba4a0e72338 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:00.058075 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1440/2891] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:50:00.062089 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721e25f-97f8-4759-a8d8-9240ce5e39f7 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:00.072311 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721e25f-97f8-4759-a8d8-9240ce5e39f7 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:00.077814 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698de158-b0e5-4672-bf1f-2e338a428289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:00.078408 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698de158-b0e5-4672-bf1f-2e338a428289 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:00.078725 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698de158-b0e5-4672-bf1f-2e338a428289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:00.079003 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698de158-b0e5-4672-bf1f-2e338a428289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:00.079642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698de158-b0e5-4672-bf1f-2e338a428289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:00.081215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698de158-b0e5-4672-bf1f-2e338a428289 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:00.092684 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1452/2892] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:50:00.096820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b205c-6cc1-4ef2-b3ad-3ba4a0e72338 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:00.106605 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b205c-6cc1-4ef2-b3ad-3ba4a0e72338 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:00.111179 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616399fd-77be-4e33-8d7a-f49802d95a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:00.111815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616399fd-77be-4e33-8d7a-f49802d95a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:00.112095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616399fd-77be-4e33-8d7a-f49802d95a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:00.112367 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616399fd-77be-4e33-8d7a-f49802d95a5c admin admin] PATH_INFO: `/v3/projects/695eeabfd72f4531947c4c4a7c77c7c1/users/a2ceb8bef61849a1aa7c4a28cc519581/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:00.127161 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616399fd-77be-4e33-8d7a-f49802d95a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=695eeabfd72f4531947c4c4a7c77c7c1, user_id=a2ceb8bef61849a1aa7c4a28cc519581, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:00.129764 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616399fd-77be-4e33-8d7a-f49802d95a5c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:00.144009 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1441/2893] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:50:00 2022] PUT /identity/v3/projects/695eeabfd72f4531947c4c4a7c77c7c1/users/a2ceb8bef61849a1aa7c4a28cc519581/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:00.154530 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017d40-329e-4262-bb58-3f97e20d4edb None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:00.154848 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017d40-329e-4262-bb58-3f97e20d4edb None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:00.155142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017d40-329e-4262-bb58-3f97e20d4edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:00.182113 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ac017d40-329e-4262-bb58-3f97e20d4edb None None] MFA Rules not processed for user `a2ceb8bef61849a1aa7c4a28cc519581`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:00.183853 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ac017d40-329e-4262-bb58-3f97e20d4edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:00.246268 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1453/2894] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:50:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:00.250935 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616399fd-77be-4e33-8d7a-f49802d95a5c admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:00.310576 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616399fd-77be-4e33-8d7a-f49802d95a5c admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:00.315264 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79461b5-75c0-4ed2-9571-e6b3b51d3af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:00.315853 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79461b5-75c0-4ed2-9571-e6b3b51d3af9 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:00.316130 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79461b5-75c0-4ed2-9571-e6b3b51d3af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:00.316398 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79461b5-75c0-4ed2-9571-e6b3b51d3af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:00.317029 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79461b5-75c0-4ed2-9571-e6b3b51d3af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:00.318915 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79461b5-75c0-4ed2-9571-e6b3b51d3af9 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:00.345262 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1442/2895] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:50:00 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:50:00.349450 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac017d40-329e-4262-bb58-3f97e20d4edb None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:00.360359 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac017d40-329e-4262-bb58-3f97e20d4edb None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:00.417514 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12912ee1-297b-4b0b-9f60-4d70213b4c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:00.418032 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12912ee1-297b-4b0b-9f60-4d70213b4c7e admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:00.418311 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12912ee1-297b-4b0b-9f60-4d70213b4c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:00.418581 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12912ee1-297b-4b0b-9f60-4d70213b4c7e admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:00.419243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12912ee1-297b-4b0b-9f60-4d70213b4c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:00.421141 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12912ee1-297b-4b0b-9f60-4d70213b4c7e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:00.442510 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1454/2896] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:50:00 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:50:00.446563 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79461b5-75c0-4ed2-9571-e6b3b51d3af9 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:00.456973 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79461b5-75c0-4ed2-9571-e6b3b51d3af9 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:00.461688 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74225f1e-6de9-4a64-bea2-b7f2129c27a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:00.462286 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74225f1e-6de9-4a64-bea2-b7f2129c27a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:00.462566 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74225f1e-6de9-4a64-bea2-b7f2129c27a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:00.462878 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74225f1e-6de9-4a64-bea2-b7f2129c27a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:00.463867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74225f1e-6de9-4a64-bea2-b7f2129c27a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:00.467477 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74225f1e-6de9-4a64-bea2-b7f2129c27a8 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:00.478440 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1443/2897] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:50:00.483577 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12912ee1-297b-4b0b-9f60-4d70213b4c7e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:00.493696 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12912ee1-297b-4b0b-9f60-4d70213b4c7e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:00.499460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75d33f-2e4b-4a98-b45c-6249c4efe8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:00.500133 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75d33f-2e4b-4a98-b45c-6249c4efe8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:00.500413 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75d33f-2e4b-4a98-b45c-6249c4efe8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:00.500686 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75d33f-2e4b-4a98-b45c-6249c4efe8cd admin admin] PATH_INFO: `/v3/projects/f3b20f4e18564c2fa8589255cd5fe691/users/9520fec5d2db4ea2b7c5cd7fb9531aa0/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:00.515258 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75d33f-2e4b-4a98-b45c-6249c4efe8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b20f4e18564c2fa8589255cd5fe691, user_id=9520fec5d2db4ea2b7c5cd7fb9531aa0, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:00.517881 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75d33f-2e4b-4a98-b45c-6249c4efe8cd admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:00.531125 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1455/2898] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:50:00 2022] PUT /identity/v3/projects/f3b20f4e18564c2fa8589255cd5fe691/users/9520fec5d2db4ea2b7c5cd7fb9531aa0/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:00.535092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74225f1e-6de9-4a64-bea2-b7f2129c27a8 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:00.545611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74225f1e-6de9-4a64-bea2-b7f2129c27a8 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:00.566092 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:00.603023 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d0ba2-ef9c-4db4-891b-da7e3d314bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:00.603628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d0ba2-ef9c-4db4-891b-da7e3d314bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:00.603910 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d0ba2-ef9c-4db4-891b-da7e3d314bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:00.604701 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d0ba2-ef9c-4db4-891b-da7e3d314bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:00.605334 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d0ba2-ef9c-4db4-891b-da7e3d314bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:00.606951 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d0ba2-ef9c-4db4-891b-da7e3d314bd8 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:00.616969 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1444/2899] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:50:00.623633 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75d33f-2e4b-4a98-b45c-6249c4efe8cd admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:00.629053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:00.636273 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75d33f-2e4b-4a98-b45c-6249c4efe8cd admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:00.641022 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fb773-2ddd-4730-baad-4ff40681e24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:00.641666 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fb773-2ddd-4730-baad-4ff40681e24f admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:00.641942 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fb773-2ddd-4730-baad-4ff40681e24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:00.642212 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fb773-2ddd-4730-baad-4ff40681e24f admin admin] PATH_INFO: `/v3/projects/f3b20f4e18564c2fa8589255cd5fe691/users/9520fec5d2db4ea2b7c5cd7fb9531aa0/roles/3cd61239237441418529e9028ef801e4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:00.644176 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8fb773-2ddd-4730-baad-4ff40681e24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b20f4e18564c2fa8589255cd5fe691, user_id=9520fec5d2db4ea2b7c5cd7fb9531aa0, role_id=3cd61239237441418529e9028ef801e4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:00.646799 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8fb773-2ddd-4730-baad-4ff40681e24f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:00.656673 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1456/2900] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:50:00 2022] PUT /identity/v3/projects/f3b20f4e18564c2fa8589255cd5fe691/users/9520fec5d2db4ea2b7c5cd7fb9531aa0/roles/3cd61239237441418529e9028ef801e4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:00.668510 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106cd71-ebc5-49fd-a330-d65a0dd044fc None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:00.668884 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106cd71-ebc5-49fd-a330-d65a0dd044fc None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:00.669003 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106cd71-ebc5-49fd-a330-d65a0dd044fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:00.698423 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-7106cd71-ebc5-49fd-a330-d65a0dd044fc None None] MFA Rules not processed for user `9520fec5d2db4ea2b7c5cd7fb9531aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:00.699652 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-7106cd71-ebc5-49fd-a330-d65a0dd044fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:00.765074 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1445/2901] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:50:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:00.777781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fb773-2ddd-4730-baad-4ff40681e24f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:00.779599 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9e8fb773-2ddd-4730-baad-4ff40681e24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:00.834787 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fb773-2ddd-4730-baad-4ff40681e24f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:00.838302 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c7233-2a5b-4c8a-b20c-e06a7153eba3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:00.839428 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c7233-2a5b-4c8a-b20c-e06a7153eba3 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:00.839701 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c7233-2a5b-4c8a-b20c-e06a7153eba3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:00.839963 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c7233-2a5b-4c8a-b20c-e06a7153eba3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:00.848734 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c7233-2a5b-4c8a-b20c-e06a7153eba3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:00.850124 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c7233-2a5b-4c8a-b20c-e06a7153eba3 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:00.860316 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1457/2902] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:50:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:50:01.165480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106cd71-ebc5-49fd-a330-d65a0dd044fc None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:01.175233 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106cd71-ebc5-49fd-a330-d65a0dd044fc None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:01.180129 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fe048-095a-4fe7-9f8d-b2c15cf258cb tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9520fec5d2db4ea2b7c5cd7fb9531aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3b20f4e18564c2fa8589255cd5fe691', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:01.180682 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fe048-095a-4fe7-9f8d-b2c15cf258cb tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:01.180967 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fe048-095a-4fe7-9f8d-b2c15cf258cb tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:01.181245 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fe048-095a-4fe7-9f8d-b2c15cf258cb tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:01.181989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fe048-095a-4fe7-9f8d-b2c15cf258cb tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:50:01.183321 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fe048-095a-4fe7-9f8d-b2c15cf258cb tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:01.184426 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fe048-095a-4fe7-9f8d-b2c15cf258cb tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:01.196119 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1446/2903] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:50:01.200266 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c7233-2a5b-4c8a-b20c-e06a7153eba3 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:01.209831 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c7233-2a5b-4c8a-b20c-e06a7153eba3 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:01.214389 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8b80f-4d97-47fa-8747-c1cea9ea864f tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9520fec5d2db4ea2b7c5cd7fb9531aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3b20f4e18564c2fa8589255cd5fe691', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:01.215026 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8b80f-4d97-47fa-8747-c1cea9ea864f tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:01.215308 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8b80f-4d97-47fa-8747-c1cea9ea864f tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:01.215578 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8b80f-4d97-47fa-8747-c1cea9ea864f tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:01.216210 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8b80f-4d97-47fa-8747-c1cea9ea864f tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:01.218072 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8b80f-4d97-47fa-8747-c1cea9ea864f tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:01.246766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1458/2904] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:50:01 2022] POST /identity/v3/projects => generated 354 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:50:01.250916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fe048-095a-4fe7-9f8d-b2c15cf258cb tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:01.261411 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fe048-095a-4fe7-9f8d-b2c15cf258cb tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:01.317212 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e82d6-06eb-498e-85aa-ac9fb0f8f767 tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9520fec5d2db4ea2b7c5cd7fb9531aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3b20f4e18564c2fa8589255cd5fe691', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:01.317828 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e82d6-06eb-498e-85aa-ac9fb0f8f767 tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:01.318113 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e82d6-06eb-498e-85aa-ac9fb0f8f767 tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:01.318389 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e82d6-06eb-498e-85aa-ac9fb0f8f767 tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:01.319087 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e82d6-06eb-498e-85aa-ac9fb0f8f767 tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:50:01.319397 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e82d6-06eb-498e-85aa-ac9fb0f8f767 tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:01.321359 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e82d6-06eb-498e-85aa-ac9fb0f8f767 tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:01.334849 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1447/2905] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:50:01.372980 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8b80f-4d97-47fa-8747-c1cea9ea864f tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:01.383352 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8b80f-4d97-47fa-8747-c1cea9ea864f tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:01.388066 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f4f5c-912c-4161-91c8-94874375571e tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9520fec5d2db4ea2b7c5cd7fb9531aa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3b20f4e18564c2fa8589255cd5fe691', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:01.388685 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f4f5c-912c-4161-91c8-94874375571e tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:01.388967 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f4f5c-912c-4161-91c8-94874375571e tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:01.389239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f4f5c-912c-4161-91c8-94874375571e tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] PATH_INFO: `/v3/projects/3a56ceb17b9a440889d9875a5800fb85` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:01.390474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f4f5c-912c-4161-91c8-94874375571e tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3a56ceb17b9a440889d9875a5800fb85)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:01.392460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f4f5c-912c-4161-91c8-94874375571e tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:01.441149 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-234f4f5c-912c-4161-91c8-94874375571e tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a56ceb17b9a440889d9875a5800fb85', 'request_id': 'req-234f4f5c-912c-4161-91c8-94874375571e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:01.448088 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-234f4f5c-912c-4161-91c8-94874375571e tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a56ceb17b9a440889d9875a5800fb85', 'request_id': 'req-234f4f5c-912c-4161-91c8-94874375571e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:01.454275 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-234f4f5c-912c-4161-91c8-94874375571e tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a56ceb17b9a440889d9875a5800fb85', 'request_id': 'req-234f4f5c-912c-4161-91c8-94874375571e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:01.467287 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-234f4f5c-912c-4161-91c8-94874375571e tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] The token cache is being invalidate because project 3a56ceb17b9a440889d9875a5800fb85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:50:01.467577 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-234f4f5c-912c-4161-91c8-94874375571e tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:01.468250 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-234f4f5c-912c-4161-91c8-94874375571e tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:01.469742 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1459/2906] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:50:01 2022] DELETE /identity/v3/projects/3a56ceb17b9a440889d9875a5800fb85 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:01.667885 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e82d6-06eb-498e-85aa-ac9fb0f8f767 tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:01.669617 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d59e82d6-06eb-498e-85aa-ac9fb0f8f767 tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:01.700674 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=100 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:01.735356 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e82d6-06eb-498e-85aa-ac9fb0f8f767 tempest-VolumeQuotaClassesTest-1574593623 tempest-VolumeQuotaClassesTest-1574593623-project-admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:01.790857 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f0c5b-b104-4800-bd8a-7b8a0d0f8136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:01.791524 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f0c5b-b104-4800-bd8a-7b8a0d0f8136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:01.791846 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f0c5b-b104-4800-bd8a-7b8a0d0f8136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:01.792120 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f0c5b-b104-4800-bd8a-7b8a0d0f8136 admin admin] PATH_INFO: `/v3/users/a2ceb8bef61849a1aa7c4a28cc519581` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:01.793253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f0c5b-b104-4800-bd8a-7b8a0d0f8136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ceb8bef61849a1aa7c4a28cc519581)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:01.795205 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f0c5b-b104-4800-bd8a-7b8a0d0f8136 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:01.840312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-0b9f0c5b-b104-4800-bd8a-7b8a0d0f8136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ceb8bef61849a1aa7c4a28cc519581'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:01.840971 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-0b9f0c5b-b104-4800-bd8a-7b8a0d0f8136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ceb8bef61849a1aa7c4a28cc519581'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:01.852774 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-0b9f0c5b-b104-4800-bd8a-7b8a0d0f8136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ceb8bef61849a1aa7c4a28cc519581'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:01.861847 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-0b9f0c5b-b104-4800-bd8a-7b8a0d0f8136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ceb8bef61849a1aa7c4a28cc519581'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:01.870607 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-0b9f0c5b-b104-4800-bd8a-7b8a0d0f8136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ceb8bef61849a1aa7c4a28cc519581'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:01.876780 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1448/2907] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:50:01 2022] DELETE /identity/v3/users/a2ceb8bef61849a1aa7c4a28cc519581 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:01.881447 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b642b3-787c-4fec-83d1-b29eefa7e96a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:01.882068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b642b3-787c-4fec-83d1-b29eefa7e96a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:01.882068 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b642b3-787c-4fec-83d1-b29eefa7e96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:01.900865 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-47b642b3-787c-4fec-83d1-b29eefa7e96a None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:01.902071 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-47b642b3-787c-4fec-83d1-b29eefa7e96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:01.948094 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:01.961737 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1460/2908] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:01.971390 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f0c5b-b104-4800-bd8a-7b8a0d0f8136 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:01.972769 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-0b9f0c5b-b104-4800-bd8a-7b8a0d0f8136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:02.028315 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f0c5b-b104-4800-bd8a-7b8a0d0f8136 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:02.031939 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153d9c8-6528-4d72-8f04-86e22a53f509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:02.032528 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153d9c8-6528-4d72-8f04-86e22a53f509 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:02.032806 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153d9c8-6528-4d72-8f04-86e22a53f509 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:02.033071 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153d9c8-6528-4d72-8f04-86e22a53f509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:02.039838 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:02.042704 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153d9c8-6528-4d72-8f04-86e22a53f509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:02.044589 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153d9c8-6528-4d72-8f04-86e22a53f509 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:02.055956 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1449/2909] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:50:02.317901 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b642b3-787c-4fec-83d1-b29eefa7e96a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:02.319474 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-47b642b3-787c-4fec-83d1-b29eefa7e96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:02.332243 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b642b3-787c-4fec-83d1-b29eefa7e96a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:02.337936 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22798018-76f2-44cd-8953-69e6e2bd1d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:02.339222 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22798018-76f2-44cd-8953-69e6e2bd1d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:02.339510 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22798018-76f2-44cd-8953-69e6e2bd1d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:02.339783 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22798018-76f2-44cd-8953-69e6e2bd1d90 admin admin] PATH_INFO: `/v3/projects/695eeabfd72f4531947c4c4a7c77c7c1` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:02.340948 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22798018-76f2-44cd-8953-69e6e2bd1d90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=695eeabfd72f4531947c4c4a7c77c7c1)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:02.342896 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22798018-76f2-44cd-8953-69e6e2bd1d90 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:02.396053 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-22798018-76f2-44cd-8953-69e6e2bd1d90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '695eeabfd72f4531947c4c4a7c77c7c1', 'request_id': 'req-22798018-76f2-44cd-8953-69e6e2bd1d90'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:02.402731 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-22798018-76f2-44cd-8953-69e6e2bd1d90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '695eeabfd72f4531947c4c4a7c77c7c1', 'request_id': 'req-22798018-76f2-44cd-8953-69e6e2bd1d90'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:02.408463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-22798018-76f2-44cd-8953-69e6e2bd1d90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '695eeabfd72f4531947c4c4a7c77c7c1', 'request_id': 'req-22798018-76f2-44cd-8953-69e6e2bd1d90'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:02.421771 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-22798018-76f2-44cd-8953-69e6e2bd1d90 admin admin] The token cache is being invalidate because project 695eeabfd72f4531947c4c4a7c77c7c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:50:02.422058 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-22798018-76f2-44cd-8953-69e6e2bd1d90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:02.422729 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-22798018-76f2-44cd-8953-69e6e2bd1d90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:02.424215 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1461/2910] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:50:02 2022] DELETE /identity/v3/projects/695eeabfd72f4531947c4c4a7c77c7c1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:02.428422 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153d9c8-6528-4d72-8f04-86e22a53f509 service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:02.438319 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153d9c8-6528-4d72-8f04-86e22a53f509 service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:02.495691 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0b2a2-5dcf-4172-9b97-2d1aced62bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:02.496233 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0b2a2-5dcf-4172-9b97-2d1aced62bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:02.496514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0b2a2-5dcf-4172-9b97-2d1aced62bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:02.496783 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0b2a2-5dcf-4172-9b97-2d1aced62bbc admin admin] PATH_INFO: `/v3/users/9520fec5d2db4ea2b7c5cd7fb9531aa0` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:02.497920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0b2a2-5dcf-4172-9b97-2d1aced62bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9520fec5d2db4ea2b7c5cd7fb9531aa0)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:02.499854 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0b2a2-5dcf-4172-9b97-2d1aced62bbc admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:02.549958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a6e0b2a2-5dcf-4172-9b97-2d1aced62bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9520fec5d2db4ea2b7c5cd7fb9531aa0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:02.550639 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a6e0b2a2-5dcf-4172-9b97-2d1aced62bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9520fec5d2db4ea2b7c5cd7fb9531aa0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:02.564008 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a6e0b2a2-5dcf-4172-9b97-2d1aced62bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9520fec5d2db4ea2b7c5cd7fb9531aa0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:02.571114 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a6e0b2a2-5dcf-4172-9b97-2d1aced62bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9520fec5d2db4ea2b7c5cd7fb9531aa0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:02.579027 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-a6e0b2a2-5dcf-4172-9b97-2d1aced62bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9520fec5d2db4ea2b7c5cd7fb9531aa0'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:02.584867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1450/2911] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:50:02 2022] DELETE /identity/v3/users/9520fec5d2db4ea2b7c5cd7fb9531aa0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:02.856323 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22798018-76f2-44cd-8953-69e6e2bd1d90 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:02.857898 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-22798018-76f2-44cd-8953-69e6e2bd1d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:02.872201 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22798018-76f2-44cd-8953-69e6e2bd1d90 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:02.930878 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6543c-efc7-412a-93d0-989aa3715a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:02.931548 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6543c-efc7-412a-93d0-989aa3715a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:02.931803 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6543c-efc7-412a-93d0-989aa3715a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:02.932090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6543c-efc7-412a-93d0-989aa3715a26 admin admin] PATH_INFO: `/v3/projects/f3b20f4e18564c2fa8589255cd5fe691` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:02.933194 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6543c-efc7-412a-93d0-989aa3715a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b20f4e18564c2fa8589255cd5fe691)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:02.935159 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6543c-efc7-412a-93d0-989aa3715a26 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:02.983300 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4db6543c-efc7-412a-93d0-989aa3715a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b20f4e18564c2fa8589255cd5fe691', 'request_id': 'req-4db6543c-efc7-412a-93d0-989aa3715a26'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:02.989444 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4db6543c-efc7-412a-93d0-989aa3715a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b20f4e18564c2fa8589255cd5fe691', 'request_id': 'req-4db6543c-efc7-412a-93d0-989aa3715a26'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:02.995773 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4db6543c-efc7-412a-93d0-989aa3715a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b20f4e18564c2fa8589255cd5fe691', 'request_id': 'req-4db6543c-efc7-412a-93d0-989aa3715a26'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:03.009036 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4db6543c-efc7-412a-93d0-989aa3715a26 admin admin] The token cache is being invalidate because project f3b20f4e18564c2fa8589255cd5fe691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:50:03.009320 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4db6543c-efc7-412a-93d0-989aa3715a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:03.009975 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4db6543c-efc7-412a-93d0-989aa3715a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:03.012061 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1462/2912] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:50:02 2022] DELETE /identity/v3/projects/f3b20f4e18564c2fa8589255cd5fe691 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:03.017909 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25284bfe-20c6-49b2-81f2-c1a68c390275 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:03.018608 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25284bfe-20c6-49b2-81f2-c1a68c390275 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:03.018608 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25284bfe-20c6-49b2-81f2-c1a68c390275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:03.038324 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-25284bfe-20c6-49b2-81f2-c1a68c390275 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:03.039574 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-25284bfe-20c6-49b2-81f2-c1a68c390275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:03.098994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1451/2913] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:03.107019 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd20d1-1a68-47d9-acac-d423c1dbe282 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:03.107303 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd20d1-1a68-47d9-acac-d423c1dbe282 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:03.107575 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd20d1-1a68-47d9-acac-d423c1dbe282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:03.122040 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:03.127821 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-addd20d1-1a68-47d9-acac-d423c1dbe282 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:03.129556 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-addd20d1-1a68-47d9-acac-d423c1dbe282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:03.139481 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1463/2914] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:03.144338 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25284bfe-20c6-49b2-81f2-c1a68c390275 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:03.156772 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25284bfe-20c6-49b2-81f2-c1a68c390275 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:03.161498 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ad53c-a7d1-43c3-ae3f-cb6836a26b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:03.162098 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ad53c-a7d1-43c3-ae3f-cb6836a26b3c admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:03.162373 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ad53c-a7d1-43c3-ae3f-cb6836a26b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:03.162664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ad53c-a7d1-43c3-ae3f-cb6836a26b3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:03.163312 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ad53c-a7d1-43c3-ae3f-cb6836a26b3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:50:03.163611 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ad53c-a7d1-43c3-ae3f-cb6836a26b3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:03.165186 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ad53c-a7d1-43c3-ae3f-cb6836a26b3c admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:03.177339 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1452/2915] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:50:03.181675 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd20d1-1a68-47d9-acac-d423c1dbe282 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:03.191611 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd20d1-1a68-47d9-acac-d423c1dbe282 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:03.196325 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc78285-84c5-4fc5-9bfc-e396ed616142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:03.196927 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc78285-84c5-4fc5-9bfc-e396ed616142 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:03.197202 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc78285-84c5-4fc5-9bfc-e396ed616142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:03.197469 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc78285-84c5-4fc5-9bfc-e396ed616142 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:03.198722 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc78285-84c5-4fc5-9bfc-e396ed616142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:03.200608 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc78285-84c5-4fc5-9bfc-e396ed616142 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:03.230178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1464/2916] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:50:03 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:50:03.234448 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ad53c-a7d1-43c3-ae3f-cb6836a26b3c admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:03.241038 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:03.245514 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ad53c-a7d1-43c3-ae3f-cb6836a26b3c admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:03.310239 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516de717-8f82-47ee-9be8-bd9c8b7d07e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:03.310784 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516de717-8f82-47ee-9be8-bd9c8b7d07e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:03.311063 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516de717-8f82-47ee-9be8-bd9c8b7d07e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:03.311333 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516de717-8f82-47ee-9be8-bd9c8b7d07e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:03.311958 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516de717-8f82-47ee-9be8-bd9c8b7d07e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:03.313842 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516de717-8f82-47ee-9be8-bd9c8b7d07e5 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:03.335710 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1453/2917] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:50:03 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:50:03.339909 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc78285-84c5-4fc5-9bfc-e396ed616142 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:03.350110 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc78285-84c5-4fc5-9bfc-e396ed616142 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:03.355231 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccf08c-0fce-420e-9512-03c9efbaf6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:03.355816 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccf08c-0fce-420e-9512-03c9efbaf6cb admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:03.356092 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccf08c-0fce-420e-9512-03c9efbaf6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:03.356363 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccf08c-0fce-420e-9512-03c9efbaf6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:03.356998 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccf08c-0fce-420e-9512-03c9efbaf6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:03.358578 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccf08c-0fce-420e-9512-03c9efbaf6cb admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:03.368195 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1465/2918] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:50:03.372721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516de717-8f82-47ee-9be8-bd9c8b7d07e5 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:03.382764 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516de717-8f82-47ee-9be8-bd9c8b7d07e5 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:03.387352 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983ebba-393d-41f7-9b52-095daf785417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:03.387936 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ebba-393d-41f7-9b52-095daf785417 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:03.388211 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ebba-393d-41f7-9b52-095daf785417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:03.388481 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ebba-393d-41f7-9b52-095daf785417 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:03.389115 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983ebba-393d-41f7-9b52-095daf785417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:03.390725 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983ebba-393d-41f7-9b52-095daf785417 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:03.400449 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1454/2919] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:50:03.404484 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccf08c-0fce-420e-9512-03c9efbaf6cb admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:03.414388 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccf08c-0fce-420e-9512-03c9efbaf6cb admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:03.419591 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c29f6-de98-4317-b511-34dce8207210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:03.420227 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c29f6-de98-4317-b511-34dce8207210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:03.420502 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c29f6-de98-4317-b511-34dce8207210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:03.420769 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c29f6-de98-4317-b511-34dce8207210 admin admin] PATH_INFO: `/v3/projects/97f8aa58de5d4a2ea0e9ed4aaa479ea5/users/8cac973ba6a445d3992d607f94ab93a1/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:03.436040 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c29f6-de98-4317-b511-34dce8207210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f8aa58de5d4a2ea0e9ed4aaa479ea5, user_id=8cac973ba6a445d3992d607f94ab93a1, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:03.439338 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c29f6-de98-4317-b511-34dce8207210 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:03.453555 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1466/2920] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:50:03 2022] PUT /identity/v3/projects/97f8aa58de5d4a2ea0e9ed4aaa479ea5/users/8cac973ba6a445d3992d607f94ab93a1/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:03.463872 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79712e43-e979-4f3d-8d9b-5b03ed7a0246 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:03.464160 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79712e43-e979-4f3d-8d9b-5b03ed7a0246 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:03.464464 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79712e43-e979-4f3d-8d9b-5b03ed7a0246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:03.492432 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-79712e43-e979-4f3d-8d9b-5b03ed7a0246 None None] MFA Rules not processed for user `8cac973ba6a445d3992d607f94ab93a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:03.493628 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-79712e43-e979-4f3d-8d9b-5b03ed7a0246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:03.556376 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1455/2921] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:50:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:03.568049 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c29f6-de98-4317-b511-34dce8207210 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:03.569745 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-159c29f6-de98-4317-b511-34dce8207210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:03.654876 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c29f6-de98-4317-b511-34dce8207210 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:03.659341 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5033b-15b6-482c-ad72-d42639571526 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11356a5e3d041729f71515482033dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:03.659953 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5033b-15b6-482c-ad72-d42639571526 service glance] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:03.660254 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5033b-15b6-482c-ad72-d42639571526 service glance] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:03.660527 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5033b-15b6-482c-ad72-d42639571526 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:03.669472 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5033b-15b6-482c-ad72-d42639571526 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:03.670903 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5033b-15b6-482c-ad72-d42639571526 service glance] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:03.679569 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1467/2922] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:50:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:50:13.553513 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:13.675665 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=59,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:23.420756 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79712e43-e979-4f3d-8d9b-5b03ed7a0246 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:23.482916 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79712e43-e979-4f3d-8d9b-5b03ed7a0246 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:23.487295 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275a45-1a60-414e-ba93-eb5cf68e5bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:23.487922 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275a45-1a60-414e-ba93-eb5cf68e5bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:23.488197 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275a45-1a60-414e-ba93-eb5cf68e5bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:23.488466 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275a45-1a60-414e-ba93-eb5cf68e5bfd admin admin] PATH_INFO: `/v3/users/8cac973ba6a445d3992d607f94ab93a1` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:23.489579 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28275a45-1a60-414e-ba93-eb5cf68e5bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cac973ba6a445d3992d607f94ab93a1)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:23.491509 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28275a45-1a60-414e-ba93-eb5cf68e5bfd admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:23.539324 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-28275a45-1a60-414e-ba93-eb5cf68e5bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cac973ba6a445d3992d607f94ab93a1'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:23.540018 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-28275a45-1a60-414e-ba93-eb5cf68e5bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cac973ba6a445d3992d607f94ab93a1'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:23.551820 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-28275a45-1a60-414e-ba93-eb5cf68e5bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cac973ba6a445d3992d607f94ab93a1'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:23.560334 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-28275a45-1a60-414e-ba93-eb5cf68e5bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cac973ba6a445d3992d607f94ab93a1'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:23.567679 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-28275a45-1a60-414e-ba93-eb5cf68e5bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cac973ba6a445d3992d607f94ab93a1'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:23.574207 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1456/2923] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:50:23 2022] DELETE /identity/v3/users/8cac973ba6a445d3992d607f94ab93a1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:23.578945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0085-eb31-45f8-91d6-eaea7790bf46 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:23.579463 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0085-eb31-45f8-91d6-eaea7790bf46 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:23.579565 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0085-eb31-45f8-91d6-eaea7790bf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:23.599188 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d72f0085-eb31-45f8-91d6-eaea7790bf46 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:23.600405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d72f0085-eb31-45f8-91d6-eaea7790bf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:23.663833 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1468/2924] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:23.674158 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275a45-1a60-414e-ba93-eb5cf68e5bfd admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:23.675555 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-28275a45-1a60-414e-ba93-eb5cf68e5bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:23.733108 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275a45-1a60-414e-ba93-eb5cf68e5bfd admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:23.736753 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940181c-e8e8-4e64-95c7-8a3e24b389df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:23.737355 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940181c-e8e8-4e64-95c7-8a3e24b389df service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:23.737634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940181c-e8e8-4e64-95c7-8a3e24b389df service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:23.737904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940181c-e8e8-4e64-95c7-8a3e24b389df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:23.747718 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940181c-e8e8-4e64-95c7-8a3e24b389df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:23.749183 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940181c-e8e8-4e64-95c7-8a3e24b389df service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:23.758946 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1457/2925] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:50:24.031920 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f0085-eb31-45f8-91d6-eaea7790bf46 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:24.033475 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d72f0085-eb31-45f8-91d6-eaea7790bf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:24.046101 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f0085-eb31-45f8-91d6-eaea7790bf46 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:24.050849 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d481a-2485-40f9-9b38-35bebefda42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:24.051491 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d481a-2485-40f9-9b38-35bebefda42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:24.051769 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d481a-2485-40f9-9b38-35bebefda42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:24.052038 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d481a-2485-40f9-9b38-35bebefda42e admin admin] PATH_INFO: `/v3/projects/97f8aa58de5d4a2ea0e9ed4aaa479ea5` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:24.053203 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d481a-2485-40f9-9b38-35bebefda42e admin admin] RBAC: Authorizing `identity:delete_project(project_id=97f8aa58de5d4a2ea0e9ed4aaa479ea5)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:24.055315 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d481a-2485-40f9-9b38-35bebefda42e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:24.105637 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f16d481a-2485-40f9-9b38-35bebefda42e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97f8aa58de5d4a2ea0e9ed4aaa479ea5', 'request_id': 'req-f16d481a-2485-40f9-9b38-35bebefda42e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:24.111777 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f16d481a-2485-40f9-9b38-35bebefda42e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97f8aa58de5d4a2ea0e9ed4aaa479ea5', 'request_id': 'req-f16d481a-2485-40f9-9b38-35bebefda42e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:24.117283 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f16d481a-2485-40f9-9b38-35bebefda42e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97f8aa58de5d4a2ea0e9ed4aaa479ea5', 'request_id': 'req-f16d481a-2485-40f9-9b38-35bebefda42e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:24.129608 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f16d481a-2485-40f9-9b38-35bebefda42e admin admin] The token cache is being invalidate because project 97f8aa58de5d4a2ea0e9ed4aaa479ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:50:24.129889 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f16d481a-2485-40f9-9b38-35bebefda42e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:24.130513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f16d481a-2485-40f9-9b38-35bebefda42e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:24.132021 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1469/2926] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:50:24 2022] DELETE /identity/v3/projects/97f8aa58de5d4a2ea0e9ed4aaa479ea5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:24.137062 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c1d75-ba2a-4b8c-bfd4-498b15a49a53 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:24.137414 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c1d75-ba2a-4b8c-bfd4-498b15a49a53 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:24.137655 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c1d75-ba2a-4b8c-bfd4-498b15a49a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:24.162438 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-c36c1d75-ba2a-4b8c-bfd4-498b15a49a53 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:24.163625 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-c36c1d75-ba2a-4b8c-bfd4-498b15a49a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:24.181995 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:24.227581 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1458/2927] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:24.290239 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ae2b3-40ac-4880-93d2-24bffb9f28e8 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:24.290505 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ae2b3-40ac-4880-93d2-24bffb9f28e8 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:24.290908 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ae2b3-40ac-4880-93d2-24bffb9f28e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:24.311155 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-3d3ae2b3-40ac-4880-93d2-24bffb9f28e8 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:24.312368 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3d3ae2b3-40ac-4880-93d2-24bffb9f28e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:24.320372 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1470/2928] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:24.324729 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c1d75-ba2a-4b8c-bfd4-498b15a49a53 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:24.335049 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c1d75-ba2a-4b8c-bfd4-498b15a49a53 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:24.340253 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b37ff4-072b-4608-9c9b-5989937264d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:24.340857 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b37ff4-072b-4608-9c9b-5989937264d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:24.341135 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b37ff4-072b-4608-9c9b-5989937264d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:24.341403 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b37ff4-072b-4608-9c9b-5989937264d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:24.342056 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b37ff4-072b-4608-9c9b-5989937264d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:50:24.342358 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b37ff4-072b-4608-9c9b-5989937264d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:24.343987 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b37ff4-072b-4608-9c9b-5989937264d5 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:24.356163 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1459/2929] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:50:24.360727 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ae2b3-40ac-4880-93d2-24bffb9f28e8 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:24.370488 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ae2b3-40ac-4880-93d2-24bffb9f28e8 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:24.375183 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af2b64-5f60-4053-b089-7abcd7a0f788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:24.375781 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af2b64-5f60-4053-b089-7abcd7a0f788 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:24.376057 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af2b64-5f60-4053-b089-7abcd7a0f788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:24.376326 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af2b64-5f60-4053-b089-7abcd7a0f788 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:24.376968 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af2b64-5f60-4053-b089-7abcd7a0f788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:24.378869 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af2b64-5f60-4053-b089-7abcd7a0f788 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:24.407226 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1471/2930] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:50:24 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:50:24.411525 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b37ff4-072b-4608-9c9b-5989937264d5 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:24.421795 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b37ff4-072b-4608-9c9b-5989937264d5 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:24.479690 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab834d-4c51-461f-a1ea-628a6610588e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:24.480305 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab834d-4c51-461f-a1ea-628a6610588e admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:24.480585 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab834d-4c51-461f-a1ea-628a6610588e admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:24.480857 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab834d-4c51-461f-a1ea-628a6610588e admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:24.481509 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab834d-4c51-461f-a1ea-628a6610588e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:24.483436 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab834d-4c51-461f-a1ea-628a6610588e admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:24.504619 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1460/2931] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:50:24 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:50:24.509172 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af2b64-5f60-4053-b089-7abcd7a0f788 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:24.520700 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af2b64-5f60-4053-b089-7abcd7a0f788 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:24.526877 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd117128-b135-46b2-883a-9de956bbbb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:24.527513 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd117128-b135-46b2-883a-9de956bbbb9c admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:24.527820 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd117128-b135-46b2-883a-9de956bbbb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:24.528095 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd117128-b135-46b2-883a-9de956bbbb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:24.529020 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd117128-b135-46b2-883a-9de956bbbb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:24.530822 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd117128-b135-46b2-883a-9de956bbbb9c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:24.541353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1472/2932] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:50:24.546438 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab834d-4c51-461f-a1ea-628a6610588e admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:24.557184 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab834d-4c51-461f-a1ea-628a6610588e admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:24.561904 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e2d0e-ec99-4329-b545-1dd2992741ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:24.562539 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e2d0e-ec99-4329-b545-1dd2992741ea admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:24.562848 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e2d0e-ec99-4329-b545-1dd2992741ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:24.563121 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e2d0e-ec99-4329-b545-1dd2992741ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:24.563756 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e2d0e-ec99-4329-b545-1dd2992741ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:24.565334 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e2d0e-ec99-4329-b545-1dd2992741ea admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:24.579108 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1461/2933] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:50:24.583500 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd117128-b135-46b2-883a-9de956bbbb9c admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:24.594562 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd117128-b135-46b2-883a-9de956bbbb9c admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:24.599432 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fa0d5-94ad-4434-b74a-32de57a941ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:24.600090 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fa0d5-94ad-4434-b74a-32de57a941ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:24.600389 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fa0d5-94ad-4434-b74a-32de57a941ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:24.600647 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fa0d5-94ad-4434-b74a-32de57a941ff admin admin] PATH_INFO: `/v3/projects/6843894ce735474ca8a056d9244632c2/users/61d043df526d41b8aec90da609bfed0c/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:24.616028 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fa0d5-94ad-4434-b74a-32de57a941ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6843894ce735474ca8a056d9244632c2, user_id=61d043df526d41b8aec90da609bfed0c, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:24.618790 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fa0d5-94ad-4434-b74a-32de57a941ff admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:24.632376 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1473/2934] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:50:24 2022] PUT /identity/v3/projects/6843894ce735474ca8a056d9244632c2/users/61d043df526d41b8aec90da609bfed0c/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:24.643171 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caa5cb-479b-4e0e-a325-b939347f1822 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:24.643454 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caa5cb-479b-4e0e-a325-b939347f1822 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:24.643724 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caa5cb-479b-4e0e-a325-b939347f1822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:24.673097 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-05caa5cb-479b-4e0e-a325-b939347f1822 None None] MFA Rules not processed for user `61d043df526d41b8aec90da609bfed0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:24.674217 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-05caa5cb-479b-4e0e-a325-b939347f1822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:24.749732 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1462/2935] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:50:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:24.761389 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fa0d5-94ad-4434-b74a-32de57a941ff admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:24.763138 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-903fa0d5-94ad-4434-b74a-32de57a941ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:24.785384 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:24.823717 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fa0d5-94ad-4434-b74a-32de57a941ff admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:24.827668 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75440489-161b-4b02-b75a-ccd2468b0fea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b11356a5e3d041729f71515482033dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:24.828269 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75440489-161b-4b02-b75a-ccd2468b0fea service glance] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:24.828547 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75440489-161b-4b02-b75a-ccd2468b0fea service glance] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:24.828816 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75440489-161b-4b02-b75a-ccd2468b0fea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:24.837554 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75440489-161b-4b02-b75a-ccd2468b0fea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:24.839523 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75440489-161b-4b02-b75a-ccd2468b0fea service glance] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:24.848460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1474/2936] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:50:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:50:34.746371 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:34.844391 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=17 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:50.628492 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05caa5cb-479b-4e0e-a325-b939347f1822 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:50.713592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05caa5cb-479b-4e0e-a325-b939347f1822 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:50.718547 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fcd31-44c6-42e1-8426-556aa2c2704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:50.719320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fcd31-44c6-42e1-8426-556aa2c2704b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:50.719672 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fcd31-44c6-42e1-8426-556aa2c2704b admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:50.720016 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fcd31-44c6-42e1-8426-556aa2c2704b admin admin] PATH_INFO: `/v3/users/61d043df526d41b8aec90da609bfed0c` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:50.721434 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fcd31-44c6-42e1-8426-556aa2c2704b admin admin] RBAC: Authorizing `identity:delete_user(user_id=61d043df526d41b8aec90da609bfed0c)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:50.723829 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fcd31-44c6-42e1-8426-556aa2c2704b admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:50.776994 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-340fcd31-44c6-42e1-8426-556aa2c2704b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61d043df526d41b8aec90da609bfed0c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:50.777664 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-340fcd31-44c6-42e1-8426-556aa2c2704b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61d043df526d41b8aec90da609bfed0c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:50.791065 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-340fcd31-44c6-42e1-8426-556aa2c2704b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61d043df526d41b8aec90da609bfed0c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:50.799062 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-340fcd31-44c6-42e1-8426-556aa2c2704b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61d043df526d41b8aec90da609bfed0c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:50.807054 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-340fcd31-44c6-42e1-8426-556aa2c2704b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61d043df526d41b8aec90da609bfed0c'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:50.813884 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1463/2937] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:50:50 2022] DELETE /identity/v3/users/61d043df526d41b8aec90da609bfed0c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:50.819267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ab7df-a033-4eb5-9043-ef303a921b61 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:50.819931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ab7df-a033-4eb5-9043-ef303a921b61 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:50.819931 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ab7df-a033-4eb5-9043-ef303a921b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:50.842178 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5c1ab7df-a033-4eb5-9043-ef303a921b61 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:50.843625 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5c1ab7df-a033-4eb5-9043-ef303a921b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:50.905232 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1475/2938] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:50.916570 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fcd31-44c6-42e1-8426-556aa2c2704b admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:50.918005 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-340fcd31-44c6-42e1-8426-556aa2c2704b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:50.976901 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fcd31-44c6-42e1-8426-556aa2c2704b admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:50.981345 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770de8e5-8caf-41da-b951-22c244d8ff04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:50.982011 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770de8e5-8caf-41da-b951-22c244d8ff04 service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:50.982327 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770de8e5-8caf-41da-b951-22c244d8ff04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:50.982643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770de8e5-8caf-41da-b951-22c244d8ff04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:50.991792 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770de8e5-8caf-41da-b951-22c244d8ff04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:50.993747 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770de8e5-8caf-41da-b951-22c244d8ff04 service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:51.003321 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1464/2939] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:50:51.279526 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ab7df-a033-4eb5-9043-ef303a921b61 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:51.281065 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5c1ab7df-a033-4eb5-9043-ef303a921b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:51.295721 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ab7df-a033-4eb5-9043-ef303a921b61 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:51.300574 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4ec90-6fab-4fd5-ba3b-f7cbab8577a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:51.301755 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4ec90-6fab-4fd5-ba3b-f7cbab8577a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:51.302043 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4ec90-6fab-4fd5-ba3b-f7cbab8577a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:51.302501 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4ec90-6fab-4fd5-ba3b-f7cbab8577a5 admin admin] PATH_INFO: `/v3/projects/6843894ce735474ca8a056d9244632c2` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:51.303945 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4ec90-6fab-4fd5-ba3b-f7cbab8577a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6843894ce735474ca8a056d9244632c2)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:51.306008 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4ec90-6fab-4fd5-ba3b-f7cbab8577a5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:51.352375 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-00c4ec90-6fab-4fd5-ba3b-f7cbab8577a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6843894ce735474ca8a056d9244632c2', 'request_id': 'req-00c4ec90-6fab-4fd5-ba3b-f7cbab8577a5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:51.359071 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-00c4ec90-6fab-4fd5-ba3b-f7cbab8577a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6843894ce735474ca8a056d9244632c2', 'request_id': 'req-00c4ec90-6fab-4fd5-ba3b-f7cbab8577a5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:51.364642 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-00c4ec90-6fab-4fd5-ba3b-f7cbab8577a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6843894ce735474ca8a056d9244632c2', 'request_id': 'req-00c4ec90-6fab-4fd5-ba3b-f7cbab8577a5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:51.376948 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-00c4ec90-6fab-4fd5-ba3b-f7cbab8577a5 admin admin] The token cache is being invalidate because project 6843894ce735474ca8a056d9244632c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:50:51.377227 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-00c4ec90-6fab-4fd5-ba3b-f7cbab8577a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:51.377848 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-00c4ec90-6fab-4fd5-ba3b-f7cbab8577a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:51.379353 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1476/2940] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:50:51 2022] DELETE /identity/v3/projects/6843894ce735474ca8a056d9244632c2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:51.385447 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c7006-bff2-4e12-8d5a-2d141aa14ddb None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:51.385734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c7006-bff2-4e12-8d5a-2d141aa14ddb None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:51.386007 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c7006-bff2-4e12-8d5a-2d141aa14ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:51.393871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:51.408248 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-d34c7006-bff2-4e12-8d5a-2d141aa14ddb None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:51.409483 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-d34c7006-bff2-4e12-8d5a-2d141aa14ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:51.472734 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1465/2941] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:51.482233 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681f270-0e3b-49ca-8ec8-f360f0a1f0d4 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:51.482531 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681f270-0e3b-49ca-8ec8-f360f0a1f0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:51.482891 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681f270-0e3b-49ca-8ec8-f360f0a1f0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:51.503526 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b681f270-0e3b-49ca-8ec8-f360f0a1f0d4 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:51.504805 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b681f270-0e3b-49ca-8ec8-f360f0a1f0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:51.513668 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1477/2942] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:51.518108 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c7006-bff2-4e12-8d5a-2d141aa14ddb None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:51.528397 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c7006-bff2-4e12-8d5a-2d141aa14ddb None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:51.532998 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c0a4a-a065-4379-badb-6404f95d2da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:51.533592 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c0a4a-a065-4379-badb-6404f95d2da0 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:51.533880 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c0a4a-a065-4379-badb-6404f95d2da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:51.534155 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c0a4a-a065-4379-badb-6404f95d2da0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:51.534834 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c0a4a-a065-4379-badb-6404f95d2da0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:50:51.535144 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c0a4a-a065-4379-badb-6404f95d2da0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:51.536727 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c0a4a-a065-4379-badb-6404f95d2da0 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:51.548190 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1466/2943] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Sep 1 16:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:50:51.552342 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681f270-0e3b-49ca-8ec8-f360f0a1f0d4 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:51.561561 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681f270-0e3b-49ca-8ec8-f360f0a1f0d4 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:51.566117 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e49bbb-6c0b-4a05-8eef-a05395ee5efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:51.566724 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e49bbb-6c0b-4a05-8eef-a05395ee5efb admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:51.567001 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e49bbb-6c0b-4a05-8eef-a05395ee5efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:51.567267 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e49bbb-6c0b-4a05-8eef-a05395ee5efb admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:51.567884 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e49bbb-6c0b-4a05-8eef-a05395ee5efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:51.569748 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e49bbb-6c0b-4a05-8eef-a05395ee5efb admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:51.597543 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1478/2944] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Sep 1 16:50:51 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:50:51.601634 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c0a4a-a065-4379-badb-6404f95d2da0 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:51.611989 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c0a4a-a065-4379-badb-6404f95d2da0 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:51.668530 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3623066-df9d-483b-9df2-7c291bd46c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:51.669336 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3623066-df9d-483b-9df2-7c291bd46c16 admin admin] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:51.669480 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3623066-df9d-483b-9df2-7c291bd46c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:51.669692 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3623066-df9d-483b-9df2-7c291bd46c16 admin admin] PATH_INFO: `/v3/users` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:51.670297 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3623066-df9d-483b-9df2-7c291bd46c16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:51.672228 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3623066-df9d-483b-9df2-7c291bd46c16 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:51.695868 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1467/2945] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Sep 1 16:50:51 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:50:51.699902 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e49bbb-6c0b-4a05-8eef-a05395ee5efb admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:51.710525 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e49bbb-6c0b-4a05-8eef-a05395ee5efb admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:51.715228 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a745e-99b0-48e7-8ec9-90b07146a6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:51.715812 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a745e-99b0-48e7-8ec9-90b07146a6da admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:51.716091 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a745e-99b0-48e7-8ec9-90b07146a6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:51.716364 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a745e-99b0-48e7-8ec9-90b07146a6da admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:51.717001 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a745e-99b0-48e7-8ec9-90b07146a6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:51.719134 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a745e-99b0-48e7-8ec9-90b07146a6da admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:51.734224 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1479/2946] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:50:51.738427 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3623066-df9d-483b-9df2-7c291bd46c16 admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:51.749262 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3623066-df9d-483b-9df2-7c291bd46c16 admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:51.753948 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb6c51-25cf-47e8-8af7-9eaa025605a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:51.754551 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb6c51-25cf-47e8-8af7-9eaa025605a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:51.754867 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb6c51-25cf-47e8-8af7-9eaa025605a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:51.755143 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb6c51-25cf-47e8-8af7-9eaa025605a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:51.755775 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb6c51-25cf-47e8-8af7-9eaa025605a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:51.757347 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb6c51-25cf-47e8-8af7-9eaa025605a5 admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:51.767920 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1468/2947] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Sep 1 16:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:50:51.772668 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a745e-99b0-48e7-8ec9-90b07146a6da admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:51.783201 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a745e-99b0-48e7-8ec9-90b07146a6da admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:51.787836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a51c-a913-4df4-b05a-28f91598a0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:51.788476 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a51c-a913-4df4-b05a-28f91598a0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:51.788756 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a51c-a913-4df4-b05a-28f91598a0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:51.789027 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a51c-a913-4df4-b05a-28f91598a0fe admin admin] PATH_INFO: `/v3/projects/9738214a81fe442b8e15960d94e93842/users/99ff42621d72414aae829878f44bbc54/roles/8b655a66d879422db1b56ca98d77e490` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:51.803864 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264a51c-a913-4df4-b05a-28f91598a0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9738214a81fe442b8e15960d94e93842, user_id=99ff42621d72414aae829878f44bbc54, role_id=8b655a66d879422db1b56ca98d77e490)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:51.806536 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264a51c-a913-4df4-b05a-28f91598a0fe admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:51.820412 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1480/2948] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Sep 1 16:50:51 2022] PUT /identity/v3/projects/9738214a81fe442b8e15960d94e93842/users/99ff42621d72414aae829878f44bbc54/roles/8b655a66d879422db1b56ca98d77e490 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:51.831545 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68220f53-7016-4af1-9192-1cc6891d3221 None None] REQUEST_METHOD: `POST` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:51.831832 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68220f53-7016-4af1-9192-1cc6891d3221 None None] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:51.832103 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68220f53-7016-4af1-9192-1cc6891d3221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:51.862095 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.auth.core [None req-68220f53-7016-4af1-9192-1cc6891d3221 None None] MFA Rules not processed for user `99ff42621d72414aae829878f44bbc54`. Rule list: `[]` (Enabled: `True`). {{(pid=81498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:51.863368 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-68220f53-7016-4af1-9192-1cc6891d3221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:51.924602 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:51.932354 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1469/2949] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:50:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:51.942820 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a51c-a913-4df4-b05a-28f91598a0fe admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:51.944644 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3264a51c-a913-4df4-b05a-28f91598a0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:51.972137 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:52.017246 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a51c-a913-4df4-b05a-28f91598a0fe admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:52.022648 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc368d9-7225-4772-944d-a84e3b070068 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0dece90fc54641be30cdc2ddad9cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:52.023292 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc368d9-7225-4772-944d-a84e3b070068 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:52.023545 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc368d9-7225-4772-944d-a84e3b070068 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:52.023808 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc368d9-7225-4772-944d-a84e3b070068 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:52.036425 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc368d9-7225-4772-944d-a84e3b070068 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:52.039107 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc368d9-7225-4772-944d-a84e3b070068 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:52.056893 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1481/2950] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:50:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:51:01.932925 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:02.048007 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=17 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:02.193686 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68220f53-7016-4af1-9192-1cc6891d3221 None None] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:51:02.292496 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68220f53-7016-4af1-9192-1cc6891d3221 None None] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:51:02.297815 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074a0d0-085c-41d9-8a93-bd20a0660f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:51:02.298441 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074a0d0-085c-41d9-8a93-bd20a0660f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:02.298754 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074a0d0-085c-41d9-8a93-bd20a0660f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:02.299030 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074a0d0-085c-41d9-8a93-bd20a0660f0f admin admin] PATH_INFO: `/v3/users/99ff42621d72414aae829878f44bbc54` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:02.300179 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074a0d0-085c-41d9-8a93-bd20a0660f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=99ff42621d72414aae829878f44bbc54)` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:51:02.302110 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074a0d0-085c-41d9-8a93-bd20a0660f0f admin admin] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:51:02.355495 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e074a0d0-085c-41d9-8a93-bd20a0660f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99ff42621d72414aae829878f44bbc54'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:51:02.356219 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e074a0d0-085c-41d9-8a93-bd20a0660f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99ff42621d72414aae829878f44bbc54'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:51:02.371004 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e074a0d0-085c-41d9-8a93-bd20a0660f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99ff42621d72414aae829878f44bbc54'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:51:02.380941 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e074a0d0-085c-41d9-8a93-bd20a0660f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99ff42621d72414aae829878f44bbc54'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:51:02.389600 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.notifications [None req-e074a0d0-085c-41d9-8a93-bd20a0660f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99ff42621d72414aae829878f44bbc54'} {{(pid=81498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:51:02.395707 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1470/2951] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Sep 1 16:51:02 2022] DELETE /identity/v3/users/99ff42621d72414aae829878f44bbc54 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:51:02.400240 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ae84e-a5df-4c2e-9625-268c2857c1c4 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:02.400525 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ae84e-a5df-4c2e-9625-268c2857c1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:02.400797 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ae84e-a5df-4c2e-9625-268c2857c1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:02.453685 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-635ae84e-a5df-4c2e-9625-268c2857c1c4 None None] MFA Rules not processed for user `935f6e33b5664b82a96e7a902653bf28`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:51:02.454836 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-635ae84e-a5df-4c2e-9625-268c2857c1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:51:02.514405 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1482/2952] 10.222.0.71 () {58 vars in 958 bytes} [Thu Sep 1 16:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:51:02.525397 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074a0d0-085c-41d9-8a93-bd20a0660f0f admin admin] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:51:02.527000 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-e074a0d0-085c-41d9-8a93-bd20a0660f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:51:02.597532 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:02.615183 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074a0d0-085c-41d9-8a93-bd20a0660f0f admin admin] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:51:02.619736 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3db97-4d4e-436f-aa08-b595332e565c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd494fd310b1f40839f113d045f0bdcb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:51:02.620346 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3db97-4d4e-436f-aa08-b595332e565c service neutron] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:02.620629 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3db97-4d4e-436f-aa08-b595332e565c service neutron] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:02.620897 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3db97-4d4e-436f-aa08-b595332e565c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:02.631031 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3db97-4d4e-436f-aa08-b595332e565c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:51:02.632461 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3db97-4d4e-436f-aa08-b595332e565c service neutron] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:51:02.642100 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1471/2953] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:51:02.944613 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ae84e-a5df-4c2e-9625-268c2857c1c4 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:51:02.946819 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-635ae84e-a5df-4c2e-9625-268c2857c1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:51:02.965883 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ae84e-a5df-4c2e-9625-268c2857c1c4 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:51:02.971114 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c869354-d6a2-4d74-8ee7-bcbd48d1d5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935f6e33b5664b82a96e7a902653bf28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4331680a8fba4a9c848da35bab7c3c6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:51:02.973460 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c869354-d6a2-4d74-8ee7-bcbd48d1d5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:02.973766 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c869354-d6a2-4d74-8ee7-bcbd48d1d5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:02.974142 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c869354-d6a2-4d74-8ee7-bcbd48d1d5e5 admin admin] PATH_INFO: `/v3/projects/9738214a81fe442b8e15960d94e93842` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:02.975809 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c869354-d6a2-4d74-8ee7-bcbd48d1d5e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9738214a81fe442b8e15960d94e93842)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:51:02.979037 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c869354-d6a2-4d74-8ee7-bcbd48d1d5e5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:51:03.030099 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6c869354-d6a2-4d74-8ee7-bcbd48d1d5e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9738214a81fe442b8e15960d94e93842', 'request_id': 'req-6c869354-d6a2-4d74-8ee7-bcbd48d1d5e5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:51:03.036404 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6c869354-d6a2-4d74-8ee7-bcbd48d1d5e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9738214a81fe442b8e15960d94e93842', 'request_id': 'req-6c869354-d6a2-4d74-8ee7-bcbd48d1d5e5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:51:03.043788 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6c869354-d6a2-4d74-8ee7-bcbd48d1d5e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9738214a81fe442b8e15960d94e93842', 'request_id': 'req-6c869354-d6a2-4d74-8ee7-bcbd48d1d5e5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:51:03.058216 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6c869354-d6a2-4d74-8ee7-bcbd48d1d5e5 admin admin] The token cache is being invalidate because project 9738214a81fe442b8e15960d94e93842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:51:03.058908 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6c869354-d6a2-4d74-8ee7-bcbd48d1d5e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:51:03.059246 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6c869354-d6a2-4d74-8ee7-bcbd48d1d5e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:51:03.060728 dv-cinder-852208-16-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1483/2954] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Sep 1 16:51:02 2022] DELETE /identity/v3/projects/9738214a81fe442b8e15960d94e93842 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:51:12.638089 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=7 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:13.054532 dv-cinder-852208-16-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:45.158271 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3db97-4d4e-436f-aa08-b595332e565c service neutron] Authenticating user token {{(pid=81498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:51:45.159721 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-23e3db97-4d4e-436f-aa08-b595332e565c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:51:45.261535 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3db97-4d4e-436f-aa08-b595332e565c service neutron] Validating token access rules against request {{(pid=81498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:51:45.325425 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544e963-2ad9-4019-97ea-a310699e7560 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae8db0856ed44088f0bd3cb93701de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9527063094354a99a80822107d2740fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:51:45.326040 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544e963-2ad9-4019-97ea-a310699e7560 service placement] REQUEST_METHOD: `GET` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:45.326320 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544e963-2ad9-4019-97ea-a310699e7560 service placement] SCRIPT_NAME: `/identity` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:45.326871 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544e963-2ad9-4019-97ea-a310699e7560 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:45.328643 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.fernet_utils [None req-b544e963-2ad9-4019-97ea-a310699e7560 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:51:45.340409 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544e963-2ad9-4019-97ea-a310699e7560 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:51:45.341987 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544e963-2ad9-4019-97ea-a310699e7560 service placement] RBAC: Authorization granted {{(pid=81498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:51:45.352758 dv-cinder-852208-16-smb devstack@keystone.service[81498]: [pid: 81498|app: 0|req: 1472/2955] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Sep 1 16:51:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:51:55.347862 dv-cinder-852208-16-smb devstack@keystone.service[81498]: DEBUG dbcounter [-] [81498] Writing DB stats keystone:SELECT=67 {{(pid=81498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}